When A or K falls in the flop, how many players does it take to weak you out -- make you fold to a reasonable bet?

If I'm in late and a guy bets on that King, obviously I'm out of there. But how about this one:

PF I raise modestly into 3 limpers, and only one stays in. And there's the K in the flop. I bet about the pot and he raises pretty big. He's middle, almost late position.

Doesn't it hurt your rep if they see you folding every time a K shows up? I can see a guy calling a PF raise from there with a great many hands -- any pair, suited conn, any ace. Am I really just supposed to assume that I'm beat here?