What if the guy is raising with 57 suited and bluffs you out every time you miss your set and gives you no action when you hit?

or

You have 66, the flop is A96 and the guy had KK? how much do you make here?

You need a very good board or a very dumb opponent to double up, I think it's very easy to overestimate our implied odds with small pockets.