The real question is how often you would recognize the set and correctly fold vs how often you would get bluffed into folding. I would say that the situation is rare enough that you would almost certainly be costing yourself money long term if you are constantly worried about that set coming up unless you REALLY know the people you are playing against.