Quite often a player to the flop or average pot size will get inflated after the sucker leaves and he will likely be replaced by a bunch of fishermen.

Also, you're vastly under-estimating how good a game can be with mostly small and medium pots. Makes it a lot easier to tell where you're at in a hand and tightish aware players can be easily exploited once you know how.