Where do you draw the line of variance???

I know if you go from limit A to limit B, and go from winner to loser, it's because those players are better than you or you play incorrectly in those games.