I would strongly consider moving tables if he has table position on you. I also think that you should do whatever seems the most profitable. It would be good practice I think to continue playing against these guys when you feel up to it though.

The problem might be that you're getting impatient about when to confront this guy. Play your laggy style when he's not in the hand. Try to reraise him pf with your mediocre holdings because you know he'll have worse. Don't do as many cont bluffs with him in the hand. Resteals are much more powerful against this guy.

You can also just say, "I'm not messing with him" and stay away from his pots until you have a premium hand.