I personally would have bet the pot ($2) when you hit the flush on the turn, he might not have chased that 2-pair to the river...

- or -

Take the warning on the river, he was quiet for the rest of the hand and then bet into you...