Seems to me you had him beat. Maybe the card that gave you the flush gave him two pair. I see it happen all the time. By semibluffing the draw, you somewhat disguised your flush when it came. He may have been gambling that you didn't have it. He probably didn't think flush was a factor.