That's strange that he raised with middle pair and didn't raise when he got two pair. I would've thought he flopped top pair or two pair the way he was betting.
Either way, if I was him and he saw where you pulled that hand from, I would've guessed you had a bigger pair even before they, err, I mean, the flop.Nice avatar.