Hmmm... Why would he have reraised so high?
a. Has a 4 (shouldn't have called with a 4)
b. Has a Q (you're beat atm)
c. Has AA (you're beat atm)
d. Bluffing.

So without a read on him, we should have folded, at least on the turn, when he didn't back off. Not saying I would have, but I know I should!