Ok, so let me get this straight.

You had the lead on him preflop and after every card fell, and he's still betting into you and calling YOU the idiot?

He's right - your odds are only 12% to hit the set - but you also seemed to know he was on a drawing hand - you're a little better than a coin flip.

The inside straight draw raising all in was funny, though.