I think I'd trust your read here and call. You've said you don't think he's flatting pre with any of the possible boats at this point. He could probably do this for value with Q9. If I had to guess I'd put him on TJ or 33, I just don't think his line makes a lot of sense with anything else and it's hard to hit quads.
If he's a thinking player, and you're folding this what does he think you can call with here? I don't suppose you ever get to this point and have a 3, occasionally you've got a boat, but I think the biggest part of your range is similar or weaker than what you have now. So ya, if I was villain and thought you'd fold something as strong as aces to this line I think I'd ship all my air on this river.

cheers