I'd have played it the same way. He's probably putting you on the flush draw, so each round you call the trap gets deeper. It worked out nicely that the flush card didn't come, so he won't be afraid of you coming over the top. Nice trap.