Given his stack size i think this is fine, his range contains more top pair hands than hands that beat you and he certainly isn't folding them.