Pre flop is fine as shoving will likely make him fold some hands that you will get value from later.

On the flop you have outs + he does this with quite a few hands other than the nuts so call.