Because you minraised preflop, I would continue this hand. If you had put in a reasonable raise preflop and he still reraised you preflop and on the flop, you might consider letting this go.