Short answer, yes, its wrong, and it increases the chances you will be going broke.

Bankroll management is meant to protect you from going broke (assuming you are a winning player of course) due to short term variance, 20 buy in is the minimum to have, and I think 25-30 buy in is much more recommended.

You are not in competition with anyone about who will win more money faster, nothing will happen if it will take you 2-3 more months to move up in limits