You shouldn't decide whether or not to leave based on your stack size. You decide based on if you have an edge at the table. Look at how you are playing, your opponents, and your position on them.

If your stack gets low and its a good table, just addon to your stack. If the table is bad, leave regardless of your stack size.