Whether you owe back taxes or current taxes, you may be hit with significant penalties and interest accruals over time if you don't pay. The failure to pay penalty starts at .5% of your balance due per month (capped at 25% of the back taxes you owe).