If you owe a large tax bill and haven’t attempted to pay down your balance at all, the CRA may take legal action that could result in serious financial or legal consequences, and damage to your credit score. And, unpaid taxes are subject to penalties and interest charges that can add up over time and become a greater burden on your financial situation.