If you're unable to pay your taxes or penalties, contact the IRS to discuss options such as a payment plan or negotiating a lower amount. Be aware that penalties and interest accrue until the debt is fully paid.