Unfortunately, as long as you owe money to the IRS, interest will accrue on your account. You will also pay penalty fees based on what you owe. However, the elimination of some penalties may be possible in cases of major life circumstances that have made repayment difficult.