The only way to stop the IRS from assessing penalties and interest is to timely pay your tax liability. Tax planning with a CPA is critical to avoiding late or under payment penalties and interest.