It depends. Penalty abatement (or forgiveness) is much more common than interest abatement. You’re likely to get abatement for certain penalties if you have a clean compliance history (called first-time abatement) or have reasonable cause for not following the rules. Interest abatement is difficult to qualify for. It usually happens only if the IRS delayed your request, causing you to owe more interest.