Generally, interest charged by the IRS is not available for abatement.  However, penalties are available for abatement provided the taxpayer qualifies.