Penalty relief is normally considered as being available to people or businesses incurring a penalty from the IRS for the first time, but a more recent review of their website indicates that you may also qualify if you haven't received a penalty within the last 3 years. In either scenario, you also need to have finished paying your back taxes and interest in full or have made arrangements to do so. You can learn more about penalty relief from the IRS.