Generally, if you miss the filing due date or fail to file by the tax extension deadline, the IRS may charge a failure-to-file penalty. The penalty is based on your unpaid taxes, and the IRS charges 5% of your taxes due for every month or partial month your tax return is not filed.