The IRS can impose a penalty of up to 25% of the amount of the tax due for failing to file a return on time. The amount of the penalty depends on the amount of the tax due and the length of time the return is late. The longer the return is late, the larger the penalty.