The IRS penalty for late filing of Form 4626 is 5% of the unpaid taxes for each month or part of a month that the return is late, up to a maximum of 25%. This penalty is in addition to any interest charged on the unpaid taxes.