The penalty for the late filing of IRS Form 1024 is $205 for each month or part of a month that the form is late, up to a maximum of 12 months (or $2,460).