The penalty for the late filing of form 2119 is typically a percentage of the unpaid tax due, calculated based on the number of days the form is overdue. The exact penalty rate may vary depending on the tax laws and regulations in effect for that tax year.