The penalty for the late filing of IRS Form 5329 is $50 for each IRA or Roth IRA for which the form is not filed on time. This penalty is assessed for each tax year for which the form is late.