Penalties for late filing of state tax exemption forms vary by state. Generally, penalties can include interest charges on any late payments, additional fees for late filing, and penalties or fines that may be assessed by the state for not filing on time.