Penalties for late filings can include fines, interest on the owed tax, and in severe cases, legal action. The specific penalties vary by state, so it's important to understand the rules in each state where you conduct business.