If you don’t pay state taxes, you’ll face penalties similar to those imposed by the federal government. These include penalties, interest, and interest on penalties.