Both civil and criminal remedies apply against businesses and owners that refuse to file or pay the business privilege tax. If your business does not file and pay the business privilege tax, you may be subject to penalties, interest, costs of collection and even imprisonment.