Yes. If you don’t close your business, you must continue to pay the taxes and fees that the company owes, including any annual fees charged by your state. You may also incur late fees and penalties. In addition, you’re subject to continuing bills for any existing leases and contracts. You continue to be responsible for the actions (or inactions) of the company and could face possible lawsuits.