Even though you may be able to escape the government with your credit card, you could face a slew of other problems that you need to know about. In most cases, it is easier to work out an installment plan directly with the government.