It is possible for you to pay your tax penalty in installments, but you will have to set up an installment agreement with the IRS. Tax Defense Network professionals are skilled at setting up an IRS penalty payment plan that works for you.