There are a handful of ways to pay your taxes, not only for back taxes but for any tax due: check or money order, The Electronic Federal Tax Payment System, or credit card or debit card payments.