While the IRS offers many easy payment options, payroll taxes must be made electronically through the Electronic Federal Tax Payment System (EFTPS). When using this system to file your payroll taxes quarterly or monthly, your funds will be withdrawn directly from your checking or savings account. Therefore, you cannot pay your federal payroll taxes with a credit card.