If you are e-filing your Form 2290 and trying to make your irs 2290 payment through a trusted provider like eForm2290, you can authorize a direct debit from your bank account towards the HVUT payment.