The penalty for the late filing of payroll tax withholding varies depending on the country and the specific laws of the jurisdiction, but in general it could include fines, penalties, and other costs. In the United States, the penalty for not filing payroll taxes on time is a failure-to-file penalty of 5% of the unpaid taxes for each month or part of a month that the return is late, up to a maximum of 25% of the unpaid taxes.