Yes. A penalty for late payment of 1.25% per month is added the day following the due date and the first day of each calendar month thereafter. Payments on account are applied first toward the outstanding interest and penalty, then to the oldest outstanding taxes.