The penalty for late filing of a ledger will depend on the local laws of the jurisdiction in which the business is located. Generally, penalties can include fines, interest, or other administrative penalties.