The penalty for late filing of a marriage certificate can vary depending on the state or country. In some cases, there may be a nominal fee assessed for late filing. In other cases, the marriage may not be officially recognized until the certificate is filed. Additionally, some states may require a court order to make the marriage official if it is filed after a certain deadline. For more information, please contact the local Clerk of Court or the relevant government office in your area.