The penalty for late filing of a premarital certification depends on the state in which you are filing. In general, most states require the premarital certification to be filed before the marriage takes place and may impose a penalty if it is not filed in a timely manner. Penalties can range from fines to possible annulment of the marriage.