The penalty for late filing of a marriage license can vary depending on the state. Generally, late filing can result in a fine and/or a delay in the marriage being recognized. It is important to consult with the relevant state authorities to understand any applicable penalties.