There is no specific penalty for late filing of a baby dedication certificate. However, if the certificate is needed for legal purposes, it may be difficult to obtain the necessary records if the certificate is not filed in a timely manner.