The Social Security Administration mandates that you must provide evidence of your marriage. Evidence to prove a common-law marriage in the States that recognize such marriages must include: A statement from each spouse and a statement from a blood relative of each, if both spouses are living, OR.