No, you may not sue the church: an employer is not responsible or liable for an employee's acts which  are outside his job duties and responsibilities, and it is not part of a pastor's job description to have affairs with a parishoner's wife.And more generally, your state (CA) does not allow what were traditionally titled "alienation of affection" lawsuits at all: you cannot sue because someone had an affair with a spouse.