The couple are attending sunday services at the church