The couple is having an affair'