Yes, most men miss their affair partners, especially if their partners are passionate and easy to be with compared to their spouses or primary relationship partners. Affairs often provide an outlet and a safe haven for men, which is what they miss.