It’s unlikely, but not impossible. Usually, when a man leaves his wife, he has a lot of baggage, and the woman from the affair may not be the woman he chooses to be his next partner. Also, second marriages have a much higher chance of divorce than first ones do.