Adultery is assumed to belong to a realm of casual contact. It is also the narrative of Lysias 1. Euphiletus insists that he had no other contact with Eratosthenes. Obviously, in a culture in which this is a stereotype, the stereotype itself may encourage the behavior. But this kind of relationship is inherently very difficult in a society like classical Athens.
Strangers are very visible.
Neighbors watch comings and goings, and among the well-off slaves are inevitably in the know and subject to pressure. The situation might in some ways be different among the poor, where there are no slaves and women go out alone to work. From the prospective adulterer's point of view, the rewards in an affair with a married woman to whom he might be attracted in a casual way seem very limited compared to the risks. The situation might be different outside the elite and especially in the rural demes. Here there would be far less sexual variety available for males.