The most common challenge that married couples face when looking for sex outside of their marriage is the fear of being discovered and judged. It can be difficult to find someone who understands and respects the boundaries of an extramarital relationship, and it takes a lot of trust for both parties involved. There may be social pressures or family concerns about engaging in this kind of behavior, which can add stress to the situation.