Rick (Owen Wilson) and Fred (Jason Sudeikis) are best friends as are their wives, Maggie (Jenna Fischer) and Grace (Christina Applegate). They are both unhappy with their married lives and missing the old days when they were single. Realizing this, their wives talk to their friend Dr. Lucy (Joy Behar) and decide to give them a "Hall Pass": A week off from marriage during which they can have sex with other women. They are skeptical at first, but ultimately accept the offers and try to pick up women with their friends Gary (Stephen Merchant), Flats (J. B. Smoove) and Hog Head (Larry Joe Campbell). Maggie and Grace spend Rick's and Fred's "Hall Pass Week" at Maggie's parents' house in Cape Cod, where Grace flirts with athlete Gerry (Tyler Hoechlin). She says that if their husbands have Hall Passes, so should they.
With their wives and children away, Fred and Rick check in at a motel and prepare for their Hall Pass Week. On day one, they decide to eat before going to a local bar and get too tired to spend the night there, preferring to stay at the hotel.
On day two, they eat hash brownies and decide to play golf, but get too high and wreak havoc on the golf course.
On day three, Rick and Fred go to a bar with their friends but fail to impress the women there. They decide to get drunk in order to become more loose, but go too far and wind up getting into a fight with other customers. They spend day four at the hotel suffering from a hangover.
On day five, Rick goes to a local coffee shop where Rick flirts with an attractive waitress named Leigh (Nicky Whelan), much to the annoyance of her co-worker Brent who insults Rick. When Rick answers him back, Leigh is impressed and tells Rick that they might see each other at the local gym. They later meet there, and Leigh invites Rick for a beer after they work out. Rick decides to sit in the hot tub instead, but falls asleep and stays there for several hours ending up with his muscles too weak to use and forced to accept the help of two naked men to leave much to his dismay. Meanwhile, Grace and Gerry get closer, while Maggie finds herself attracted to Gerry's coach.
On day six, Rick and Fred go to a bar called Enter the Dragon with their friend Coakley (Richard Jenkins), where Rick meets his children's babysitter Paige (Alexandra Daddario), who has just turned 21 and is with her aunt Meg. Paige is attracted to Rick, but he shoots her down to dance with Leigh. Brent, the party's DJ, is angry at this. After the party is over, Rick goes to party at Coakley's while Fred takes a girl to his motel room. However, she feels sick and, after a minor incident in the bathroom, is sent back home by Fred before they can have sex. Later that evening Paige's aunt shows up at the room and mistakes Fred for Rick, eventually seducing him. Fred fakes oral sex on Meg until they are interrupted by Rick.
Meanwhile, Gerry's coach tries to seduce Maggie, but she rebuffs him. Grace, on the other hand, has sex with Gerry, but tells him it will be just that one time. On her way back home, she feels guilty about cheating on Fred and has a car accident.
At Coakley's house, Rick is approached by Brent who is angry at Rick for going out with Leigh. Leigh calms Brent, then finds Rick alone in a bedroom and offers him a one-time fling. He initially wants to do it, but ultimately rebuffs her, unable to cheat on Maggie. After answering Fred's phone, Rick learns of Grace's accident and makes his way to the hotel to tell him. In the lobby he finds Paige, who thinks he was having sex with her aunt Meg. They enter the room and find Fred having fake sex with her. After finding out the truth, Meg kicks Fred in the face.
Upon hearing about Grace's accident, Fred tries to go to the hospital but finds Brent vandalizing what Brent thought was Rick's car. Upon seeing Paige's aunt Meg, his mother, at the hotel, Brent thinks Fred has had sex with her and tries to kill him as well, but runs out of bullets and is tackled by Paige and his mother. Rick and Fred enter Fred's car and make their way to the hospital with Brent and the police chasing them. At the hospital, Brent is arrested for attacking them and Fred finds out Grace only broke her nose.
Rick goes back home and finds Maggie. He tells her he did not use the Hall Pass and remembers the time he lost his virginity to her. She is the only woman he has ever been with. Moved by his declaration, Maggie tells him she did not use her Hall Pass either and they reconcile and have sex for the first time in months. Fred and Grace also reconcile and decide to hide their cheating from one another. However, Fred ultimately confesses that he used his Hall Pass with Paige's aunt when Grace asks him to take her to see Kathy Griffin.
During the credits, Fred hosts a barbecue where he pays Kathy Griffin to be present. Noticing how happy Maggie and Grace are following the Hall Pass week, Gary's wife suggests that she give him a Hall Pass. After a fantasy where he sleeps with a married woman, resulting in the death of her, her husband, her grandmother and several innocent bystanders (and ending with him getting anally raped in prison), Gary agrees to "give it a whirl".

Question: Who did Fred use his hall pass with?
Answer: Paige's aunt Meg
Alternative answer: Meg