SlowGuess/ACL_2020_OCR huggingface dataset:
A) The old man was appearing to help Mr. Green while actually tricking him.
B) The old man was appearing to trick Mr. Green while actually helping him.
C) Mr. Green was appearing to help the old man while actually tricking him.
D) Mr. Green was appearing to trick the old man while actually helping him.
Q7-14. Why did the old man say he would show Mr. Green the way instead of just giving directions?
A) So Mr. Green would let him into his car.
B) So Mr. Green would stop his car.
C) So Mr. Green would say something to the old man.
D) So he could answer Mr. Green.
E) So they could go to the hotel.
F) So Mr. Green would take him to the hotel.
Q10-20. Where did the old man expect he and Mr. Green would drive together to?
A) The house
B) The Sun Hotel
C) The side of the road
D) Back nine miles
Q11-22. Why did the man want to ride with Mr. Green?
A) He wanted to get home.
B) He wanted to get to the hotel.
C) He wanted to stand at the side of the road.
D) He wanted to answer Mr. Green.
E) He wanted to get into Mr. Green's car.
Q13-26. What is one reason the man's plan worked?
A) Mr. Green wouldn't know where they were really going.
B) Mr. Green wouldn't know what his name really was.
C) Mr. Green wouldn't know how old he really was.
D) He wanted to see the hotel on the left.
E) He showed Mr. Green the way to the hotel.
B.3.2 General knowledge
For causal and motivational questions, an RoU often includes abstract general knowledge. To interrogate these components of understanding, we we wrote questions where the answer choices do not mention any of the entities in the story. Below are general knowledge questions that target the same two events as the questions immediately above.
While we thought these questions might be especially difficult, XLNet handled them about as well as the causal/motivational questions whose answer choices explicitly mentioned story entities.
Q21-44. What is part of the reason why Mr. Green stopped driving when he first saw the man?
A) In order to ask someone a question, you have to be close to them.
B) In order to get where you're going, you need to stop your car.
C) When you travel around the country, you stop your car.
D) When the evening arrives, you drive your car home.
E) When you're looking for a hotel, you often stop your car.
F) People often pick up hitchhikers.
G) People often stop to help others.
Q22-47. Why did Mr. Green think the man on the side of the road might be able to help him?
A) Often a person in a given area is familiar with the geography of that area.
B) Often a person in a given area gives out useful items.
C) Often one person can give a ride to another person.
D) Often a person on the side of the road needs help.
7856
Q23-48. Why did Mr. Green want to know where the hotel was?
A) Getting to a place usually requires knowing where the place is.
B) Driving around the country usually requires knowing where you are.
C) Talking with a person usually requires seeing where they are.
D) Getting into a car usually requires knowing where the car is.
Q24-51. Why was Mr. Green seeking the old man's help in the first place?
A) People like to sleep comfortably at night.
B) People like to travel in a leisurely manner around the country.
C) People like to talk amiably with each other.
D) People like to see interesting sights on the road.
E) People like to be driven directly to their homes.
Q25-52. Why did the old man say he would show Mr. Green the way, the first time?
A) People sometimes trick others for their own gain.
B) People sometimes trick others in order to help them.
C) People sometimes help others for selfless reasons.
D) People sometimes help others for selfish reasons.
Q26-54. Why did the old man first say he would show Mr. Green the way instead of just giving directions?
A) To show someone the way means going along with them whereas giving directions means just telling them information.
B) To show someone the way means just giving them information whereas giving directions means going along with them.
C) Giving directions is more effective than showing someone the way.
D) Giving directions is less effective than showing someone the way.
E) Giving directions is more friendly than showing someone the way.
F) Giving directions is less friendly than showing someone the way.
Q28-58. Why did the old man expect to be able to control the route as he rode with Mr. Green?
A) When taking directions, people generally go where they are told to go.
B) When taking directions, people usually go somewhere other than where they are told to go.
C) When on vacation, people generally follow their itineraries.
D) When driving with strangers, people are generally very careful.
E) When going to a small house, people generally ride together.
Q29-60. What helps explain why the man wanted to accompany Mr. Green on his drive?
A) People usually want to go home at night.
B) People usually want to go to a hotel at night.
C) People usually want to travel around the country.
D) People usually want to drive with each other.
Q30-62. Why did the old man trick Mr. Green?
A) Being driven home by someone is nice and convenient.
B) Traveling around the country with someone is fun and exciting.
C) Stopping and looking at someone's house is interesting and enjoyable.
D) Answering someone's questions is fulfilling and helpful.
Q31-64. What is one reason the man's plan worked?
A) If someone is unfamiliar with an area, they won't realize if they're going the wrong way.
B) If someone is familiar with an area, they won't realize if they're going the wrong way.
C) If someone is unfamiliar with an area, they will realize if they're going the wrong way.
D) If someone is traveling around the country by car, they will drive an old man's home.
E) If someone wants to go to a hotel, they will go to a small house first.
B.3.3 Spatio-temporal questions
The questions below target the spatial and temporal information in the story, asking how things were physically arranged at different points in time.
7857
Q37-76. Who was in the car at first?
A) Mr. Green
B) Both Mr. Green and the old man
C) The old man
D) Neither Mr. Green nor the old man
Q38-78. Who was in the car when Mr. Green drove to the small house?
A) Both Mr. Green and the old man
B) Mr. Green
C) The old man
D) Neither Mr. Green nor the old man
Q39-80. Who was probably in the car when Mr. Green drove away from the small house?
Q40-82. Who was at the small house at first?
A) Neither Mr. Green nor the old man
B) Mr. Green
C) Both Mr. Green and the old man
D) The old man
Q41-84. Who was at the small house when Mr. Green arrived there?
Q42-86. Who was likely at the small house a short while after the story ends?
A) The old man
B) Mr. Green
C) Both Mr. Green and the old man
D) Neither Mr. Green nor the old man
Q53-109. When driving to the old man's, on which side did they pass the hotel?
A) The car passed the hotel on the right side of the road
B) The car passed the hotel on the left side of the road
C) The car passed the house on the left side of the road
D) The car passed the house on the right side of the road
Q54-111. How were Mr. Green, the car, the old man, and the window probably situated when Mr. Green stopped to ask the man a question?
A) Mr. Green in the car, the window down, the man on the side of the road
B) Mr. Green in the car, the window down, the man in the car
C) Mr. Green in the car, the window up, the man on the side of the road
D) Mr. Green in the car, the window up, the man in the car
E) Mr. Green out of the car, the window down, the man in the car
F) Mr. Green out of the car, the window up, the man in the car
Q55-113. While the two men drove to the old man's house, how was the scene likely arranged?
A) Mr. Green and the man next to each other, in the car
B) The man next to Mr. Green next to the car
C) The car in the man and Mr. Green
D) Mr. Green next to the man next to the car
E) The man at his house and Mr. Green in the car
F) Mr. Green at the hotel and the man at his house
G) Mr. Green at his house and the man at the hotel
Q56-115. When Mr. Green was actually going the right way at the end, how was the scene likely arranged?
A) The man at his house and Mr. Green in the car
B) Mr. Green and the man next to each other, in the car
C) The man next to Mr. Green next to the car
D) The car in the man and Mr. Green
E) Mr. Green next to the man next to the car
F) Mr. Green at the hotel and the man at his house
G) Mr. Green at his house and the man at the hotel
B.3.4 More variant groups
As described in the paper, for each question we wrote a second version that targeted essentially the same information in a different way. Below are additional examples of such variant groups.
7858
Q19-39. Why could the man still help Mr. Green by showing him the way at the end of the story?
A) Mr. Green still didn't know how to get to the hotel.
B) Mr. Green still didn't know that he was at the man's house.
C) Mr. Green was still looking at the house.
D) The old man knew where Mr. Green's car was.
Q19-40. What information was Mr. Green missing that the man provided when he showed him the way the second time?
A) Mr. Green didn't know how to get to the hotel.
B) Mr. Green didn't know that he was at the old man's house.
C) Mr. Green didn't know who the old man was.
D) The old man knew where Mr. Green's car was.
Q46-94. Who was in the car just before Mr. Green met the old man?
Q46-95. Who was in the car when Mr. Green approached the spot where he met the old man?
Q22-45. Why did Mr. Green want to speak to the old man?
A) People ask questions when they lack information.
B) People are interested in the places they travel.
C) People are often very curious.
D) Old men at the side of the road sometimes know the future.
E) People ask questions before letting people into their cars.
F) People interrogate hitchhikers before picking them up.
Q22-46. Why did Mr. Green think the old man might be able to help him?
A) Sometimes one person has information another person doesn't.
B) Sometimes one person trades a car for another person's house.
C) Sometimes one person gives a ride to another person.
D) Sometimes one person on the side of the road gets in another person's car.
7859