TASK DEFINITION: In this task, you will be shown a conversation and a question. You should categorize the question into matching, summary, logic, arithmetic and, commonsense groups. Matching is a question entailed or paraphrased by exactly one sentence in a dialogue. The answer can be extracted from the same sentence. Questions that cannot be answered by the surface meaning of a single sentence belong to the reasoning category. We further define summary, logic, arithmetic and, commonsense subcategories. Answering summary questions requires the whole picture of dialogue, such as the topic of dialogue and the relation between speakers. We require logical reasoning to answer logical questions. in arithmetic questions Inferring the answer requires arithmetic knowledge. To answer commonsense questions, besides the textual information in the dialogue, we also require additional commonsense knowledge that cannot be obtained from the dialogue. Note that a question can be in more than one group. "W" and "M" in the conversations stand for "woman" and "man".
PROBLEM: W: Welcome, everyone. Welcome to Language International. My name is Ema Waston. And I am the center manager. I hope you will all have a wonderful stay here with us. This is Mr. Brone, our social organizer. M: Thank you, Ema. Hello, everyone. I'm Jone Brone, And it's my job to make sure you have some fun while you are here. Now this afternoon we'll go together on the walking tour of the city. And then on Wednesday afternoon, we are off to the legal sports center where you can play volleyball or football, use the gym, or go swimming to keep yourselves fit. And on Friday afternoon, we have a film club. This week's film is Spider Man. On Saturday, we are going on a day trip to Oxford, leaving here at 8:30 in the morning. Please don't be late, or we'll go without you. And finally on Sunday, we are off to London, leaving at the same time. If there are any other things you'd like to do while you are here, just ask me. And I will see if I can help., Question: What are the students going to do on Wednesday? (A) See a film. (B) Play sports. (C) Go sightseeing.

SOLUTION: commonsense

PROBLEM: W: Hello, Dan. I was sorry to hear that you had an accident last week. How did it happen and how are you feeling now? M: Well, I was riding on my bicycle along the street when a taxi driver suddenly made a sharp turn in front of me. I could not stop my bicycle in time and I was knocked down. Fortunately, I only got a broken arm and a broken leg. The doctor said that I would have to stay in hospital for at least a week. W: Do your arm and leg hurt now? M: Yes, my leg hurts badly, but I can bear the pain. The only thing that I'm worried about is my classes. You know, next week we're going to have our mid-term exams. W: Well, don't worry about the exams. I can help you. M: Thank you, but I don't really want to stay here that long. Anyway, thank you for coming to see me., Question: Where does the conversation probably take place? (A) In a hospital. (B) In a classroom. (C) At the man's home.

SOLUTION: summary

PROBLEM: W: May I help you, sir? M: Can I have a look at that suit, please? W: Sure. Here you are. M: Could I try it on, please? W: Yes, the fitting room is over there., Question: What do you think the woman can most probably be? (A) A restaurant waitress. (B) A shop assistant. (C) A school teacher.

SOLUTION:
commonsense