To improve the quality of the test collections based on the feedback from participants. Documents will be provided for the participants those who returned required signed user agreement form s. Web documents collected from mainly .jp domain. Text processing such as indexing must be done on the machines in the Lab. A participant will conduct one or more of the tasks or subtasks below.
System extracts five answers from the documents in some order.
System is required to return support information for each answer of the questions. System extracts only one answer from the documents. Support information is required. The related questions are given for the 30 of questions of Task 2. Given a set of texts, the participants produce summaries of it in plain text format.