MEMORANDUM ON PERMISSION TO USE
NTCIR-12 QA Lab for Entrance Exam TASK PARTICIPANT TEST COLLECTION(FOR NTCIR WORKSHOP PARTICIPANTS)

This Memorandum is made and entered into this [] day [], year [] between National Institute of Informatics, a division ofInter-University Research Institute Corporation Research Organization of Information and Systems, a corporation incorporated in Japan and having
its registered office at 4-3-13 Toranomon, Minato-ku, Tokyo, Japan 105-0001 (hereinafter “NII”) and ______________________________________________________________________________________________________________________________________________ (hereinafter“USER/USER’S RESEARCH GROUP”) with regard to the NTCIR-12 QA Lab for Entrance Exam Task Participant Test Collection which NII
provides at the NTCIR Workshop 12 .
Article 1. Description of Data
1.
2.
3.
4.
5.

Textbook Data is defined as data which appears in Section 1 of the Appendix attached herein.
Task Data is defined as data which appears in Section 2 of the Appendix attached herein.
Raw Submission Data is defined as data that the results which were submitted by task participants of the NTCIR workshop that NII organized.
Evaluation Data is data obtained by using the basic evaluation tools defined by NII against “Raw Submission Data”.
Test Collection consists of the Textbook Data, Task Data., Raw Submission Data and Evaluation Data.

Article 2. Retention of Rights
1.
2.
3.
4.

The copyright holders of Textbook Data are defined in Section 3 of the Appendix attached herein.
The copyright holders of Task Data are defined in Section 4 of the Appendix attached herein.
USER/USER’S RESEARCH GROUP retains all intellectual property rights relating to the technology and systems developed by USER/USER’S RESEARCHGROUP using the Test Collection.
NII retains all intellectual property rights relating to analytical results obtained by NII and improvements on the Test Collection and such made by NII based on datasubmitted by USER/USER’S RESEARCH GROUP.

Article 3. Permission for Use
NII hereby permits USER/USER’S RESEARCH GROUP to use the Test Collection.

Article 4. Scope of Authorized Use
1.
2.

3.
4.
5.

USER/USER’S RESEARCH GROUP shall use Test Collection solely for the purpose of accomplishing tasks set out in the NTCIR Workshop and for the purposeof research related to the tasks until and inclusive of the last day of March 2017, the end of the term of NTCIR-12 Workshop.
USER/USER’S RESEARCH GROUP shall restrict uses of DATA are done only by the following Research Representative (hereinafter referred to as“Representative”) and by those who belong to the organization (regardless of its name, such as “laboratory”, “group” or “project”) that Representative is a memberof, and do research jointly with Representative or are graduate students and the like Representative supervises (hereinafter referred to as “Group”).
Research Representative:
Name:
Title:
Affiliation:
USER/USER’S RESEARCH GROUP shall not sell, lend, publish, distribute, or make transmittable to a third party the Test Collection, copies of the Test Collection,or processed data which would enable a third party to reproduce the Test Collection.
USER/USER’S RESEARCH GROUP shall use the Test Collection solely for the purpose of research related to information retrieval and natural language
processing after the end of the term of NTCIR-12 Workshop.
USER/USER’S RESEARCH GROUP shall maintain a list of users and make this list available to NII without delay upon request from NII.

Article 5. Method of Provision
NII will provide the Test Collection to USER/USER’S RESEARCH GROUP using a method which is defined in Section 5 of the Appendix attached herein.

Article 6. Presentation of Knowledge
1.
2.
3.

4.

5.
6.
7.

USER/USER’S RESEARCH GROUP may present research findings concerning knowledge obtained using the Test Collection provided that the aforementioned
presentation is within the limits of this Memorandum.
USER/USER’S RESEARCH GROUP may quote in part data included in the Test Collection if and only if the aforementioned data is required to describe
USER/USER’S RESEARCH GROUP’s own research. In such cases, USER/USER’S RESEARCH GROUP shall not violate the rights of the authors, publishers
and others protected by copyright.
When USER/USER’S RESEARCH GROUP shall present research findings concerning knowledge obtained using the Raw Submission Data and Evaluation
Data, USER/USER’S RESEARCH GROUP shall clearly mention USER/USER’S RESEARCH GROUP’s use of the data and clearly state the experimental
nature of the data and the data collection procedure of the data.
USER/USER’S RESEARCH GROUP shall always reference the NTCIR workshop proceedings and clearly state in the paper, thesis or other presentation that
USER/USER’S RESEARCH GROUP presents: (a) USER/USER’S RESEARCH GROUP’s use of Textbook Data (b) USER/USER’S RESEARCHGROUP’s use of Center Shiken Exam Data and (c) USER/USER’S RESEARCH GROUP’s use of Second-stage University Entrance Exam Data and (d)USER/USER’S RESEARCH GROUP’s use of the Test Collection.
USER/USER’S RESEARCH GROUP shall submit to NII: (a) a publication report including bibliographic information of the publication (the titles of thepublication, volume, pages, publishers’ names and dates), and (b) one (1) offprint or one (1) copy of the publication each time when USER/USER’S RESEARCHGROUP publishes the research results using the Test Collection or part of the Test Collection.
Before making public any information data developed using the Test Collection, USER/USER’S RESEARCH GROUP should receive consent in writing from
NII in advance.
USER/USER’S RESEARCH GROUP shall not use evaluation results obtained through use of the Test Collection for profitable purposes including advertising,and/or defamatory or slanderous purposes.

Article 7. Duration of Memorandum
1.

This Memorandum shall be in effect from the date first above written until and inclusive of the last day of March 2017. The effect of the Memorandum shall beextended automatically to another fiscal year, unless a written objection is issued either by NII or by USER/USER’S RESEARCH GROUP more than one month
before the expiration date of the Memorandum. This shall apply to consecutive fiscal years as well.

2015-05-292.

Notwithstanding the preceding paragraph, if permission for use of the Raw Submission Data and Evaluation Data is requested by USER/USER’S RESEARCHGROUP which shall extend the effect of the Memorandum, USER/USER’S RESEARCH GROUP shall separately enter into a new Memorandum with NII, inaddition to the written notice more than one month before the expiration date of the Memorandum.
If USER/USER’S RESEARCH GROUP would not like to automatically renew the original terms and the renewal terms, after expiration of the term,
USER/USER’S RESEARCH GROUP shall promptly delete the Test Collection from any computer or media onto which it has been copied. If the organizational
structure of USER/USER’S RESEARCH GROUP or the affiliation of USER/USER’S RESEARCH GROUP is changed, USER/USER’S RESEARCHGROUP shall report the change to NII without delay and, if necessary, shall sign another Memorandum.

3.

Article 8. Submission of Reports
1.
2.

USER/USER’S RESEARCH GROUP shall submit to NII a report on research outcomes in accordance with procedures specified at the NTCIR Workshop.
USER/USER’S RESEARCH GROUP shall submit to NII a report concerning research activities conducted by USER/USER’S RESEARCH GROUP during theduration of the Memorandum using the Test Collection more than one month before the expiration date of the Memorandum.

Article 9. Termination of Data Use
1.

If the use of data is deemed to be in violation of the Memorandum, USER/USER’S RESEARCH GROUP shall, upon instructions from NII, immediately
discontinue use of the Test Collection and promptly delete the Test Collection and all data obtained by processing the Test Collection from any computer or media
onto which it has been copied. USER/USER’S RESEARCH GROUP shall submit a document attesting to deletion of the data to NII.
If there is a request to discontinue the use of data from the copyright holder(s) or their executor(s) of the Test Collection, USER/USER’S RESEARCH GROUP
must delete said data from any computer or media onto which it has been copied upon instructions from NII. USER/USER’S RESEARCH GROUP shall submit adocument attesting to deletion of the data to NII.

2.

Article 10. Exemption from Liability
NII and the copyright holder(s) or their executor(s) of the Test Collection shall not for any reason whatsoever be responsible for losses arising from USER/USER’SRESEARCH GROUP’s use of the Test Collection.

Article 11. Undefined Issues
Should any issues undefined in this Memorandum arise, both parties shall confer in good faith and resolve such issues.

Article 12. Jurisdiction
All disputes relevant to this Memorandum shall be subject to the exclusive jurisdiction of the Tokyo District Court of Japan as court of first instance. The validity,construction and performance of this Memorandum shall be governed by, and interpreted in accordance with, the law of Japan.

Both parties hereto have caused this Agreement in duplicate to be executed by their duly authorized officers as of the date first above written.
Signed for and on behalf ofNII:

Inter-University Research Institute Corporation
Research Organization of Information and Systems

Signature:
Name (in print):
Title:
Division:
Notice address:___________________________________________________
Masaru Kitsuregawa
Director General
The National Institute of Informatics
2-1-2 Hitotsubashi, Chiyoda-ku, TokyoJAPAN101-8430

Signed for and on behalf of

USER/USER’SRESEARCHGROUP:
Signature:___________________________________________________Name (in print):
Title:
Division:
Notice address:_____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

2015-05-29

APPENDIX- NTCIR-12 QA LAB FOR ENTRANCE EXAMTASK PARTICIPANT TEST COLLECTION(FOR NTCIR WORKSHOP 12 PARTICIPANTS)
Section 1.
A formal name is called NTCIR-12 QA Lab for Entrance Exam Task: Japanese Subtask Textbook Data with, and the term of "Textbook Data",
is defined as data selected and composed by USER/USER'S RESEARCH GROUP from data which appears in Table A that NII is granted
permission by the rightful holder(s) thereof, whose names appear in Section 3, to permit use of the data for the participants as a collaborator ofQA Lab for Entrance Exam Task: Japanese Subtask in the NTCIR Workshop 12.
Table A(please tick the resources you are requesting)□A.1 Japanese Textbook Corpus2 - World History Subset：
A.1.1 the data below that Yamakawa Shuppansha Ltd., provided for NII and appears in the following list
・Detailed explanation World History (『詳説世界史』(世 B 016) ): Text Data of the text and the explanatory note

A.1.2 Annotations that NII assigned to the data that appears in List A.1.1
A.1.3 Indexed Data that NII assigned to the data that appears in List A.1.1
Section 2.
A formal name is called NTCIR-12 QA Lab for Entrance Exam Task Data with, and the term of "Task Data", consists of a set of topics andanswer data that NII created using "Center Shiken Exam Data" and "Second-stage University Entrance Exam Data" and is defined as data
selected and composed by USER/USER'S RESEARCH GROUP from data which appears in Table B.

1.

Table B (please tick the resources you are requesting)□ B.1 NTCIR-12 QA Lab for Entrance Exam Japanese Subtask Task Data
□ B.2 NTCIR-12 QA Lab for Entrance Exam English Subtask Task Data
A formal name is called NTCIR-12 QA Lab for Entrance Exam Center Shiken Exam Data with, and the term of "Center Shiken Exam Data",
consists of a set of NTCIR-12 QA Lab for Entrance Exam Japanese Subtask Center Shiken Exam Data and a set of NTCIR-12 QA Lab for
Entrance Exam English Subtask Center Shiken Exam Data, is defined as data selected, translated and composed by NII from data whichappears in Table C that NII is granted permission by the rightful holder(s) thereof to permit use of the data for the purpose of accomplishingtasks set out in Workshop 12 and for the purpose of research related to the tasks to the participants.
Table C Center Shiken Exam Data:
C.1 "Exam Database of National Center Test for University Admissions: Center Ten 2011 Regular Edition (All subjects) " that JC
Educational Institute, Inc. sells and NII assigned annotations thereto.

2.

A formal name is called NTCIR-12 QA Lab for Entrance Exam Second-stage University Entrance Exam Data with, and the term of"Second-stage University Entrance Exam Data", consists of a set of NTCIR-12 QA Lab for Entrance Exam Japanese Subtask Second-stage
University Entrance Exam Data and a set of NTCIR-12 QA Lab for Entrance Exam English Subtask Second-stage University Entrance ExamData, is defined as data selected, translated and composed by NII from data which appears in Table D that NII is granted permission by therightful holder(s) thereof to permit use of the data for the purpose of accomplishing tasks set out in Workshop 12 and for the purpose ofresearch related to the tasks to the participants.
Table D Second-stage University Entrance Exam Data:
D.1 the Digital data (in pdf format and in word format), the text data and the image data of the inset of the plane of paper of thesecondary entrance exam questions of the University that JC Educational Institute, Inc. provided for NII.
D.2 Annotations that NII assigned to the data that appears in List D.1.
D.3 Answer data and answer nugget data that NII assigned to the data that appears in List D.1.

Section 3.
Yamakawa Shuppansha Ltd., retains all rights under the Copyright Law relating to Textbook Data, except quotations of which copyright holder(s)is defined clearly in the said data as a third party. NII retains all rights under the Copyright Law relating to a set of the annotations.
Section4.
The Copyright Law relating to "Center Shiken Exam Data" included in "Task Data": (i) JC Educational Institute, Inc. retains all rights under theCopyright Law relating to the data, except relating to the examination questions, each work that the questions contains and the annotations. (ii) NII
retains all rights under the Copyright Law relating to the annotations. The Copyright Law relating to "Second-stage University Entrance Exam
Data" included in "Task Data": (i)JC Educational Institute, Inc. retains all rights under the Copyright Law relating to the data, except relating to theexamination questions, each work that the questions contains and the annotations. (ii) NII retains all rights under the Copyright Law relating to theannotations . NII retains all rights under the Copyright Law relating to the answer data and the answer nugget data included in "Task Data".
However, "Task Data" related to "Center Shiken Exam Data" and "Second-stage University Entrance Exam Data", and all rightful holders of"Center Shiken Exam Data" and "Second-stage University Entrance Exam Data" under the Copyright Law are not responsible for their content.
Section5.
1.
NII will provide Textbook Data to USER/USER’S RESEARCH GROUP by using a technologically appropriate method.
2.
NII will provide Task Data to USER/USER’S RESEARCH GROUP by transferring the data files electronically.

2015-05-29