MEMORANDUM ON PERMISSION TO USE
NTCIR TASK PARTICIPANT TEST COLLECTION(FOR NTCIR WORKSHOP PARTICIPANTS)

This Memorandum is made and entered into this [] day [], year [] between National Institute of Informatics, a division ofInter-University Research Institute Corporation Research Organization of Information and Systems, a corporation incorporated in Japan and having
its registered office at 4-3-13 Toranomon, Minato-ku, Tokyo, Japan 105-0001 (hereinafter “NII”) and ___________________________________________________________________________________________________________ (hereinafter “USER/USER’S RESEARCH GROUP”)
with regard to the NTCIR-9 Interactive Visual Exploration Task Participant Test Collection which NII provides at the NTCIR Workshop 9 .

Article 1. Description of Data
1.
2.
3.
4.
5.

Document Data is defined as data which appears in Section 1 of the Appendix attached herein.
Task Data is defined as data which appears in Section 2 of the Appendix attached herein.
Raw Submission Data is defined as data that the results which were submitted by task participants of the NTCIR workshop that NII organized.
Evaluation Data is data obtained by using the basic evaluation tools defined by NII against “Raw Submission Data”.
Test Collection consists of the Task Data., Raw Submission Data and Evaluation Data.

Article 2. Retention of Rights
1.
2.
3.
4.

The copyright holders of Document Data are defined in Section 3 of the Appendix attached herein.
The copyright holders of Task Data are defined in Section 4 of the Appendix attached herein.
USER/USER’S RESEARCH GROUP retains all intellectual property rights relating to the technology and systems developed by USER/USER’S RESEARCHGROUP using the Test Collection.
NII retains all intellectual property rights relating to analytical results obtained by NII and improvements on the Test Collection and such made by NII based on datasubmitted by USER/USER’S RESEARCH GROUP.

Article 3. Permission for Use
NII hereby permits USER/USER’S RESEARCH GROUP to use the Test Collection.

Article 4. Scope of Authorized Use
1.
2.
3.

USER/USER’S RESEARCH GROUP shall use Test Collection solely for the purpose of accomplishing tasks set out in the NTCIR Workshop and for the purposeof research related to the tasks until and inclusive of the last day of September 2012, the end of the term of NTCIR-9 Workshop.
USER/USER’S RESEARCH GROUP shall use the Test Collection solely for the purpose of research related to information retrieval and natural language
processing after the end of the term of NTCIR-9 Workshop.
USER/USER’S RESEARCH GROUP shall not sell, lend, publish, distribute, or make transmittable to a third party the Test Collection, copies of the Test Collection,or processed data which would enable a third party to reproduce the Test Collection.

Article 5. Method of Provision
NII will provide the Test Collection to USER/USER’S RESEARCH GROUP using a method which is defined in Section 5 of the Appendix attached herein.

Article 6. Scope of Users
1.
2.

The scope of users of the Test Collection shall be limited to USER/USER’S RESEARCH GROUP and members of the immediate group jointly conducting
research with USER/USER’S RESEARCH GROUP.
USER/USER’S RESEARCH GROUP shall maintain a list of users and make this list available to NII without delay upon request from NII.

Article 7. Presentation of Knowledge
1.
2.
3.

4.
5.
6.
7.

USER/USER’S RESEARCH GROUP may present research findings concerning knowledge obtained using the Test Collection provided that the aforementioned
presentation is within the limits of this Memorandum.
USER/USER’S RESEARCH GROUP may quote in part data included in the Test Collection if and only if the aforementioned data is required to describe
USER/USER’S RESEARCH GROUP’s own research. In such cases, USER/USER’S RESEARCH GROUP shall not violate the rights of the authors, publishers
and others protected by copyright.
When USER/USER’S RESEARCH GROUP shall present research findings concerning knowledge obtained using the Raw Submission Data and Evaluation
Data, USER/USER’S RESEARCH GROUP shall clearly mention USER/USER’S RESEARCH GROUP’s use of the data and clearly state the experimental
nature of the data and the data collection procedure of the data.
USER/USER’S RESEARCH GROUP shall always reference the NTCIR workshop proceedings and clearly state in the paper, thesis or other presentation that
USER/USER’S RESEARCH GROUP presents: (a) USER/USER’S RESEARCH GROUP’s use of the Document Data and (b) USER/USER’S RESEARCHGROUP’s use of the Test Collection.
USER/USER’S RESEARCH GROUP shall submit to NII: (a) a publication report including bibliographic information of the publication (the titles of thepublication, volume, pages, publishers’ names and dates), and (b) one (1) offprint or one (1) copy of the publication each time when USER/USER’S RESEARCHGROUP publishes the research results using the Test Collection or part of the Test Collection.
Before making public any information data developed using the Test Collection, USER/USER’S RESEARCH GROUP should receive consent in writing fromNII in advance.
USER/USER’S RESEARCH GROUP shall not use evaluation results obtained through use of the Test Collection for profitable purposes including advertising,
and/or defamatory or slanderous purposes.

Article 8. Duration of Memorandum
1.
2.
3.

This Memorandum shall be in effect from the date first above written until and inclusive of the last day of September 2012. The effect of the Memorandum shall be
extended automatically to another fiscal year, unless a written objection is issued either by NII or by USER/USER’S RESEARCH GROUP more than one month
before the expiration date of the Memorandum. This shall apply to consecutive fiscal years as well.
Notwithstanding the preceding paragraph, if permission for use of the Raw Submission Data and Evaluation Data is requested by USER/USER’S RESEARCHGROUP which shall extend the effect of the Memorandum, USER/USER’S RESEARCH GROUP shall separately enter into a new Memorandum with NII, inaddition to the written notice more than one month before the expiration date of the Memorandum.
If USER/USER’S RESEARCH GROUP would not like to automatically renew the original terms and the renewal terms, after expiration of the term,

2010-12-17

USER/USER’S RESEARCH GROUP shall promptly delete the Test Collection from any computer or media onto which it has been copied. If the organizational
structure of USER/USER’S RESEARCH GROUP or the affiliation of USER/USER’S RESEARCH GROUP is changed, USER/USER’S RESEARCHGROUP shall report the change to NII without delay and, if necessary, shall sign another Memorandum.

Article 9. Submission of Reports
1.
2.

USER/USER’S RESEARCH GROUP shall submit to NII a report on research outcomes in accordance with procedures specified at the NTCIR Workshop.
USER/USER’S RESEARCH GROUP shall submit to NII a report concerning research activities conducted by USER/USER’S RESEARCH GROUP during theduration of the Memorandum using the Test Collection more than one month before the expiration date of the Memorandum.

Article 10. Termination of Data Use
1.

If the use of data is deemed to be in violation of the Memorandum, USER/USER’S RESEARCH GROUP shall, upon instructions from NII, immediatelydiscontinue use of the Test Collection and promptly delete the Test Collection and all data obtained by processing the Test Collection from any computer or media
onto which it has been copied. USER/USER’S RESEARCH GROUP shall submit a document attesting to deletion of the data to NII.
If there is a request to discontinue the use of data from the copyright holder(s) or their executor(s) of the Test Collection, USER/USER’S RESEARCH GROUP
must delete said data from any computer or media onto which it has been copied upon instructions from NII. USER/USER’S RESEARCH GROUP shall submit adocument attesting to deletion of the data to NII.

2.

Article 11. Exemption from Liability
NII and the copyright holder(s) or their executor(s) of the Test Collection shall not for any reason whatsoever be responsible for losses arising from USER/USER’SRESEARCH GROUP’s use of the Test Collection.

Article 12. Undefined Issues
Should any issues undefined in this Memorandum arise, both parties shall confer in good faith and resolve such issues.

Article 13. Jurisdiction
All disputes relevant to this Memorandum shall be subject to the exclusive jurisdiction of the Tokyo District Court of Japan as court of first instance. The validity,construction and performance of this Memorandum shall be governed by, and interpreted in accordance with, the law of Japan.

Both parties hereto have caused this Agreement in duplicate to be executed by their duly authorized officers as of the date first above written.
Signed for and on behalf ofNII:

Inter-University Research Institute Corporation
Research Organization of Information and Systems

Signature:
Name (in print):
Title:
Division:
Notice address:___________________________________________________
Noriko Kando
Leader, NTCIR Project, Professor
The National Institute of Informatics
2-1-2 Hitotsubashi, Chiyoda-ku, TokyoJAPAN
101-8430

Signed for and on behalf ofUSER/USER’SRESEARCHGROUP:
Signature:___________________________________________________Name (in print):
Title:
Division:
Notice address:_____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

2010-12-17

APPENDIX- NTCIR-9 INTERACTIVE VISUAL EXPLORATIONTASK PARTICIPANT TEST COLLECTION(FOR NTCIR WORKSHOP 9 PARTICIPANTS)
Section 1.
A formal name is called NTCIR-9 Interactive Visual Exploration Task Document Data with, and the term of "Document Data", is defined as data
selected and composed by USER/USER’S RESEARCH GROUP from data which appears in Table A that NII is granted permission by therightful copyright holder(s) or executor(s) thereof to permit use of the data for the participants in the NTCIR Workshop 9.
Table A (please tick the resources you are requesting):□ A.1 Japanese Dataset
Mainichi Newspaper Full-Text Article Database 1998-2001 (Copyright holder: Mainichi Newspaper)With regard to permission to use of ‘Mainichi Newspaper Full-Text Article Database 1998-2001’, if and only if USER/USER’S RESEARCHGROUP submit to NII a report on research outcomes in accordance with procedures specified at the NTCIR Workshop on or before theappointed date, the permitted term shall be extended automatically to another fiscal year. This shall apply to consecutive fiscal years as well.
Provided that ‘Mainichi Newspaper Full-Text Article Database 1998-2001’ shall continue to be in force for further period of one year, five times alimit until 30st September , 2017
Section 2.
1.
A formal name is called NTCIR-9 Interactive Visual Exploration Task Data with, and the term of "Task Data", is defined as data selected andcomposed by USER/USER’S RESEARCH GROUP from data which appears in Table B.
Table B (please tick the resources you are requesting):□ NTCIR-7 ACLIA Cross-Lingual Information Retrieval Data/Question Answering Data
□ NTCIR-7 Multimodal Summarization for Trend Information Dataset□ NTCIR-9 Interactive Visual Exploration Dataset
2.
NTCIR-7 ACLIA Cross-Lingual Information Retrieval Data/Question Answering Data consists of a set of questions pertaining to the contentsof the Document Data, the ID lists of the relevant documents for each question, and words or phrases extracted from Document Data which
justify these relevant documents, descriptions which are answers to those questions, and the IDs and essential portions of documents that arenecessary to justify those answers.
3.
NTCIR-7 Multimodal Summarization for Trend Information Dataset consists of 701 articles tagged and chosen from Document Data by NII,
whose topics are relevant to researches on the task, corpus data that consists of annotations on the articles and data tables constructed from thearticles, a set of information extraction queries (of T2N subtask) and their correct answers pertaining the articles.
4.
NTCIR-9 Interactive Visual Exploration Dataset consists of named entity annotation of essential portions of documents for selected topics ofCross-Lingual Information Retrieval Data/Question Answering Data; lists of information nuggets of summarization of trends for selected
topics of Multimodal Summarization for Trend Information Dataset; and some additional description on the correct answers to selected topicsof Cross-Lingual Information Retrieval Data/Question Answering Data.
Section3.
The copyright holder of the data, whose name appears in Table A, retains all rights under the Copyright Law relating to Document Data.
Section4.
The copyright holder of the data, whose name appears in Table A, retains all rights under the Copyright Law relating to the articles whose topics arerelevant to researches on the task. NII retains all rights under the Copyright Law relating to Task Data with the exception of the articles whosetopics are relevant to researches on the task. Task Data are concerned with the contents of documents included in the Document Data; however, allrightful holders of the documents in the Document Data under the Copyright Law are not responsible for their content.
Section5.
1.
NII will provide Document Data to USER/USER’S RESEARCH GROUP by using a technologically appropriate method.
2.
NII will provide Task Data to USER/USER’S RESEARCH GROUP by transferring the data files electronically.

2010-12-17