NTCIR-14 Kick-off Event
March 20, 2018
English session: 13:00 ~ 14:30
Japanese session: 14:45 ~ 16:15

Program• Overview of NTCIR• Overview of NTCIR-14• Task Introduction (7 min x 6 tasks)• Why participate?
• How to participate• Important Dates
• Q&A



Overview of NTCIROverview of NTCIR-14

Organization at NTCIR-14

GeneralCo-chairs

Participants

TaskOrganizers

ProgramCommittee

General Co-chairs

Charles L. A. Clarke
Facebook, USA

Noriko Kando

National Institute of Informatics, JapanProgram Committee (PC)• Makoto P. Kato (Co-chair, Kyoto University, Japan)• Yiqun Liu (Co-chair, Tsinghua University, China)
Ben

Carterette University of Delaware

Hsin-Hsi

Chen

National Taiwan University

Tat-Seng

Chua

National University of Singapore

Maartende Rijke

University of Amsterdam

NicolaFerro

University of Padova

KalJarvelin

University of Tampere

GarethJones

Dublin City University

Mandar

Mitra

Indian Statistical InstituteDouglasOard

University of Maryland

Tetsuya

Sakai

Waseda University

Mark

Sanderson RMIT University

Ian

Soboroff

NIST

Emine

Yilmaz

University College London

NTCIR-14 General Schedule

Note that each task can have its own schedule
Date

EventMar 20, 2018

Kick-off event in TokyoJun 2018

Task Registration Due

Jun 2018

Dataset Release

Jun-Jul 2018

Dry Run

Aug-Oct 2018

Formal Run

Feb 1, 2019

Evaluation Result ReleaseFeb 1, 2019

Early draft Task Overview Release

Mar 15, 2019

Participant paper (draft) submission due

May 1, 2019

All camera-ready copy for the Proceedings due

Jun 2019

NTCIR-14 ConferenceNew Trial at NTCIR-14: LNCS Publication• Post-conference proceedings
published by LNCS
– Only selected papers will be invited• Submit a good paper to NTCIR,
and get the paper published by LNCS
Tentative Schedule (the details will be announced later)
Jun 17, 2019

Invitation of LNCS publication sent to selected papers

July 15, 2019

Submission due of invited LNCS papers

August 5, 2019

Camera-ready LNCS paper dueOctober 2019

LNCS Post-conference proceeding publishedFocuses of NTCIR-14

1. Heterogeneous information access
2. Dialogue generation and analysis
3. Meta research on information
access communitiesSearch for questions

OpenLiveQ
Search for web pages

SearchWWW
Search for lifelog data

Lifelog

Heterogeneous dataA!

Summarizing dialog data

QALabGenerating dialogues

Summarize
GenerateSTC
Reproduce the best practicesCENTRE

B?

C…

Dialog data
Reproduce

NTCIR-14 Tasks• CORE– Personal Lifelog Organisation & Retrieval (Lifelog-3)– Open Live Test for Question Retrieval (OpenLiveQ-2)– QA Lab for Politics Minutes (QALab-PoliInfo)– Short Text Conversation (STC-3)– We Want Web (WWW-2)• PILOT– CLEF/NTCIR/TREC REproducibility (CENTRE)How to participate

How to participate

1. Read the task
description andCFP carefully
2. Contact a TO if you
have questions
3. Decide a task toparticipate
4. Register as aparticipant at
NTCIR website

5. Fill in User
Agreement Forms
6. Keep an eye on atask’s ML, website,etc. to follow theactivity
Don’t hesitate tosend a feedback toTO

What Participants Must Do

1. Submit your runs
2. Submit a paper to NTCIR-14 Conference– Demonstrate your systems and methods

3. Attend the NTCIR-14 conference
and give a presentation– Every group will give a poster presentation– Some will give an oral presentation, tooWhy participate? (Students)• Easy start-up– Much of experimental
setup is provided– Performance measuresare (often) defined• Increase your visibility– Demonstration of youridea and achievement foracademics andindustries• Publications– Comparison with otherparticipants can produce
stronger arguments– Inspired by theinternational community
for future work

• Diverse tasks– A variety of Information
access tasks to tackleWhy participate? (Industry)• Establish your brand– To your end-users andcompetitors– Recruit smart people• Fair benchmarking– Comparison with yourown products can beless reproducible– Critical self-assessments• Faster development– Brushing up your productor eliminating bugs in alimited period of time

• Early access toresultant resources– Secondary resources
developed by the task areyours, tooWrap-up• The fourteenth cycle of NTCIR has started– Will conclude in June 2019

• Six exciting tasks are running– Organized by leading researchers worldwide• Lots of opportunities for innovative work
– Exchange great ideas with the community

What we need is your participation!
http://research.nii.ac.jp/ntcir/ntcir-14/-,,

Q & A?

-.
. .

!

-.

..

,,.