Pre-Conference Sessions:
12:00-17:30
13:00-14:00

Registration <Hitotsubashi Memorial Hall Lobby>(Tutorial) Introduction to NTCIR < Mid-Conference Hall 2.3.4>
Noriko Kando (National Institute of Informatics)*This is mainly for new comers and non-participants. Explaining brief history of NTCIR, how to use NTCIR
collections, evaluation metrics and analysis, etc.

14:00-14:10
14:15-15:35

BreakOpen Submission Session 1 < Mid-Conference Hall 2.3.4>
Chair: Hsin-Hsi Chen (National Taiwan University)
14:15-14:20
WelcomeHsin-Hsi Chen
14:20-14:45
The Effect of Topic Sampling on Sensitivity Comparisons of Information Retrieval Metrics
Tetsuya Sakai
14:45-15:10
Construction of an Evaluation Corpus for Opinion Extraction
Lun-Wei Ku, Tung-Ho Wu, Li-Ying Lee and Hsin-Hsi Chen
15:10-15:35
Multi-Document Summarization Reflecting Information Needs on Subjectivity
Yohei Seki, Koji Eguchi, Noriko Kando and Masaki Aono

15:35-15:50
15:50-17:30

Coffee BreakOpen Submission Session 2 < Mid-Conference Hall 2.3.4>
Chair: Takashi Koga (National Institute of Informatics)
15:50-16:15
A Two-Stage Incremental Annotation Approach to Constructing a Network Informal Language Corpus
Yunqing Xia, Kam-Fai Wong and Robert Luk
16:15-16:40
The Relationship between Answer Ranking and User Satisfaction in a Question Answering System
Tomoharu Kokubu, Tetsuya Sakai, Yoshimi Saito, Hideki Tsutsui, Toshihiko Manabe, Makoto Koyama
and Hiroko Fujii
16:40-17:05
An Analysis of Question Processing of English and Chinese for the NTCIR 5 Cross-Language Question
Answering Task
John Judge, Yuqing Guo, Gareth J. F. Jones and Bin Wang
Report from NTCIR-5 Pilot Workshop
17:05-17:30
MuST: A Workshop on Multimodal Summarization for Trend Information
Tsuneaki Kato, Mitsunori Matsushita and Noriko Kando

Main Conference DAY 1:

Tuesday, December 6, 2005
<National Center of Science (NCS)>

Wednesday, December. 7, 2005

9:00- 17:30
9:00-   9:30
9:30-   9:45
9:45- 10:45

Registration <Hitotsubashi Memorial Hall Lobby>
Light Refreshment
Welcome <Hitotsubashi Memorial Hall >Overview of NTCIR-5  <Hitotsubashi Memorial Hall >Noriko Kando

10:45-11:00
11:00-12:30

BreakSession 1: CLIR-1  <Hitotsubashi Memorial Hall >Chair: Sukhoon Lee (Chungnum National University)
11:00-11:40
Overview of CLIR Task at the Fifth NTCIR Workshop
Kazuaki Kishida, Kuang-hua Chen, Sukhoon Lee, Kazuko Kuriyama, Noriko Kando, Hsin-Hsi Chen and Sung Hyon Myaeng

12:30-13:30
13:30-15:20

11:40-12:00
Word or Bi-gram for Effective Search with Asian Languages
Jacques Savoy
12:00-12:20
POSTECH at NTCIR-5: Combining Evidences of Multiple Term Extractions for Mono-Lingual and Cross-Lingual
Retrieval in Korean and JapaneseSeung-Hoon Na, In-Su Kang and Jong-Hyeok Lee
12:20-12:30
Discussion
Lunch < Mid-Conference Hall 1.2.3.4>
Session 2: CLQA  <Hitotsubashi Memorial Hall >Chair: Chuan-Jie Lin (National Taiwan Ocean University)
13:30-13:52
Overview of the NTCIR-5 Cross-Lingual Question Answering Task (CLQA1)
Yutaka Sasaki, Hsin-Hsi Chen, Kuang-hua Chen and Chuan-Jie Lin
13:52-14:14
NTT's Japanese-English Cross-Language Question Answering System
Hideki Isozaki, Katsuhito Sudoh and Hajime Tsukada
14:14-14:36
CMU JAVELIN System for NTCIR5 CLQA1Frank Lin, Hideki Shima, Mengqiu Wang and Teruko Mitamura
14:36-14:58
NTCIR-5 English-Chinese Cross-Language Question Answering Experiments using PIRCS
Kui-Lam Kwok, Peter Deng, Norbert Dinstl and Sora Choi
14:58-15:20
ASQA: Academia Sinica Question Answering System for NTCIR-5 CLQA
Cheng-Wei Lee, Cheng-Wei Shih, Min-Yuh Day, Tzong-Han Tsai, Tian-Jian Jiang, Chia-Wei Wu, Cheng-Lung Sung,
Yu-Ren Chen, Shih-Hung Wu and Wen-Lian Hsu

15:20-15:40
15:40-17:30

Coffee BreakSession 3: PATENT  <Hitotsubashi Memorial Hall >Chair: Atsushi Fujii (University of Tsukuba)
15:40-16:02
Overview of Patent Retrieval Task at NTCIR-5
Atsushi Fujii, Makoto Iwayama and Noriko Kando
16:02-16:24
Overview of Classification Subtask at NTCIR-5 Patent Retrieval Task
Makoto Iwayama, Atsushi Fujii and Noriko Kando
16:24-16:46
NTCIR-5 Patent Retrieval Experiments at Hitachi
Hisao Mase, Tadataka Matsubayashi, Yuichi Ogawa, Takaaki Yayoi, Yusuke Sato and Makoto Iwayama
16:46-17:08
Patent Document Retrieval and Classification at KAIST
Jae-Ho Kim, Jin-Xia Huang, Ha-Yong Jung and Key-Sun Choi
17:08-17:30
Justsystem at NTCIR-5 Patent Classification
Tetsuya Tashiro, Masaki Rikitoku and Takashi Nakagawa

18:00-20:00

Banquet < Mid-Conference Hall 1.2.3.4>

Main Conference DAY 2:
9:00- 17:30
9:00-   9:30
9:30- 11:20

Thursday, December 8, 2005

Registration <Hitotsubashi Memorial Hall Lobby>
Light Refreshment
Session 4: WEB  <Hitotsubashi Memorial Hall >Chair: Masaharu Yoshioka (Hokkaido University)9:30-10:05
Overview of the NTCIR-5 WEB Navigational Retrieval Subtask 2 (Navi-2)
Keizo Oyama, Masao Takaku, Haruko Ishikawa, Akiko Aizawa and Hayato Yamana
10:05-10:30
Exploiting Anchor Text for the Navigational Web Retrieval at NTCIR-5
Atsushi Fujii, Katunobu Itou, Tomoyosi Akiba and Tetsuya Ishikawa10:30-10:55
Verification of Effective Retrieval Method for Anchor Text on Navigational Retrieval
Kenji Tateishi, Hideki Kawai, Dai Kusui and Toshikazu Fukushima
10:55-11:20
Overview of the NTCIR-5 WEB Query Term Expansion Subtask
Masaharu Yoshioka



11:20-11:50
11:50-12:20

Coffee BreakBoasting 1 (short presentation for DP): CLQA, PATENT, WEB
Chair: Takashi Koga (National Institute of Informatics)

12:20-14:50

Lunch & Digital Poster 1: CLIR, CLQA, PATENT, WEB < Mid-Conference Hall 1.2.3.4>
CLIR
MIRACLE Retrieval Experiments with East Asian Languages
Julio Villena-Román, José Miguel Göni-Menoyo, Jose C. González-Cristóbal, José Luis and Martínez-FernándezCLQA
NTT's Japanese-English Cross-Language Question Answering System
Hideki Isozaki, Katsuhito Sudoh and Hajime Tsukada
CMU JAVELIN System for NTCIR5 CLQA1Frank Lin, Hideki Shima, Mengqiu Wang and Teruko Mitamura
ASQA: Academia Sinica Question Answering System for NTCIR-5 CLQA
Cheng-Wei Lee, Cheng-Wei Shih, Min-Yuh Day, Tzong-Han Tsai, Tian-Jian Jiang, Chia-Wei Wu, Cheng-Lung Sung,Yu-Ren Chen, Shih-Hung Wu and Wen-Lian Hsu
NTCIR-5 English-Chinese Cross-Language Question Answering Experiments using PIRCS
Kui-Lam Kwok, Peter Deng, Norbert Dinstl and Sora Choi
A Method of Cross-Language Question Answering Based on Machine Translation and Transliteration-- Yokohama National University at NTCIR-5 CLQA1 --Tatsunori Mori and Masami Kawagishi
Japanese-to-English and English-to-Japanese Cross-Language Question Answering System Using Decreased
Adding with Multiple Answers at NTCIR-5
Masaki Murata, Masao Utiyama and Hitoshi Isahara
Baseline Systems for NTCIR-5 CLQA1: An Experimentally Extended QBTE Approach
Yutaka Sasaki
Bi-directional Cross-Language Question Answering using a Single Monolingual QA System
Kei Shimizu, Tomoyosi Akiba, Atsushi Fujii and Katunobu Itou
Chinese QA and CLQA: NTCIR-5 QA Experiments at UNT
Jiangping Chen, Rowena Li, Ping Yu, He Ge, Pok Chin, Fei Li and Cong Xuan
System Description of NTOUA Group in CLQA1
Chuan-Jie Lin,Yu-Chun Tzeng, and Hsin-His Chen
Chinese Question Answering using the DLT System at NTCIR 2005
Richard F. E. Sutcliffe, Jia Xu and Michael Mulcahy
LCC-DCU C-C Question Answering Task at NTCIR-5Bin Wang and Gareth J.F. Jones
PATENTA Patent Retrieval Method Using a Hierarchy of Clusters at TUT
Hironori Doi, Yohei Seki and Masaki Aono
Document Structure Analysis for the NTCIR-5 Patent Retrieval Task
Atsushi Fujii and Tetsuya Ishikawa
NTCIR-5 Patent Retrieval Experiments at RICOH
Hideo Itoh
POSTECH at NTCIR-5 Patent Retrieval: Smoothing Experiments in a Language Modeling Approach to PatentRetrieval
In-Su Kang, Seung-Hoon Na, Jun-Ki Kim and Jong-Hyeok LeePatent Document Retrieval and Classification at KAIST
Jae-Ho Kim, Jin-Xia Huang, Ha-Yong Jung and Key-Sun Choi
Query Terms Extraction from Patent Document for Invalidity Search
Kazuya Konishi
NTCIR-5 Patent Retrieval Experiments at Hitachi
Hisao Mase, Tadataka Matsubayashi, Yuichi Ogawa, Takaaki Yayoi, Yusuke Sato and Makoto Iwayama
Using the K Nearest Neighbor Method and BM25 in the Patent Document Categorization Subtask at NTCIR-5
Masaki Murata, Toshiyuki Kanamaru, Tamotsu Shirado and Hitoshi Isahara
Experiments on Patent Retrieval at NTCIR-5 Workshop
Hironori Takeuchi, Naohiko Uramoto and Koichi Takeda
A Distributed Retrieval System for NTCIR-5 Patent Retrieval TaskHiroki Tanioka and Kenichi Yamamoto
Justsystem at NTCIR-5 Patent Classification
Tetsuya Tashiro, Masaki Rikitoku and Takashi Nakagawa
Automatic Categorization of Japanese Patents based on Surrogate Texts
Yuen-Hsien Tseng, Da-Wei Juang and Chi-Jen Lin
Evaluation of the Document Categorization in "Fixed-point Observatory"
Yoshihiro Ueda, Mamiko Oka, Katsunori Houchi and Akio Yamashita
WEB
Exploiting Anchor Text for the Navigational Web Retrieval at NTCIR-5
Atsushi Fujii, Katunobu Itou, Tomoyosi Akiba and Tetsuya Ishikawa
Verification of Effective Retrieval Method for Anchor Text on Navigational Retrieval
Kenji Tateishi, Hideki Kawai, Dai Kusui and Toshikazu Fukushima
NTCIR-5 WEB Navi-2 Experiments at Osaka Kyoiku University-- Page, Anchor and Title Indexing, and In-link Count, Inter Page and Inter Site Link Analyses -Takashi Sato and Hitoshi Nakakubo
A Distributed Retrieval System for NTCIR-5 WEB Task
Hiroki Tanioka, Kenichi Yamamoto and Takashi Nakagawa
OASIS at NTCIR-5: Web Navigation Retrieval Subtask
Vitaly Klyuev
Search Result Clustering Method at NTCIR-5 Web Query Expansion Subtask
Hiroyuki Toda and Ryoji Kataoka
Improving Web Search by Query Expansion with a Small Number of Terms
Tomonari Masada, Teruhiko Kanazawa, Atsuhiro Takasu and Jun Adachi
NTCIR-5 Query Expansion Experiments using Term Dependence Models
Koji Eguchi
OPEN SUBMISSION
A Unified Approach to Japanese and English Question Answering
E.W.D.Whittaker, J. Hamonic and S. Furui
14:50-15:10
15:10-17:00

Coffee BreakSession 5: QAC  <Hitotsubashi Memorial Hall >Chair: Tsuneaki Kato (Tokyo University)
15:10-15:30
An Overview of NTCIR-5 QAC3
Tsuneaki Kato, Jun'ichi Fukumoto and Fumito Masui
15:30-16:00
Answering Questions of IAD Task using Reference Resolution of Follow-up Questions
Megumi Matsuda and Jun'ichi Fukumoto
16:00-16:30
Question Answering Experiments at NTCIR-5: Acquisition of Answer Evaluation Patterns and Context
Processing using Passage Retrieval
Yuichi Murata, Tomoyosi Akiba, Atsushi Fujii and Katunobu Itou
16:30-17:00
Answering Contextual Questions Based on the Cohesion with the Knowledge-- Yokohama National University at NTCIR-5 QAC3 -Tatsunori Mori and Shinpei Kawaguchi

Main Conference DAY 3:9:00- 16:10
9:00-   9:15
9:15- 10:15

Registration <Hitotsubashi Memorial Hall Lobby>
Light Refreshment
Invited Talk  <Hitotsubashi Memorial Hall >9:15-9:45
Cross Language Evaluation Forum: CLEF 2005
Gareth Jones and Carol Peters
9:45-10:15
Evaluation and Applications of Automatic Text Summarization
Chin-Yew Lin

10:15-10:20
10:20-12:10

BreakSession 6: CLIR-2 <Hitotsubashi Memorial Hall >Chair: Kuang-hua Chen (National Taiwan University)
10:20-10:40
A Decade after TREC-4 -- NTCIR-5 CLIR-J-J Experiments at Yahoo!Japan
Sumio Fujita
10:40-11:00
I2R at NTCIR5Yang Lingpeng and Ji Donghong
11:00-11:20
Using the Web for Translation Disambiguation: RMIT University at NTCIR-5 Chinese-English CLIR
Ying Zhang and Phil Vines
11:20-11:40
Toshiba BRIDJE at NTCIR-5 CLIR: Evaluation using Geometric Means
Tetsuya Sakai, Toshihiko Manabe, Akira Kumano, Makoto Koyama and Tomoharu Kokubu
11:40-12:00
How Similar are Chinese and Japanese for Cross-Language Information Retrieval?
Fredric C. Gey
12:00-12:10
Discussion
Boasting 2: CLIR, QAC
Chair: Fumito Masui (Mie University)

12:10-12:40
12:40-15:10

Friday, December 9, 2005

Lunch & Digital Poster 2: CLIR, QAC < Mid-Conference Hall 1.2.3.4>
CLIRSingle Language Information Retrieval at NTCIR-5
Qing Ma, Koichi Nakao, Kousuke Enomoto and Masaki Murata
Report on CLIR Task for the NTCIR-5 Evaluation Campaign
Samir Abdou and Jacques Savoy
I2R at NTCIR5Yang Lingpeng and Ji Donghong
Toshiba BRIDJE at NTCIR-5 CLIR: Evaluation using Geometric Means
Tetsuya Sakai, Toshihiko Manabe, Akira Kumano, Makoto Koyama and Tomoharu Kokubu
Chinese Information Retrieval Based on Related Term Group
Tingting He, Guozhong Qu, Xinhui Tu and Donghong Ji
Using the Web for Translation Disambiguation: RMIT University at NTCIR-5 Chinese-English CLIR
Ying Zhang and Phil Vines
Applying Multiple Characteristics and Techniques in the NICT Information Retrieval System in NTCIR-5
Masaki Murata, Qing Ma and Hitoshi Isahara
NTCIR-5 CLIR Experiments at QUT
David Lu, Shlomo Geva, Yue Xu and Yuefeng Li
Thomson Legal and Regulatory at NTCIR-5: Japanese and Korean Experiments
Isabelle Moulinier and Ken Williams
NTCIR-5 Chinese, English, Korean Cross Language Information Retrieval Experiments using PIRCS
Kui-Lam Kwok, Sora Choi, Norbert Dinstl and Peter Deng

POSTECH at NTCIR-5: Combining Evidences of Multiple Term Extractions for Mono-lingual and Cross-lingualRetrieval in Korean and JapaneseSeung-Hoon Na, In-Su Kang and Jong-Hyeok Lee
NTCIR-5 CLIR Experiments at Oki
Tetsuji Nakagawa
MIMOR @ NTCIR 5: A Fusion-based Approach to Japanese Information Retrieval
Nina Kummer, Christa Womser-Hacker and Noriko Kando
Some Experiments with Blind Feedback and Re-ranking for Chinese Information Retrieval
Y. Xiao, R.W.P. Luk, K.F. Wong and K.L. Kwok
ISCAS in English-Chinese CLIR at NTCIR-5Jinming Min, Le Sun and Junlin Zhang
A Decade after TREC-4 --NTCIR-5 CLIR-J-J Experiments at Yahoo!JapanSumio Fujita
The University of Amsterdam at NTCIR-5
Jaap Kamps, Michiel van der Bruggen and Maarten de Rijke
Comparison of Global Term Expansion Methods for Text Retrieval
Yuen-Hsien Tseng, Yu-Chin Tsai and Chi-Jen Lin
CJK Experiments with Hummingbird SearchServerTM at NTCIR-5
Stephen Tomlinson
Chinese Information Retrieval Using Lemur: NTCIR-5 CIR Experiments at UNTJiangping Chen, Rowena Li and Fei Li
How Similar are Chinese and Japanese for Cross-Language Information Retrieval?
Fredric C. Gey
QAC
Synthesis of Multiple Answer Evaluation Measures using a Machine Learning Technique for a QA SystemYasuharu Matsuda and Takashi Yukawa
Japanese Question-Answering System Using Decreased Adding with Multiple Answers at NTCIR 5
Masaki Murata, Masao Utiyama and Hitoshi Isahara
Answering Contextual Questions Based on the Cohesion with the Knowledge-- Yokohama National University at NTCIR-5 QAC3 -Tatsunori Mori and Shinpei Kawaguchi
Question Answering Experiments at NTCIR-5: Acquisition of Answer Evaluation Patterns and Context
Processing using Passage Retrieval
Yuichi Murata, Tomoyosi Akiba, Atsushi Fujii and Katunobu Itou
Three Systems and One Verifier -- HOKUM's Participation in QAC3 of NTCIR-5
Yasutomo Kimura, Kenji Ishida, Hirotaka Imaoka, Fumito Masui, Marcin Skowron, Rafal Rzepka and Kenji Araki
Question Answering System with Fine Grain Answer Types and Search Refinement
David Ramamonjisoa
Answering Questions of IAD Task using Reference Resolution of Follow-up Questions
Megumi Matsuda and Jun'ichi Fukumoto
15:10-15:50

Break Out Session(discussion of each task/each new task application)

15:50-16:10
16:10-16:40

Coffee BreakWrap up <Hitotsubashi Memorial Hall >Report out of the break-out session
Schedule after this meeting		 ClosingEvaluation of Information Access Technologies:
Information Retrieval, Question Answering, and Cross-Lingual Information Access

December 6-9, 2005