Proceedings of NTCIR-8 Workshop Meeting, June 15–18, 2010, Tokyo, Japan:LNLSHGLDDQG:HEGRFXPHQWEDVHG4XHU\7UDQVODWLRQ
DQG([SDQVLRQIRU&URVVODQJXDJH,5
/LQJ;LDQJ7DQJ$QGUHZ7URWPDQ6KORPR*HYD<XH;X)DFXOW\RI6FLHQFHDQG7HFKQRORJ\
4XHHQVODQG8QLYHUVLW\RI7HFKQRORJ\%ULVEDQH$XVWUDOLD

^OWDQJVJHYD\XH[X`#TXWHGXDX'HSDUWPHQWRI&RPSXWHU6FLHQFH
8QLYHUVLW\RI2WDJR'XQHGLQ1HZ=HDODQGDQGUHZ#FVRWDJRDFQ]
$%675$&7
,Q WKLV SDSHU ZH GHVFULEH RXU DSSURDFKHV WR UHWULHYLQJ FURVVOLQJXDO GRFXPHQWV IRU TXHVWLRQ DQVZHULQJ LQ WKH 17&,5$&/,$,54$WDVN $ IHZ&KLQHVHLQGH[LQJWHFKQLTXHVZHUH
XVHGLQRXUH[SHULPHQWV:HPDLQO\IRFXVHGRQXVLQJH[WHUQDOUHFRXUVHV ZHE GRFXPHQWV DQG :LNLSHGLD IRU WKH NH\ SKUDVH
LGHQWLILFDWLRQ WUDQVODWLRQ DQG TXHU\ H[SDQVLRQ 7KH HYDOXDWLRQVKRZVHQFRXUDJLQJUHVXOWVRIRXUV\VWHPVWDWLVWLFDO PDFKLQH WUDQVODWLRQ WRRONLW>@ WR REWDLQ ELOLQJXDOSKUDVH SDLUV DQG WR WUDQVODWH RQ D SKUDVH E\ SKUDVH EDVLV1RZDGD\V GLFWLRQDU\EDVHG DQG VWDWLVWLFDO PDFKLQH WUDQVODWLRQ
FDQDFKLHYHYHU\KLJKDFFXUDF\OHYHOVZKHQWUDQVODWLQJJHQHUDO
WH[W +RZHYHU WKH FRPSOH[ SKUDVHV DQG SRVVLEOH DPELJXLW\
SUHVHQW LQ D TXHVWLRQ WD[ JHQHUDO SXUSRVH PDFKLQH WUDQVODWLRQDSSURDFKHV2XWRIYRFDEXODU\WHUPVDUHSDUWLFXODUO\DSUREOHP([DPSOH4XHVWLRQDQGWKUHHWUDQVODWLRQV&DWHJRULHVDQG6XEMHFW'HVFULSWRUV+ &RQWHQW $QDO\VLV DQG ,QGH[LQJ  ,QGH[LQJ PHWKRGV

4XHVWLRQ/LQJXLVWLFSURFHVVLQJ +,QIRUPDWLRQ6HDUFKDQG5HWULHYDO 
4XHU\IRUPXODWLRQ6HDUFKSURFHVV:KDW LV WKH UHODWLRQVKLSEHWZHHQ WKH PRYLH 5LGLQJ
$ORQHIRU7KRXVDQGVRI0LOHV
DQG=+$1*<LPRX*RRJOH 7UDQVODWH 
WUDGLWLRQDO&KLQHVH *RRJOH
7UDQVODWHVLPSOLILHG&KLQHVH *HQHUDO7HUPV$OJRULWKPV'HVLJQ([SHULPHQWDWLRQ.H\ZRUGV

17&,5:LNLSHGLD1*0,'XDO,QGH[LQJFRUUHFWWUDQVODWLRQ,1752'8&7,21

,Q H[DPSOH  QHLWKHU RI WKH *RRJOH WUDQVODWLRQV IRU =+$1*
V PRYLH 5LGLQJ $ORQH IRU 7KRXVDQGV RI 0LOHVLVFRUUHFW )RUWKHWUDGLWLRQDO&KLQHVHYHUVLRQRI
WKH PRYLH QDPH WKH WUDQVODWLRQ LV SDUWO\ FRUUHFW DQG LW LV
UHDVRQDEOH WR H[SHFW LW ZLOO EH DQ HIIHFWLYH TXHU\ %XW IRU WKHVLPSOLILHG &KLQHVH YHUVLRQ WKH WUDQVODWHG PRYLH WLWOH LV
QRQVHQVH DQG LV IXOO RI QRLVH ZRUGV ,Q WKLV H[DPSOH 5LGLQJ
$ORQHIRU7KRXVDQGVRI0LOHVLVDQRXWRIYRFDEXODU\SKUDVH

,Q 17&,5 ZH SDUWLFLSDWHG LQ WKH $GYDQFHG &URVVOLQJXDO,QIRUPDWLRQ $FFHVV $&/,$  ,54$ WDVN DQG VXEPLWWHG UXQV
IRU WKH (QJOLVK WR &KLQHVH &/,5 WDVN ERWK (QJOLVKWR
6LPSOLILHG&KLQHVHDQG(QJOLVKWR7UDGLWLRQDO&KLQHVH ,54$ LV DQ HPEHGGHG FRPSRQHQW RI DQ RYHUDOO FURVVOLQJXDOTXHVWLRQ DQVZHULQJ &/4$  V\VWHP > @ 7KH DQVZHU IRU D
TXHVWLRQFRXOGEHHLWKHUWKHUHVXOWRIDQ(QGWR(QG4$V\VWHP
RU D FRPELQDWLRQ RI GLIIHUHQW 4$ V\VWHPV DQG ,5 V\VWHPV ,Q
ERWKFDVHVWKHFDQGLGDWHDQVZHUVIRUWKHTXHVWLRQDUHH[WUDFWHG
IURP GRFXPHQWV UHWULHYHG LQ D &/,5 VWDJH &/,5 SOD\V D YHU\LPSRUWDQWUROHLQDQRYHUDOOTXHVWLRQDQVZHULQJV\VWHPEHFDXVHWKHUHOHYDQF\RIUHWULHYHGSDVVDJHVRUGRFXPHQWVGHWHUPLQHVWKHDFFXUDF\RIWKHDQVZHU

5DWKHU WKDQ XVLQJ WKH WUDGLWLRQDO PDFKLQH WUDQVODWLRQ PHWKRGVGHVFULEHG DERYHZH DGRSWHGD IDUVLPSOHU VWUDWHJ\ :HXVHDZHEVHDUFKHQJLQH *RRJOH WRORFDWHDUHODWHG:LNLSHGLDHQWU\IRU WKH TXHVWLRQ DQG WKHQ XVH WKH WLWOH RI &KLQHVH SDJH IRUWUDQVODWLRQ4XHU\H[SDQVLRQLVGRQHXVLQJ&KLQHVHWH[W FDOOHG
FOXH WH[W  HQFRXQWHUHG LQ WKH (QJOLVK UHVXOWV $ GHWDLOHG
GHVFULSWLRQRIWKHDSSURDFKLVSUHVHQWHGLQVHFWLRQ

$VLPSOHDSSURDFKWRDFKLHYLQJ&/,5LVWRWUDQVODWHWKHTXHU\
LQWR WKH ODQJXDJH RI WKH GRFXPHQWV DQG WRXVH D PRQROLQJXDO
,5 V\VWHP +RZHYHU IRU WKLV LW LV HVVHQWLDO WR LGHQWLI\ WKH NH\
SKUDVHVLQWKHTXHVWLRQDQGWRFRUUHFWO\WUDQVODWHWKHP&+,1(6('2&80(17,1'(;,1*

$JRRGZD\WRDFKLHYHKLJKDFFXUDF\IRUTXHU\WUDQVODWLRQLVWRDSSO\DQ(QJOLVK326WDJJHU>@WRWKHTXHU\WRH[WUDFWWKHNH\
SKUDVHV DQGWKHQWR WUDQVODWH WKHP  $Q DOWHUQDWLYH LV WR XVH D

0RUHWKDQWKHFDVHZLWKZHVWHUQODQJXDJHVWKHPHWKRGVXVHGLQ
,5 LQGH[LQJ RI &KLQHVH WH[W YDU\ EHWZHHQ UHVHDUFK JURXSVKWWSWUDQVODWHJRRJOHFRP― 121 ―

Proceedings of NTCIR-8 Workshop Meeting, June 15–18, 2010, Tokyo, Japan

8QLJUDPV ELJUDPV DQG ZRUGV DUH DOO FRPPRQ WRNHQV XVHGZKHQ LQGH[LQJ &KLQHVH WH[W 'LIIHUHQW ZRUG VHJPHQWDWLRQ
DOJRULWKPV PLJKWEHXVHGDVPLJKWGLIIHUHQWUDQNLQJIXQFWLRQV
7KH SHUIRUPDQFH RI YDULRXV ,5 V\VWHPV FRPELQLQJ GLIIHUHQWPRGHOVFDQYDU\VXEVWDQWLDOO\>@
,Q RXU H[SHULPHQWV IRU ,54$ ZH XVHG QJUDP PXWXDOLQIRUPDWLRQ 1*0,  >@WR VHJPHQW &KLQHVH WH[W 1*0, LV DQXQVXSHUYLVHGQJUDPZRUGVHJPHQWDWLRQDSSURDFK,WLVGHULYHG
IURP FKDUDFWHUEDVHG PXWXDO LQIRUPDWLRQ EXW FDQ DGGLWLRQDOO\UHFRJQL]HZRUGVORQJHUWKDQWZRFKDUDFWHUV,QRUGHUWRILQGWKHPRVWVXLWDEOHVHJPHQWDWLRQVWUDWHJ\IRURXU
&/,5 V\VWHP XQLJUDP LQGH[LQJ DQG GXDO LQGH[LQJ XQLJUDPV
DQG 1*0, VHJPHQWDWLRQ  ZHUH XVHG LQ GLIIHUHQW H[SHULPHQWDOUXQV

LQGHSHQGHQW7DEOHSUHVHQWVWZRH[DPSOHVRIWKHWHUPFKXQNVDIWHUVWRSZRUGVKDYHEHHQUHPRYHG


7DEOH([DPSOHWHUPFKXQNVDIWHUVWRSZRUGUHPRYDO 

7RSLF,'$&/,$&7
$&/,$&7

7HUPV&KXQN
VRFDOOHGVWHURLG
JLYHVKRUWGHVFULSWLRQVLVRODWLRQ+HSLQJ%UDQFK7DLSHLFLW\KRVSLWDOFDXVHG6$56WK$SULO



48(5<352&(66,1*
4XHVWLRQ$QDO\VLV([DPSOH(QJOLVKWR&KLQHVH17&,5$&/,$WRSLFVWRSLFLG
TXHVWLRQ HQ 
TXHVWLRQ ]K 
QDUUDWLYH HQ $&/,$&6
:KDW LV WKH UHODWLRQVKLS EHWZHHQ WKH PRYLH
5LGLQJ $ORQH IRU 7KRXVDQGV RI 0LOHV DQG=+$1*<LPRX"

7KH XVHU ZDQWV WR NQRZ WKH UHODWLRQVKLSEHWZHHQ WKH PRYLH 5LGLQJ $ORQH IRU7KRXVDQGVRI0LOHVDQG=+$1*<LPRXQDUUDWLYH ]K 
WRSLFLG
TXHVWLRQ HQ 
TXHVWLRQ ]K 
QDUUDWLYH HQ 

QDUUDWLYH ]K $&/,$&7
*LYHVKRUWGHVFULSWLRQVWRWKHLVRODWLRQRIWKH
+HSLQJ%UDQFKRI7DLSHLFLW\KRVSLWDOFDXVHG
E\6$56RQWKRI$SULO
>



6$56

7KHDQDO\VWZRXOGOLNHWRNQRZWKHWUXWKWKDW7DLSHL &LW\ +RVSLWDO  +HSLQJ %UDQFK KDG WR
EH LVRODWHG IURP RWKHUV EHFDXVH RI JURXS
6$56FDVHV



6$56



([DPSOH  VKRZV WZR TXHULHV IURP WKH (QJOLVKWR&KLQHVH
17&,5$/&,$WRSLFVHW7KH\DUHFRPSOH[TXHVWLRQVDQGLWLVLPSRUWDQWWREHDEOHWRSUHFLVHO\WUDQVODWHWKHP
&RPPRQO\ WRSLFV DUH FODVVLILHG LQWR GLIIHUHQW GRPDLQV DQGUHFHLYHVSHFLDOSURFHVVLQJDFFRUGLQJO\7KHTXDOLW\RIWKHTXHU\
FDQ EH LPSURYHG E\ SURYLGLQJ DGGLWLRQDO WHUPV IRU TXHU\
H[SDQVLRQRUUHPRYLQJQRLVHZRUGV)RUH[DPSOHUHFRJQLVLQJDELRJUDSK\ TXHVWLRQ FDQ KHOS LQ TXHU\ H[SDQVLRQ E\ DSSHQGLQJ
WKH TXHU\ ZLWK WKH
TXHVWLRQV  ,Q 17&,5  $&/,$ WKHUH DUH D IHZ SUHGHILQHG
TXHVWLRQW\SHV'(),1,7,21
%,2*5$3+<
5(/$7,216+,3
(9(17
:+<
3(5621
25*$1,=$7,21/2&$7,21DQG'$7(
5DWKHU WKDQ XVLQJ FRPSOH[ QDWXUDO ODQJXDJH SURFHVVLQJ ZH
HPSOR\DQDLYHTXHVWLRQSURFHVVLQJPHWKRGWKDWVLPSO\EUHDNVWKH VHQWHQFH GRZQ LQWR WHUP FKXQNV E\ UHPRYLQJ VWRS ZRUGV
7KH VWRS ZRUG OLVW FRQWDLQV  ZRUGV H[WUDFWHG IURP
0HGOLQH>@ 7KH EHQHILW RI WKLV PHWKRG LV WKDW LW LV TXHVWLRQ)LJXUH7KHGHVLJQRI&/,5V\VWHP&/,56\VWHP$UFKLWHFWXUH
:H DGRSWHG D VLPSOH DOOLQRQH VWUDWHJ\ IRU TXHU\ NH\ WHUPUHFRJQLWLRQ WUDQVODWLRQ TXHU\ H[SDQVLRQ DQG WR DGGUHVV WKH
RXWRIYRFDEXODU\SUREOHP,WLVGHSLFWHGLQ)LJXUH
$ *RRJOHVHDUFKIRUWKHEHVW(QJOLVK:LNLSHGLDSDJHVLVGRQHXVLQJ WKH (QJOLVK TXHVWLRQ  7KH &KLQHVH HTXLYDOHQW SDJH LV
IRXQG E\ IROORZLQJ WKH ODQJXDJH OLQN  )LQDOO\ WKH WLWOH RI WKH&KLQHVH:LNLSHGLDSDJHLVXVHGDVWKHWUDQVODWLRQRIWKHTXHU\,I WKLV IDLOV ZH XVH *RRJOH 7UDQVODWH 7KLV DSSURDFK UHOLHV RQ
IROORZLQJREVHUYDWLRQV

7KH &KLQHVH :LNLSHGLD KDV RYHU  HQWULHVGHVFULELQJYDULRXVHYHQWVSHRSOHRUJDQL]DWLRQVORFDWLRQV
DQG IDFWV 0RVW LPSRUWDQWO\ WKHUH DUH OLQNV EHWZHHQ(QJOLVK DUWLFOHV DQG WKHLU FRUUHVSRQGLQJ &KLQHVHFRXQWHUSDUWV

:KHQ SHRSOH SRVW LQIRUPDWLRQ RQ WKH ,QWHUQHW WKH\ RIWHQSURYLGH D WUDQVODWLRQ ZKHUH QHFHVVDU\  LQ WKH VDPH ZHEGRFXPHQWV7KHVHSDJHVFRQWDLQELOLQJXDOSKUDVHSDLUV― 122 ―

Proceedings of NTCIR-8 Workshop Meeting, June 15–18, 2010, Tokyo, Japan$ ZHE VHDUFK HQJLQHV VXFK DV *RRJOH LGHQWLI\ :LNLSHGLDHQWULHV DQG ELOLQJXDO ZHE GRFXPHQWV WKDW DUH FORVHO\UHODWHGWRDTXHU\&KLQHVHFOXHWH[WFROOHFWHGIURP*RRJOHVHDUFK DOORUKLJKIUHTXHQF\ZRUGV 
5HVXOWIURP*RRJOH7UDQVODWH RSWLRQDO ,QVXPPDU\ZHXVHWKUHHGLIIHUHQWVRXUFHVIRUTXHU\WUDQVODWLRQ
LQRXUVWUDWHJ\7KH\DUHOLVWHGLQ7DEOH
7DEOH7UDQVODWLRQVRXUFHV
1DPH
0HWKRG*RRJOH
ELOLQJXDOZHEGRFXPHQWV:LNLSHGLDPXOWLOLQJXDOHQF\FORSHGLD*RRJOH7UDQVODWHPDFKLQHWUDQVODWLRQ>@

:(,*+7,1*02'(/7KH4XHU\7UDQVODWLRQ$OJRULWKP
7KH &KLQHVH WUDQVODWLRQ RI WKH (QJOLVK TXHVWLRQ LV JHQHUDWHG
IURPWKHIROORZLQJVWHSV$ VOLJKWO\ PRGLILHG %0 UDQNLQJ IXQFWLRQ ZDV XVHG IRUGRFXPHQWRUGHULQJ
:KHQFDOFXODWLQJWKHLQYHUVHGRFXPHQWIUHTXHQF\ZHXVH :KHUH1LVWKHQXPEHURIGRFXPHQWVLQWKHFRUSXVDQGQLVWKH
GRFXPHQWIUHTXHQF\RITXHU\WHUP 7KHUHWULHYDOVWDWXVYDOXH
RI D GRFXPHQW G ZLWK UHVSHFW WR TXHU\LVFDOFXODWHGDV 5HPRYH VWRS ZRUGV IURP WKH (QJOLVK TXHVWLRQ WR JHQHUDWH

WHUPFKXQNV 6HDUFK *RRJOH XVLQJ WKH WHUP FKXQNV ZLWK RSWLRQV VHW WRUHWXUQ RQO\ WKH &KLQHVH DQG (QJOLVK SDJH ,I WKHUH LV D
:LNLSHGLDSDJHDWWKHWRSWKHQJRWRVWHSHOVHJRWRVWHS
,Q ERWK FDVHV &KLQHVH WH[W SUHVHQW LQ WKH (QJOLVK UHVXOWV OLVWLV
FROOHFWHG WKLVFOXHWH[WLVXVHGIRUTXHU\H[SDQVLRQ&DOFXODWHWKHIUHTXHQF\RIZRUGVDSSHDULQJLQWKHWLWOHRIWKHUHVXOWV IURP VWHS  &KRRVH WKH WRS UDQNLQJ RQHV ZLWK D
IUHTXHQF\DERYHDWKUHVKROG7KHWKUHVKROGLVVHWWRWREHJLQZLWK WKHQ OLQHDUO\ GHFUHDVHG E\ RQH XQWLO DW OHDVW RQH WHUP LV
IRXQG6HDUFK*RRJOHXVLQJWKHVHZRUGVEXWUHVWULFWWKHVHDUFKWRWKH(QJOLVK:LNLSHGLD7KHKLJKHVWUDQNLQJUHVXOWFRQWDLQLQJDQ\WHUPIURPWKHTXHVWLRQLVFRQVLGHUHGWKHFRUUHFWUHVXOW5HWULHYHWKH(QJOLVK:LNLSHGLDSDJH 5HWULHYH WKH FRUUHVSRQGLQJ &KLQHVH :LNLSHGLD SDJH E\IROORZLQJWKHODQJXDJHVOLQNIURPWKH(QJOLVKSDJH,IWKHUHLV
QR&KLQHVHOLQNIRXQGWKHQMXPSWRVWHS
([WUDFWWKHWLWOHRIWKH&KLQHVH:LNLSHGLDSDJHDQGXVHLWDVWKHTXHU\ 3URFHVV WKH FOXH WH[W LI WKHUH LV DQ\ IRU TXHU\ H[SDQVLRQ(LWKHUWKHZKROHRUVRPHIUHTXHQWZRUGVRIWKHFOXHWH[WFRXOG
EH XVHG DV H[SDQVLRQ WHUPV $SSHQG WKHVH DGGLWLRQDO WHUPV WR
WKH &KLQHVH TXHU\ 7KH IUHTXHQW ZRUGV DUH FKRVHQ IURP WKH
1*0,VHJPHQWHGWHUPVLQWKHFOXHWH[W7KHIUHTXHQF\RIWKRVHZRUGVKDVWREHDERYHDWKUHVKROG7KHWKUHVKROGLVVHWWRWR
EHJLQ ZLWK WKHQ OLQHDUO\ GHFUHDVHG E\ RQH XQWLO DW OHDVW RQH
WHUPLVIRXQG
 ,I QR &KLQHVH TXHU\ WHUPV KDYH EHHQ IRXQG WKHQ XVH WKHWUDQVODWLRQ IURP *RRJOH 7UDQVODWH RQ WKH WHUP FKXQNV2WKHUZLVHWKHUHVXOWVRIWKLVPDFKLQHWUDQVODWLRQDUHRSWLRQDOO\DSSHQGHGWRWKHTXHU\6HDUFKWKHFRUSXVXVLQJHLWKHUVLQJOHFKDUDFWHUVHJPHQWDWLRQ
RUVLQJOHFKDUDFWHUVHJPHQWDWLRQSOXV1*0,VHJPHQWHGWHUPV
7KHUHVXOWLQJTXHU\FDQEHWKRXJKWRIDV&KLQHVHTXHU\ 
7KH WLWOH RI WKH &KLQHVH :LNLSHGLD GRFXPHQW IRXQG E\VHDUFKLQJ *RRJOH IRU WKH (QJOLVK :LNLSHGLD GRFXPHQW DQGIROORZLQJWKHODQJXDJHVOLQN














LVWKHWHUPIUHTXHQF\RI WHUP LQGRFXPHQWG:KHUH
LV WKH OHQJWK RI GRFXPHQW G LQ ZRUGV DQG DYJGO LV WKH
PHDQGRFXPHQWOHQJWK:KHQLQGH[LQJXVLQJWKHGXDOLQGH[LQJ
VWUDWHJ\ RQO\ WKH DFWXDO ZRUGV QRW WKH XQLJUDPV  DUH FRXQWHGWRZDUGVWKHGRFXPHQWOHQJWK7KHYDOXHVRIWXQDEOHSDUDPHWHUVDQGEXVHGLQRXUH[SHULPHQWVDUHDQGUHVSHFWLYHO\(;3(5,0(176
:H XVHG FRPELQDWLRQV RI GLIIHUHQW VHJPHQWDWLRQ DSSURDFKHVDQGTXHU\WUDQVODWLRQDSSURDFKHVWRJHQHUDWHILYHGLIIHUHQWUXQV
IRU HDFK (QJOLVKWR&KLQHVH WDVN 7KH GHWDLO RI WKH GLIIHUHQFHVEHWZHHQWKHVHUXQVLVJLYHQLQ7DEOHDQG7DEOH
7KH  DQG  UXQV XVHG EOLQG WUDQVODWLRQ IURP *RRJOH DQG:LNLSHGLD ZLWK WUDQVODWLRQ IURP WKH RQOLQH WUDQVODWLRQ VHUYLFH
LI:LNLSHGLDDQGZHEGRFXPHQWEDVHGWUDQVODWLRQIDLOHG 7KH
  DQG  UXQV FRPELQH WKH WUDQVODWLRQ UHVXOWV IURP WKUHH
GLIIHUHQW VRXUFHV ZHE GRFXPHQWV :LNLSHGLD DQG PDFKLQHWUDQVODWLRQ
:HDUHDOVRLQWHUHVWHGLQLQYHVWLJDWLQJKRZVHJPHQWDWLRQDIIHFWVFURVVOLQJXDO ,5 7R WHVW WKLV ZH HPSOR\HG WZR GLIIHUHQWLQGH[LQJDQGTXHU\VHJPHQWDWLRQVWUDWHJLHVLQRXUUXQV7KH
DQG  UXQV XVHG RQO\ VLQJOH &KLQHVH FKDUDFWHU LQGH[LQJ DQGVHDUFKLQJ  7KH   DQG  UXQV XVHG GXDO LQGH[LQJ DQGVHDUFKHGWKHGRFXPHQWVXVLQJVLQJOHFKDUDFWHUVDQGZRUGV,Q RXU H[SHULPHQWV ZHE GRFXPHQWV IRUP DQ LPSRUWDQW GDWD
VRXUFHIRUTXHU\H[SDQVLRQ$VWKHVRXUFHODQJXDJHRIWKHZHEGRFXPHQWV PD\ DIIHFW WKH UHVXOWV ZH FUHDWHG WZR DGGLWLRQDOUXQV WR H[DPLQH WKLV  5XQ (1&6  VHDUFKHG RQO\ LQ WKH FQGRPDLQZKLOHUXQ(1&7VHDUFKRQO\LQWKHWZGRPDLQ
2YHUDOO WKH   UXQV VKDUH WKH VDPH *RRJOH VHDUFKUHVXOWV DQG FOXH WH[W EXW UXQ  LV GLIIHUHQW )RU GLIIHUHQWH[SHULPHQWDO UXQ JURXSV WKH VWDWLVWLFV RI WKH QXPEHU RI
GLVFRYHUHG:LNLSHGLDSDJHVFROOHFWHGFOXHWH[WDQGWRWDOWRSLFVLQ ZKLFK ZHE VHDUFK IDLOHG DUH JLYHQ LQ 7DEOH  DQG 7DEOH )URP WKRVH WZR WDEOHV ZH FDQ VHH WKDW D ODUJH SRUWLRQ DOPRVW RI WKH TXHVWLRQV IRXQG WKHLU UHODWHG :LNLSHGLD SDJHV8VLQJ ELOLQJXDO VHDUFK RQ *RRJOH FRQWULEXWHV DERXW  RI WKH
FOXHWH[W,WDOVRFDQEHVHHQWKDWGRPDLQVHDUFKLVDJRRGZD\WRLQFUHDVHWKHFKDQFHRIILQGLQJPRUHFOXHWH[W DVWKHDPRXQW
RI FOXH WH[W QHDUO\ WULSOHV IRU WKH (1&6 UXQV DQG TXDGUXSOHV
IRU WKH (1&7 UXQV +RZHYHU LW UHGXFHV WKH SRVVLELOLW\ RI

― 123 ―

Proceedings of NTCIR-8 Workshop Meeting, June 15–18, 2010, Tokyo, JapanILQGLQJ WKH UHOHYDQW :LNLSHGLD SDJH EHFDXVH RI WKH UHVWULFWLYH
VHDUFK

7DEOH  7KH VWDWLVWLFV RI WKH (1&6 UXQV  )$,/ LV WKHQXPEHU RI WRWDO WRSLFV IRU ZKLFK WKH ZHE VHDUFK FRXOG QRWREWDLQHLWKHUD&KLQHVH:LNLSHGLDSDJHRU&KLQHVHFOXHWH[W
5XQ
(1
=+ &OXH)$,/
:LNL
:LNL
7H[W












DQDO\VLV WR ORRN IRU EHWWHU WUDQVODWLRQV RI RXWRIYRFDEXODU\SKUDVHV:HZLOODOVRFRQWLQXHRXUZRUNLQXVLQJWKH:LNLSHGLDDVDPHWKRGRIWUDQVODWLRQDQGTXHU\H[SDQVLRQ
7DEOH2IILFLDO(1&6,54$UHVXOWV%()25(EXJIL[HV
7DEOH  7KH VWDWLVWLFV RI WKH (1&7 UXQV  )$,/ LV WKHQXPEHU RI WRWDO WRSLFV IRU ZKLFK WKH ZHE VHDUFK FRXOG QRWREWDLQHLWKHUD&KLQHVH:LNLSHGLDSDJHRU&KLQHVHFOXHWH[W
5XQ
(1
=+ &OXH)$,/:LNL
:LNL
WH[W












,54$5(68/76$1'',6&866,21
7KH RIILFLDO HYDOXDWLRQ UHVXOWV EHIRUH EXJ IL[HV  RI RXUVXEPLVVLRQVRQWKHWZRWDVNVDUHJLYHQLQ7DEOHDQG7DEOH
,W FDQ EH VHHQ WKDW WKH GLVWULEXWLRQV RI WKH PHDQ DYHUDJH
SUHFLVLRQ 0$3  PHDQ 4 04  DQG PHDQ Q'&* 0Q'&* 
DUHVLPLODUIRUERWKWKH(1&6DQG(1&7WDVNV
5XQVDQGWKDWXVHMXVWZHEGRFXPHQWVDQGWKH:LNLSHGLDZKHUH SRVVLEOH  DFKLHYH D UHODWLYHO\ ORZ SUHFLVLRQ 7KLVKRZHYHUGRHVLQGLFDWHWKDWZHEGRFXPHQWVDQGWKH:LNLSHGLDPD\EHJRRGUHVRXUFHVIRUTXHU\WUDQVODWLRQ
7KHUXQVXVLQJ1*0,ZRUGGXDOLQGH[LQJ UXQVDQG 
EHWWHUHGWKHHTXLYDOHQWFKDUDFWHUEDVHGLQGH[LQJLQDOOFDVHV,Q ERWK FDVHV WKH UXQV WKDW UHVWULFWHG WKH ZHE VHDUFK WR D
SDUWLFXODUGRPDLQ UXQ SHUIRUPHGZRUVHWKDQWKHHTXLYDOHQWUXQ WKDW GLG QRW VLWH UHVWULFW $V FDQ EH REVHUYHG IURP 7DEOH 
DQG7DEOHWKHSUREDELOLW\RI ILQGLQJFOXHWH[WLQFUHDVHVDQG
WKH FOXH WH[W FROOHFWHG LQ *RRJOH UHVXOWV JHWV ODUJHU GXH WR WKH
VSHFLILHG &KLQHVH GRPDLQ VHDUFK +RZHYHU DV D VLGHHIIHFWQRLVH ZRUGV LQFUHDVH DQG WKH KRSH IRU ILQGLQJ D UHOHYDQW:LNLSHGLD SDJH EHFRPH VOLP 7KHUHIRUH WKH SHUIRUPDQFH RI
UXQVZLWKVLWHUHVWULFWLRQFRXOGGHWHULRUDWHLIWKHLQFUHDVHGQRLVHZRUGVDUHQRWWDNHQFDUHRI
,W LV DOVR LQWHUHVWLQJ WR VHH WKDW WKH 487,6(1&6 UXQV
487,6(1&67SDUWLFXODUO\FRQWULEXWHWKHKLJKHVWQXPEHU
RI XQLTXH UHOHYDQW GRFXPHQWV LQ DOO &6 VXEPLVVLRQV DFFRUGLQJ
WR WKH RIILFLDO 17&,5 DVVHVVPHQW UHVXOWV>@ 7KLV FRXOG EH
ODUJHO\EHFDXVHRXU :LNLSHGLDDQGZHEGRFXPHQWEDVHGTXHU\WUDQVODWLRQ DQG H[SDQVLRQ DSSURDFK FRQWULEXWHV H[WUD
XQH[SHFWHGJRRGTXHU\WHUPV2YHUDOO RXU UXQV GLG QRW SHUIRUP ZHOO ZKHQ FRPSDUHG WR WKH
EHVWUXQVXEPLWWHGWRWKHWDVNDQGVRFDUHPXVWEHWDNHQZKHQGUDZLQJFRQFOXVLRQV&21&/86,216$1')8785(:25.
:H LPSOHPHQWHG D VLPSOH VWUDWHJ\ IRU TXHU\ WUDQVODWLRQ DQGH[SDQVLRQ IRU FURVVOLQJXDO TXHVWLRQ DQVZHULQJ 7KLV VWUDWHJ\UHOLHV RQ DQ H[WHUQDO UHVRXUFH VXFK DV ZHE GRFXPHQWV DQG WKH:LNLSHGLD WR WDFNOH WKH RXWRIYRFDEXODU\ SUREOHP  7KHSHUIRUPDQFH RI RXU V\VWHP DQG KLJKHVW QXPEHU RI XQLTXHUHOHYDQW GRFXPHQWV IRXQG LQ (1&6 H[SHULPHQWDO UXQV DUHHQFRXUDJLQJ,QIXWXUHZRUNZHZLOOXVHORJLFDODQGFRQWH[WXDO

581,'

0$304

0Q'&*

(1&6EHVW
487,6(1&67
487,6(1&67
487,6(1&67
487,6(1&67
487,6(1&67

















7DEOH2IILFLDO(1&7,54$UHVXOWV%()25(EXJIL[HV
581,'
0$3
04
0Q'&*
(1&7EHVW


487,6(1&77


487,6(1&77


487,6(1&77


487,6(1&77

487,6(1&77




5()(5(1&(6>@ &KHQ $ HW DO &KLQHVH WH[W UHWULHYDO ZLWKRXW XVLQJ D
GLFWLRQDU\LQ 6,*,5  3URFHHGLQJV RI WKHWK DQQXDOLQWHUQDWLRQDO $&0 6,*,5 FRQIHUHQFH RQ 5HVHDUFK DQGGHYHORSPHQWLQLQIRUPDWLRQUHWULHYDOSS
>@/XR:HWDO,&7&URVVQ7KH6\VWHPRI&URVVOLQJXDO,QIRUPDWLRQ5HWULHYDORI,&7LQ17&,5SS>@  0LWDPXUD 7 HW DO 2YHUYLHZ RI WKH 17&,5 $&/,$
7DVNV $GYDQFHG &URVV/LQJXDO ,QIRUPDWLRQ $FFHVV LQ
3URFHHGLQJVRI17&,5SS
>@  0LWDPXUD 7 HW DO 2YHUYLHZ RI WKH 17&,5 $&/,$
7DVNV $GYDQFHG &URVV/LQJXDO ,QIRUPDWLRQ $FFHVV LQ
3URFHHGLQJVRI17&,5WRDSSHDU
>@ 5REHUW : 3 / DQG . / .ZRN $ FRPSDULVRQ RI
&KLQHVH GRFXPHQW LQGH[LQJ VWUDWHJLHV DQG UHWULHYDOPRGHOV $&0 7UDQVDFWLRQV RQ $VLDQ /DQJXDJH,QIRUPDWLRQ 3URFHVVLQJ 7$/,3  YRO  SS 

>@6DNDL7HWDO2YHUYLHZRI17&,5$&/,$,54$
LQ3URFHHGLQJVRI17&,5WRDSSHDU
>@6KL/HWDO5$/,([SHULPHQWVLQ,54$DW17&,5
LQ17&,5SS
>@ 7DQJ /; HW DO :RUG 6HJPHQWDWLRQ IRU &KLQHVH
:LNLSHGLD 8VLQJ 1*UDP 0XWXDO ,QIRUPDWLRQ SUHVHQWHG
DWWKHWK$XVWUDODVLDQ'RFXPHQW&RPSXWLQJ6\PSRVLXP
$'&6   8QLYHUVLW\ RI 1HZ 6RXWK :DOHV 6\GQH\
>@861DWLRQDO/LEUDU\RI0HGLFLQH0('/,1(3XE0HG%DVHOLQH5HSRVLWRU\$YDLODEOHKWWSPEUQOPQLKJRY>@:LNLSHGLD*RRJOH
7UDQVODWH
KWWSHQZLNLSHGLDRUJZLNL*RRJOHB7UDQVODWH― 124 ―HG

Proceedings of NTCIR-8 Workshop Meeting, June 15–18, 2010, Tokyo, Japan

7DEOH(1&65XQV'HVFULSWLRQ

,QGH[8QLWV

7UDQVODWLRQ

4XHU\8QLWV

,50RGHO


581,'
487,6(1&77

XQLJUDP

:HEVHDUFK>*RRJOH7UDQVODWHLIIDLOV@XQLJUDP%0

487,6(1&77

XQLJUDPZRUG:HEVHDUFK>*RRJOH7UDQVODWHLIIDLOV@XQLJUDPZRUG

%0

487,6(1&77

XQLJUDP:HEVHDUFK*RRJOH7UDQVODWHXQLJUDP%0

487,6(1&77

XQLJUDPZRUG:HEVHDUFK*RRJOH7UDQVODWHXQLJUDPZRUG

%0

487,6(1&77

XQLJUDPZRUG:HEVHDUFK VLWHWZ *RRJOH7UDQVODWHXQLJUDPZRUG

%0




7DEOH(1&75XQV'HVFULSWLRQ
581,'

,QGH[8QLWV

7UDQVODWLRQ

4XHU\8QLWV

,50RGHO

487,6(1&67

XQLJUDP

:HEVHDUFK>*RRJOH7UDQVODWHLIIDLOV@XQLJUDP%0

487,6(1&67

XQLJUDPZRUG:HEVHDUFK>JRRJOHWUDQVODWHLIIDLOV@XQLJUDPZRUG

%0

487,6(1&67

XQLJUDP:HEVHDUFK*RRJOH7UDQVODWHXQLJUDP%0

487,6(1&67

XQLJUDPZRUG:HEVHDUFK*RRJOH7UDQVODWHXQLJUDPZRUG

%0

487,6(1&67

XQLJUDPZRUG:HEVHDUFK VLWHFQ *RRJOH7UDQVODWHXQLJUDPZRUG

%0







― 125 ―