Proceedings of NTCIR-8 Workshop Meeting, June 15–18, 2010, Tokyo, Japan'/87,54$V\VWHPLQ17&,5+XDQJ'HJHQ

/L=H]KRQJ<DQJ7LDQ'HSDUWPHQWRI&RPSXWHU6FLHQFHDQG(QJLQHHULQJ'DOLDQ8QLYHUVLW\RI7HFKQRORJ\'DOLDQ&KLQDKXDQJGJ#GOXWHGXFQOL]H]KRQJODLOH#FRP

\W[#FRP


$%675$&7
7KLVSDSHUGHVFULEHVRXUZRUNRQ,54$V\VWHPLQ17&,5WKDWLQWHQGV WR HYDOXDWH ZKLFK ,5 WHFKQLTXHV DUH PRUH XVHIXO WR 4$:HH[DPLQH,5WHFKQLTXHVZKLFKFDQILQGGRFXPHQWVWKDWFRQWDLQDQVZHUV WR WKH TXHVWLRQV ,Q RXU 6\VWHP ZH H[SORLW GLIIHUHQWH[WHUQDOUHVRXUFHDFFRUGLQJWRWKHW\SHRITXHVWLRQ,QSDUWLFXODUZH H[SORLW :LNLSHGLD *RRJOH DQG %DLGX %DLNH IRU LGHQWLI\LQJ
1DPHG(QWLW\WUDQVODWLRQDQGDOVRHPSOR\WKHPWRH[SDQGTXHU\IRU LPSURYLQJ WKH SUHFLVLRQ RI WKH UHWULHYDO :H XVH SDVVDJHUHWULHYDOWRLPSURYHDYHUDJHSUHFLVLRQ2XUH[SHULPHQWVVKRZWKDWWKHVH WHFKQLTXHV DERYH FDQ VLJQLILFDQWO\ LQFUHDVH UHWULHYDO
SUHFLVLRQ&DWHJRULHVDQG6XEMHFW'HVFULSWRUV+ >,1)250$7,21 6725$*( $1' 5(75,(9$/@
,QIRUPDWLRQ 6HDUFK DQG 5HWULHYDO ± ,QIRUPDWLRQ ILOWHULQJ 4XHU\IRUPXODWLRQ5HWULHYDOPRGHOV6HDUFKSURFHVV6HOHFWLRQSURFHVV*HQHUDO7HUPV'HVLJQ([SHULPHQWDWLRQ/DQJXDJHV3HUIRUPDQFH.H\ZRUGV,QIRUPDWLRQUHWULHYDO4XHVWLRQDQVZHULQJ4XHU\H[SDQVLRQ ,1752'8&7,21
4XHVWLRQ DQVZHULQJ LV D KRW UHVHDUFK ILHOG LQ 1DWXUDO /DQJXDJH
3URFHVVLQJZKLFKLQFOXGHVPDQ\NLQGVRI1/3DQG,5WHFKQLTXHV8VXDOO\ D 4$ V\VWHP LV FRPSRVHG RI WKUHH PDLQ SDUWV 4XHVWLRQ$QDO\VLV SDVVDJHGRFXPHQW UHWULHYDO WKDW DLPV WR H[WUDFWGRFXPHQWVWKDWPD\FRQWDLQDQVZHUVDQG$QVZHU([WUDFWLRQ4$
UHVHDUFK DWWHPSWV WR GHDO ZLWK D ZLGH UDQJH RI TXHVWLRQ W\SHVLQFOXGLQJIDFWOLVWGHILQLWLRQKRZZK\HWF,54$LVDVXEWDVN
RI $&/,$ $GYDQFHG &URVVOLQJXDO ,QIRUPDWLRQ $FFHVV  ZKLFKIRFXVHV RQ FRPSOH[ FURVVOLQJXDO TXHVWLRQV DQVZHULQJ &&/4$ 
SUREOHPV>@>@,Q 17&,5 RXU WHDP WDNHV SDUW LQ WKH ,54$
VXEWDVN WKH JRDO LV WR HYDOXDWH WKH IDFWRUV ZKLFK FDQ DIIHFW WKHSHUIRUPDQFH RI LQIRUPDWLRQ UHWULHYDO 7KH JRDO RI ,54$ LV WR
H[WUDFWGRFXPHQWVWKDWFRQWDLQDQVZHUVWRWKHTXHVWLRQ
7KHUH DUH PDQ\ LPSRUWDQW IDFWRUV WKDW DIIHFW WKH SHUIRUPDQFH RI
LQIRUPDWLRQUHWULHYDOVXFKDVWKHNH\ZRUGVH[WUDFWHGIRUTXHU\DQG
UHWULHYH UHODWHG GRFXPHQWV DFFRUGLQJ WR WKH TXHU\ 7KHVH WZRIDFWRUVPD\OHDGWRLQIRUPDWLRQORVWDQGLQIRUPDWLRQRYHUORDG$V
D UHVXOW WKH UHWULHYDO V\VWHP PD\ JHW ORZ UDWH RI UHFDOO DQGSUHFLVLRQ,QWKLVSDSHUZHKDYHH[SHULPHQWVHYHUDOWHFKQLTXHVWRKHOS H[WUDFW FDQGLGDWH GRFXPHQWV ZKLFK PD\ FRQWDLQ DQVZHUV WR
WKH TXHVWLRQV ,Q SDUWLFXODU ZH XVH H[WHUQDO UHVRXUFHV VXFK DV
:LNLSHLD *RRJOH DQG %DLGX %DLNH $QG ZH XVH ,QGUL DV RXUUHWULHYDO WRROV ,Q WKLV WRRONLW /DQJXDJH PRGHOV XVHG WR HVWLPDWH
EHOLHIV RI UHSUHVHQWDWLRQ QRGHV 'RFXPHQWV DUH UDQNHG WKURXJKJHQHUDWLYH RU GLVWULEXWLRQ VLPLODULW\ PHDVXUHV 6R ZH FDQ FKRRVH
WKHPRVWUHODWLYHGRFXPHQWVWRWKHTXHVWLRQ7KLVSDSHULVPDLQO\DERXWWKHDSSURDFKHVDQGWKHLUHIIHFWLYHQHVVLQ,54$WDVN 48(67,21$1$/<6,6$1'.(<:25'6(;75$&7,21
$ W\SLFDO TXHVWLRQ DQVZHULQJ V\VWHP XVXDOO\ WDNHV WKH 4XHVWLRQDQDO\VLV DV WKH ILUVW VWHS RI DQVZHULQJ 4XHVWLRQ DQDO\VLVGHWHUPLQHV WKH W\SH RI TXHVWLRQ DQG H[WUDFWV VRPH RWKHU XVHIXOLQIRUPDWLRQ IRU WKH IXWXUH DQVZHULQJ 3HRSOH KDYH GRQH PXFKZRUNV DERXW WKLV PDLQO\ LQFOXGLQJ VWDWLVWLFDOEDVHG DSSURDFKHV
DQG UXOHEDVHG DSSURDFKHV RU ERWK RI WKHP :H MXVW DGRSW D
VLPSOH UXOHEDVHG PHWKRG IRU WKH (QJOLVK TXHVWLRQ DQDO\VLV :H
PDNHDERXWWHPSODWHVWRPDWFKTXHVWLRQV:KHQ WKH SURFHVV RI TXHVWLRQ DQDO\VLV LV XQGHUJRLQJ WKH PRVWLPSRUWDQW LQIRUPDWLRQDO NH\ZRUGV ZLOO EH H[WUDFWHG ,Q RWKHUZRUGVYLHZ WKH DERYHWZRVXEPRGXOHV DVDQ LQWHJULW\ %HFDXVH
WKHWHPSODWHLVFRQVWLWXWHGZLWKWZRNLQGVRIHOHPHQWVWKHILUVWLV
FDOOHG &RQVWDQW (OHPHQWV DQG WKH RWKHU LV 9DULDEOH (OHPHQWVZKLFK LV DOVR FDOOHG 6ORW GLUHFWO\ 7KH &RQVWDQW (OHPHQWV LV
KHOSIXO IRU WKH FODVVLILFDWLRQ RI TXHVWLRQV DQG WKH ZRUGV LQ WKHSODFH RI 6ORWV RIWHQ FRQVLGHUHG DV NH\ZRUGV LQ WKH IXWXUHLQIRUPDWLRQUHWULHYDOIRUWKHTXHVWLRQDQVZHULQJ
7DEOH6RPHPDQXDOWHPSODWHV
4XHVWLRQW\SH

7HPSODWH

%LRORJ\:KRLV>SHUVRQQDPH@"

5HODWLRQ

:KDW LV _ :KDW¶V  WKH UHODWLRQ EHWZHHQ>[@DQG>\@"

'HILQLWLRQ:KDWLVWKH>GHILQLWLRQ@"

/LVW

/LVWHYHQWVUHODWHGWR> @
7KH IROORZ LV VRPH PDQXDOO\ FUDIWHG WHPSODWHV ZH XVHG LQ WKH
,54$WDVNWKHVTXDUHEUDFNHWLQWKHSDWWHUQVUHSUHVHQWVWKH6ORWDQGWKHFRQWHQWLQWKH URXQGEUDFNHW LV UHJXODUH[SUHVVLRQ 6RPH
DUH OH[LFDO WHPSODWHV DQG VRPH SDWWHUQV XWLOL]H VHPDQWLF

― 140 ―

Proceedings of NTCIR-8 Workshop Meeting, June 15–18, 2010, Tokyo, JapanNQRZOHGJHZKLFKLVXQGHUWKHKHOSRI6WDQIRUG1(53DUVHU7KH
WHPSODWHV QRW RQO\ PDWFK WKH OH[LFDO ZRUG EXW DOVR WKH 1DPHG
(QWLWLHV VXFKDVSHUVRQQDPHORFDWLRQ QDPH RUJDQL]DWLRQ QDPH
DQG GDWH :KHWKHU WKH SURSHU QRXQV DUH H[WUDFWHG DQG WUDQVODWHG
SURSHUO\ ODUJHO\ GHWHUPLQHV WKH UHVXOW RI WKH VXFFHHGLQJLQIRUPDWLRQUHWULHYDODQGWKHILQDODQVZHU 48(5<75$16/$7,21
,Q WKH SUHYLRXV VHFWLRQ ZH KDYH JHW WKH H[WUDFWHG (QJOLVKNH\ZRUGV DV WKH RULJLQDO TXHU\ ZKLFK VKRXOG EH WUDQVODWHG WR
&KLQHVHNH\ZRUGV7KHQKDYHDPRQROLQJXDOLQIRUPDWLRQUHWULHYDOZKLFKLVDW\SLFDODSSURDFKRI&/,5
)RUWKHJHQHUDOWHUPVZHMXVWWUDQVODWHLWZLWK*RRJOH7UDQVODWRU
)RUWKHSURSHUQRXQVZHZLOOWXUQWRWKHPXOWLOLQJXDONQRZOHGJHUHVRXUFHRQWKHLQWHUQHW:LNLSHGLD LV D PXOWLOLQJXDO HQF\FORSHGLD RQ WKH ZHE DQG LV
FRPSRVHG DQG HGLWHG E\ YROXQWHHUV DOO RYHU WKH ZRUOGKWWSZZZZLNLSHGLDRUJ  ,W LV QRZ WKH ODUJHVW PRVW YLVLWHG
HQF\FORSHGLD LQ H[LVWHQFH  (DFK HQWU\ RI :LNLSHGLD KDV OLQNV WR
HQWULHVLQRWKHUODQJXDJHVLIWKHUHDUHHQWULHVGHVFULELQJWKHVDPHWRSLFLQWKRVHODQJXDJHV7KHWUDQVODWLRQRIDQHQWU\FDQEHIRXQG
MXVW IROORZ WKH OLQN WR WKH WDUJHW ODQJXDJH LI WKH WUDQVODWLRQ LQ
WDUJHWODQJXDJHLVDYDLODEOH>@7KHUHIRUH:LNLSHGLDFDQEHVHHQ
DVDOLYHGLFWLRQDU\ZLWKDOONLQGVRIODQJXDJHV%DLGX %DLNH KWWSEDLNHEDLGXFRP  LV DOVR D PXOWLOLQJXDOHQF\FORSHGLD DV :LNLSHGLD ZKLFK VXSSOHPHQWV WKH HQWULHV RI
WKDW¶VQRWIRXQGLQ:LNLSHGLD 48(5<(;3$16,21
7KHTXHU\H[SDQVLRQLQ&/,5QRWRQO\FDQH[SDQGUHODWHGZRUGV
DV LQ PRQROLQJXDO EXW DOVR FDQ HQKDQFH TXHU\ WUDQVODWLRQ 0DQ\
TXHU\H[SDQVLRQWHFKQLTXHVKDYHEHHQH[SORUHG WRFRPEDW HUURUVLQGXFHG E\ WKH TXHU\ WUDQVODWLRQ $FFRUGLQJ WR WKH VWDJH RI WKHTXHU\ H[SDQVLRQ KDSSHQHG URXJKO\ GLYLGHG LQWR WZR NLQGV RI
DSSURDFKHVWKHSUHWUDQVODWLRQH[SDQVLRQDQGWKHSRVWWUDQVODWLRQ
H[SDQVLRQ ZKLFK FDQ EH GLVWLQJXLVKHG LQWXLWLYHO\ %XW ZKLFKSOD\V D PRUH LPSRUWDQW UROH LQ WKH LQIRUPDWLRQ UHWULHYDO GHSHQGVRQWKHTXDOLW\RITXHU\WUDQVODWLRQWRDODUJHH[WHQW >@7KHSUH
WUDQVODWLRQH[SDQVLRQUHVXOWVLQSHUIRUPDQFHEHWWHULQWKH FDVH RI
ORZ TXDOLW\ RI TXHU\ WUDQVODWLRQ )RU WKH TXHVWLRQ DQVZHULQJ
V\VWHPWKHSUHWUDQVODWLRQH[SDQVLRQFDQVWUHQJWKHQWKHHIIHFW RI
TXHU\WUDQVODWLRQHIIHFWLYHO\DFFRUGLQJWRRXUH[SHULPHQWV)RU WKH SUHWUDQVODWLRQ H[SDQVLRQ ZH GHVLJQHG D VLPSOH EXWHIIHFWLYH PHWKRG :HVXEPLWWKH(QJOLVKTXHU\ ZRUGV WR *RRJOH
6HDUFKWKHUHWXUQHGVQLSSHWVDUHVHHQDVUHOHYDQWGRFXPHQWV:H
KDYHDQDSSUR[LPDWH3VHXGR5HOHYDQFH)HHGEDFNPHWKRGEXWRXU
REMHFWLYHWKDWH[SDQVLRQLVQ¶W(QJOLVKXQLJUDPZRUGZHVHOHFWWKHELJUDPVDVRXUGHVWLQDWLRQ7KDW¶VEHFDXVHQRUPDOXQLJUDPZRUGVZLOOFRQWLQXHWROHDGWR WUDQVODWLRQDPELJXLWLHV$ SUHWUDQVODWLRQ
H[SDQVLRQ ZLWK PXFK DPELJXLWLHV RU QRLVHV ZRQ¶W EH RI KHOS WR
WKH ILQDO UHWULHYDO UHVXOW :KLOH D ELJUDP FDQ EH YLHZHG DV D
XQLJUDPWRJHWKHUZLWKLWVEULHIFRQWH[WWKXVKDYHIHZWUDQVODWLRQDPELJXLWLHV )RU H[DPSOH WKH TXHVWLRQ ³:KDW LV WKH UHODWLRQVKLSEHWZHHQ *DUILHOG DQG )R["´ ZH FDQ JHW WKH ELJUDP H[SDQVLRQ
³&HQWXU\)R[´IURPZKLFKWKHWUDQVODWRUFDQLGHQWLI\WKH³)R[´LV
QRWDQDQLPDO,Q17&,5D TXHVWLRQ³:KDW¶V WKH UHODWLRQVKLSEHWZHHQ-RUGDQDQGEDVNHWEDOO´WKHWUDQVODWLRQ³-RUGDQ´PD\EHD
ELJDPELJXLW\IRUWKHFRPSXWHUEXWZHFDQJHW³0LFKDHO-RUGDQ´WR UHSODFH ³-RUGDQ´ WKRXJK SUHWUDQVODWLRQ H[SDQVLRQ WKXV WKHH[SDQGHG ELJUDPV FDQ DOVR UHYLVH WKH RULJLQDO TXHU\ ZKLFK LV
RIWHQLQDQDEEUHYLDWHGIRUP
:H XWLOL]H WKH UHVXOW RI TXHVWLRQ DQDO\VLV ZKLFK FODVVLI\ WKHTXHVWLRQV LQWR QLQH NLQGV LQFOXGLQJ %LRJUDSK\ 3ODFH 'DWH
(YHQWDQG:K\TXHVWLRQVHWF:HQRWLFHWKDWIRUGLIIHUHQWNLQGVRITXHVWLRQV ZH VKRXOG DGRSW GLIIHUHQW H[SDQVLRQ DSSURDFKHV DQGXWLOL]H GLIIHUHQW UHVRXUFHV 1RW PRUH NLQGV RI DSSURDFKHV DQGUHVRXUFHV WR XWLOL]H PHDQV EHWWHU SHUIRUPDQFH LPSURSHU TXHU\
H[SDQVLRQRIWHQEULQJPRUHQRLVHVDQGDJJUDYDWHWKHUHVXOWRI,5
)LJXUH/LWHUDOHUURUVKDSSHQHGLQTXHVWLRQV
,Q WKH ,54$ HYDOXDWLRQ ZH ILQG VRPH OLWHUDO HUURUV LQ WKHRULJLQDO TXHVWLRQ )RU H[DPSOH WKH TXHVWLRQ RI 723,&,' $&/,$&6 3OHDVH OLVW WKH HYHQWV UHODWHG WR WKHPRYLH ,QLWLDOV ' 7KH ULJKW VSHOO RI ,QLWLDOV ' VKRXOG EH
,QLWLDO ' ZH GRQ¶W PRGLI\ WKDW GLUHFWO\ EXW XWLOL]H D
/HYHQVKWHLQ 'LVWDQFH WR ILQG RXW WKH PRVW SRVVLEOH :LNLSHGLDHQWU\ ,Q WKH ILJXUH  ZH FDQ VHOHFW WKH ILUVW HQWU\ DV RXUGHVWLQDWLRQHDVLO\7KHVDPHVLWXDWLRQRFFXUVLQ$&/,$&6ZKHUH WKH ³2O\PSLFV *DPH´ VKRXOG EH ³2O\PSLFV *DPHV´ WKH$&/,$&6KDYHVSHOOPLVWDNHVWRR)RUWKH%LRJUDSK\TXHVWLRQZHMXVWKDYHDSRVWWUDQVODWLRQTXHU\
H[SDQVLRQ 7KH VRXUFH ZH XWLOL]HG LV :LNLSHGLD LI QRW VXFFHHG
WKHQWXUQWR%DLGX %DLNH LI IDLOHG FRQWLQXRXVO\ ZH ZLOO KDYH WR
VXEPLW WKHP WR *RRJOH 6HDUFK ,I ZH ILQG WKH HQWULHV LQ WKH:LNLSHGLDRU%DLGX%DLNHZHMXVWJHWWKHILUVWSDUDJUDSKDQGXVH
VRPHWHPSODWHVVXFKDV³ߎ⫳ ´³⿄Ў ´³㈡䌃 ´WRH[WUDFWUHOHYDQWTXHU\ZRUGV(OVHZHMXVW XVH D PRGLILHG WILGI PHWKRGWRJHWWKHUHOHYDQWZRUGV
7KH 'HILQLWLRQ TXHVWLRQDQG WKH/RFDWLRQ TXHVWLRQDUH SURFHVVHG
LQ WKH VDPH ZD\ ZLWK %LRJUDSK\ TXHVWLRQ 2I FRXUVH WKH\ KDYH
GLIIHUHQW WHPSODWHV WR H[WUDFW UHODWHG ZRUGV 7KHUH DUH PDQ\VLPLODULWLHV DPRQJ WKH WKUHH NLQGV RI TXHVWLRQV WKH TXHU\ ZRUGV
DUH VRPH 1DPHG (QWLWLHV RU VLQJOH ZRUGV ZKLFK FDOOHG VLPSOH
TXHVWLRQV)RUWKH:K\TXHVWLRQ/LVWTXHVWLRQDQGRWKHUTXHVWLRQZHKDYHD
SUHWUDQVODWLRQ DQG SRVWWUDQVODWLRQ H[SDQVLRQ WRJHWKHU %HFDXVH
WKHVHTXHVWLRQVLVGLIIHUHQWIURPWKHDERYHWKUHHNLQGVRITXHVWLRQZKRVH NH\ZRUGV FDQ EH PRUH WKDQ RQH ZRUG DQG FDQ QRW JHW D

― 141 ―

Proceedings of NTCIR-8 Workshop Meeting, June 15–18, 2010, Tokyo, JapanPXFKVDWLVILHGTXDOLW\RIWUDQVODWLRQVRSUHWUDQVODWLRQH[SDQVLRQ
LVLQWHJUDWHGWRFRSHZLWKWKHOLPLWDWLRQV)RUWKH5HODWLRQVKLSTXHVWLRQLWRIWHQKDVDIRUPRI³:KDWLVWKH
UHODWLRQVKLS EHWZHHQ ; DQG < " ´ :KHQ ZH GHWHUPLQH WKHFDQGLGDWH H[WHQVLRQV ZH DGRSW D PRGLILHG WILGI PHWKRG ,Q WKHPHWKRGWKHWILVUHSODFHGE\DSURGXFWEHWZHHQWI[DQGWI\7KHWI[UHSUHVHQWWKHWHUPIUHTXHQF\QHDURI;DQGWI\PHDQVQHDURI< '2&801(75(75,(9$/ ,QGH['RFXPHQWV VKRXOG EH LQGH[HG ILUVW WR KDYH GRFXPHQW UHWULHYDO
:H XVH ,QGUL WR FUHDWH DQ LQGH[ DQG WKH LQGH[ XQLW LV ZRUGVVHJPHQWHGE\&KLQHVH:RUG 6HJPHQWV\VWHPRI '/87 ZKLFK LV
EDVHGRQ&5)>@DQGPDNHVKLJKSHUIRUPDQFHLQVHJPHQWZRUGV

H[SODQDWLRQLVWKDWWKHHDUOLHUSDUWRIUHVXOWWKDWZLWKH[SDQVLRQVLV
UHWULHYHG E\ ERWK TXHULHV DQG H[SDQVLRQV VR WKH\ DUH WKH PRVWUHODWHGGRFXPHQWV7KHODWWHUSDUWPD\EHFDXVHGHLWKHUE\TXHULHV
RUH[SDQVLRQVVRPD\HYHQOHVVUHODWHGDVWKHHDUOLHUSDUWRIUHVXOWWKDWZLWKRXWH[SDQVLRQVDWDOO (;3(5,0(176$1'5(68/76
7KHH[SHULPHQWVDUHUXQRQ;LQKXD1HZVRI3HRSOH¶V5HSXEOLFRI
&KLQD ZKLFK LV VLPSOLILHG &KLQHVH VW\OH :H KDYH VXEPLWWHG 
UHVXOWV WKHVHFRQGDQGWKHWKLUGLVVDPH '/87(1&67KDVDQRUPDOLQIRUPDWLRQUHWULHYDODQGWKHRWKHULQDK\EULGZD\7DEOH(YDOXDWLRQ5HVXOW'/87(1&67'/87(1&67 6WUXFWXUDO4XHU\/DQJXDJH
6RPH GHWDLOV DOVR VKRXOG EH QRWLFHG )RU H[DPSOH ZKHQ ZH
UHWULHYDO D ZHVWHUQ SHUVRQ KLV &KLQHVH QDPH VKRXOG EH GLYLGHG
LQWRVHYHUDOSDUWVE\WKHGRWLQWKHQDPH)RUWKHQDPH³ᴀˊᢝⱏ ´ ³ELQ /DGHQ´  WKH  ³ ᢝ ⱏ ´ ³/DGHQ´  RIWHQ DSSHDUV LQ
&KLQHVHQHZVVHSDUDWHO\6RZHVKRXOGJLYHLWDDSSURSULDWHTXHU\ZHLJKW 7KH SODFH QDPH VXFK DV ³ৄ࣫Ꮦ´ ³7DLSHL &LW\´  RIWHQDSSHDUVLQWKHIRUPRI³ৄ࣫´ ³7DLSHL´ ZLWKRXWRISODFHVXIIL[VRDV\Q ৄ࣫Ꮦৄ࣫ VKRXOGEHDGGHG

 3DVVDJH5HWULHYDO
,QRXUV\VWHPZHXVHSDVVDJHDVUHWULHYDOXQLWVLQFHGRFXPHQWLV
QRW D SURSHU JUDQXODULW\ IRU LQIRUPDWLRQ UHWULHYDO RULHQWHG WR
TXHVWLRQ DQVZHULQJ :H VHSDUDWH WKH GRFXPHQW LQWR VHYHUDOSDVVDJHV (DFK SDVVDJH UHWULHYHG ZLWK VFRUH DVVLJQHG E\ ,QGUL
7KHQ ZH DVVLJQHG HDFK GRFXPHQW ZLWK LWV EHVW SDVVDJH VFRUH
'RFXPHQWVZLOOEHVRUWHGDFFRUGLQJWRWKHLUVFRUHVWKHPRUHKLJKVFRUHPHDQVPRUHUHOHYDQWGRFXPHQW

 +\EULG0HWKRG)LUVWO\ZHKDYHWH[WUHWULHYDODVWKHDERYHSURFHGXUHV$WODVWZH
KDYH D K\EULG UHWULHYDO :H ILUVW UHWULHYDO DV QRUPDO ZLWK ZHEH[SDQVLRQ LQ WKH VHFRQG VWHS ZH KDYH D UHWULHYDO ZLWKRXWH[SDQVLRQ DW DOO 7KHQ ZH FRPELQHG WKH WZR UHVXOWV 7KH VWHSVPHQWLRQHG DERYH WDNH WKH ILUVW WKLUG RI WKH SUHYLRXV UHVXOWV LQWR
WKH ILQDO UHVXOWV 7KHQ DOWHUQDWHO\ IHWFK WKH UHVXOWV LQWR WKH ILQDOUHVXOWV HYHU\ WLPH  IRU ODWWHU EXW  IRU SUHYLRXV ([SHULPHQWVVKRZ D EHWWHU SHUIRUPDQFH RI WKLV K\EULG DSSURDFK D UHDVRQDEOH

0HDQ$3

0HDQ4

0HDQQ'&*















 5()(5(1&(6>@ 6DNDL7.DQGR1/LQ&-0LWDPXUD7-L' &KHQ.+1\EHUJ(2YHUYLHZRIWKH17&,5$&/,$,54$
7DVN3URFHHGLQJVRI17&,5WRDSSHDU
>@ 6DNDL 7 .DQGR +LGHNL 6KLPD 1RULNR .DQGR  2YHUYLHZ
RI WKH 17&,5 $&/,$ ,54$ 7DVN 3URFHHGLQJV RI
17&,5WRDSSHDU
>@ /L[LQ 6KL -LDQ<XQ 1LH DQG *XLKRQJ &DR 5$/,
([SHULPHQWVLQ,54$DW17&,517&,5SS

>@ &KLK&KXDQ+VX<X7H /L <RX:HL&KHQ DQG 6KLK+XQJ
:X 4XHU\ ([SDQVLRQ YLD /LQN $QDO\VLV RI :LNLSHGLD IRU&/,517&,5SS
>@ 3DXO 0F1DPHH PHV 0D\ILHOG &RPSDULQJ FURVVODQJXDJHTXHU\ H[SDQVLRQ WHFKQLTXHV E\ GHJUDGLQJ WUDQVODWLRQUHVRXUFHVSS
>@ /XR <DQ\DQ +XDQJ 'HJHQ &KLQHVH :RUG 6HJPHQWDWLRQ
%DVHG RQ WKH 0DUJLQDO 3UREDELOLWLHV *HQHUDWHG E\ &5)V-RXUQDORI&KLQHVH,QIRUPDWLRQ3URFHVVLQJ― 142 ―