Vol.2015-NL-223 No.12
2015/9/28

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Report‫ޠݴ‬ԣஅ࣭໰Ԡ౴ʹదͨ͠‫ػ‬ց຋༁ධՁई౓ͷ‫ݕ‬౼ਿࢁ ‫ࢤڗ‬࿕1,a) ਫ্ խത1,b) χϡʔϏοά άϥϜ1,c) ٢໺ ޾Ұ࿠1,d)αΫςΟ αΫϦΞχ1,e) ‫ ాށ‬ஐ‫ج‬1,f) தଜ ఩1,g)֓ཁɿେ‫ن‬໛ͳ஌ࣝϕʔεΛ༻͍Δ͜ͱͰɺ࣭໰Ԡ౴γεςϜ͸෯޿͍࣭໰ʹճ౴͢Δ͜ͱ͕Ͱ͖ΔΑ͏ʹͳΔɻ͔͠͠ɺ஌ࣝϕʔε͸ओཁͳ‫ݶʹޠݴ‬ఆ͞Ε͍ͯΔͨΊɺ‫ػ‬ց຋༁ͳͲΛ༻͍ͨ‫ޠݴ‬ԣஅʹΑ࣭ͬͯ໰Ԡ౴Λߦ͏ඞཁ͕͋Δ৔߹͕͋Δɻ‫ػ‬ց຋༁Λར༻ͯ͠‫ޠݴ‬ԣஅΛߦ͏ࡍɺ຋༁ੑೳ͕࣭໰Ԡ౴ͷਫ਼౓ʹӨ‫ڹ‬Λ༩͑Δ͜ͱ͸໌Β͔Ͱ͋ΔɻҰൠతͳ‫ػ‬ց຋༁͸ɺਓؒͷධՁʹ૬ؔΛ࣋ͭΑ͏ઃ‫͞ܭ‬ΕͨࣗಈධՁई౓ʹΑͬͯධՁɾ࠷దԽ͞Ε͍ͯΔ͕ɺͦͷΑ͏ͳई౓͕࣭໰Ԡ౴ʹద͍ͯ͠Δͱ͸‫ݶ‬Βͳ͍ɻຊߘͰ͸ɺෳ਺ͷ຋༁ख๏Λ༻͍࣭ͯ໰Ԡ౴σʔληοτΛ࡞੒࣭ͯ͠໰Ԡ౴Λߦ͍ɺෳ਺ͷධՁई౓ͱ࣭໰Ԡ౴ਫ਼౓ͱͷؔ܎Λௐࠪ͢Δɻͦͷ݁Ռɺ࣭໰Ԡ౴ਫ਼౓ʹӨ‫ڹ‬Λ༩͑Δ຋༁ͷཁҼ΍ɺ࣭໰Ԡ౴ਫ਼౓ͱ૬͕ؔߴ͍ධՁई౓Λൃ‫ͨ͠ݟ‬ɻΩʔϫʔυɿ࣭໰Ԡ౴, ‫ػ‬ց຋༁, ࣗಈධՁई౓1. ͸͡Ίʹͯɺฌ౻Β [1] ͷ‫Ͱڀݚ‬͸ɺจॻ΍ Web ϖʔδΛ༻͍ͨ‫ݴ‬‫ޠ‬ԣஅ࣭໰Ԡ౴λεΫʹ͓͍ͯɺίʔύεͷจશମΛ༻͍࣭໰Ԡ౴͸ɺ࣭໰จʹର͢Δղ౴Λ৘ใ‫͔ݯ‬Β‫͢ࡧݕ‬Δֶͯशͨ͠຋༁Ϟσϧʹൺ΂ɺ‫ػ‬ೳ‫ޠ‬Λআֶ͍ͯशͨ͠຋λεΫͰ͋ΓɺҰൠʹɺจॻɺWeb ϖʔδɺ஌ࣝϕʔε༁Ϟσϧ͕ΑΓߴ͍࣭໰Ԡ౴ਫ਼౓Λ࣮‫͍ͯ͠ݱ‬Δɻ·ͨɺͳͲ͕৘ใ‫͍༻ͯ͠ͱݯ‬ΒΕΔɻ͜͏ͨ͠৘ใ‫ݯ‬͸‫ʹޠݴ‬຋༁‫ث‬Λ‫ޠݴ‬ԣஅ࣭໰Ԡ౴ʹ࠷దԽ͢Δ‫ڀݚ‬΋ߦΘΕ͍ͯΑͬͯภΓ͕ଘࡏ͠ɺ࣭໰จͱ৘ใ‫ݯ‬ͷ‫͕ޠݴ‬ҟͳΔ৔߹

Δ [2], [3] ͕ɺ͜ΕΒͷख๏͸࣭໰ͱղ౴ͷେ‫ن‬໛ͳฒྻͷ࣭໰Ԡ౴Λಛʹ‫ޠݴ‬ԣஅ࣭໰Ԡ౴ͱ‫Ϳݺ‬ɻίʔύεΛඞཁͱ͢ΔͨΊɺଟ༷ͳ‫ʹޠݴ‬ద༻͢Δ͜ͱ͕୯‫Ͱޠݴ‬ͷ࣭໰Ԡ౴Ͱ͸ɺ༷ʑͳ࿩୊ͷ࣭໰ʹղ౴͢Δ

ࠔ೉Ͱ͋Δɻ͜ΕΒʹؔ࿈͠ɺ‫ޠݴ‬ԣஅ࣭໰Ԡ౴ͷਫ਼౓ΛͨΊʹߏ଄Խ͞Εͨେ‫ن‬໛ͳ஌ࣝϕʔεΛ༻͍Δख๏͕੝޲্ͤ͞Δ‫ػ‬ց຋༁ͷઃ‫ܭ‬ͷ୺ॹͱͯ͠ɺ࣭໰Ԡ౴ਫ਼౓ʹΜʹ‫͞ڀݚ‬Ε͍ͯΔɻ஌ࣝϕʔε͸গ਺ͷओཁͳ‫͠ʹޠݴ‬Ө‫ڹ‬Λ༩͑Δ຋༁݁ՌͷཁҼΛௐࠪ͢Δ͜ͱ͸༗༻Ͱ͋Δ

͔ଘࡏ͠ͳ͍ͨΊ஌ࣝϕʔεΛ࣭໰Ԡ౴ʹར༻͢Δࡍʹ͸ͱߟ͑ΒΕΔɻ‫ޠݴ‬ԣஅ͕ಛʹॏཁͱͳΔɻ͜͏ͨ͠‫ޠݴ‬ԣஅͷखஈͱͯ͠ɺ‫ػ‬ց຋༁͕༻͍ΒΕ͍ͯΔɻຊ‫Ͱڀݚ‬͸ɺ஌ࣝϕʔεΛ༻͍ͨ‫ޠݴ‬ԣஅ࣭໰Ԡ౴ʹ͓͚Δ຋༁ͷӨ‫ڹ‬Λௐࠪ͢ΔͨΊɺ‫ͳͱج‬Δ࣭໰Ԡ౴ධՁҰൠతͳ‫ػ‬ց຋༁͸ਓؒͷར༻ऀΛ૝ఆ͓ͯ͠Γɺਓؒσʔληοτͷ࣭໰จΛ༷ʑͳ຋༁γεςϜΛ༻͍ͯ 5 ௨ͷධՁͱߴ͍૬ؔΛ࣋ͭධՁई౓Λఆٛ͢Δ͜ͱ͕ॏཁͰΓʹ຋༁͠ɺ৽ͨʹ 5 ͭͷධՁσʔληοτΛ࡞੒ͨ͠ɻ

͋Δɻ‫ػ‬ց຋༁෼໺Ͱ͸ਓؒͷධՁͱؔ܎͕ਂ͍‫ػ‬ց຋༁·ͨɺ࡞੒ͨ͠σʔληοτͷ༁࣭ධՁͱɺͦΕΛ༻͍ͨ݁Ռͷಛ௃ΛͲͷΑ͏ʹࣗಈධՁई౓ʹ൓өͤ͞Δ͔͕‫ޠݴ‬ԣஅ࣭໰Ԡ౴Λߦ͍ɺ༁࣭ධՁई౓ͱ࣭໰Ԡ౴ਫ਼౓ͷ޿͘‫͞ڀݚ‬Ε͖ͯͨɻ͔͠͠ͳ͕Βɺਓؒʹͱͬͯྑ͍຋ؔ܎Λௐࠪͨ͠ɻ݁Ռͱͯ͠ɺ࣭໰Ԡ౴ਫ਼౓͸ɺ୯‫ޠ‬ͷग़༁͕ඞͣ͠΋࣭໰Ԡ౴ʹద͍ͯ͠Δͱ͸‫ݶ‬Βͳ͍ɻྫͱ͠‫ݱ‬ස౓Λߟྀͨ͠ई౓Ͱ͋Δ NIST είΞͱߴ͍૬ؔΛࣔͨ͠ɻ͜ͷ݁Ռ͸ɺ‫ޠݴ‬ԣஅ࣭໰Ԡ౴ʹ͓͍ͯग़‫ݱ‬ස౓ͷ1a)b)c)d)e)f)g)ಸྑઌ୺Պֶٕज़େֶӃେֶ
NAIST, Takayamacho 8916-5, Ikoma, Nara 630–0101, Japansugiyama.kyoshiro.sc7@is.naist.jp
masahiro-mi@is.naist.jp
neubig@is.naist.jp
koichiro@is.naist.jp
ssakti@is.naist.jp
tomoki@is.naist.jp
s-nakamura@is.naist.jp

c 2015 Information Processing Society of Japan௿͍୯‫͕ޠ‬ॏཁͳ໾ׂΛ͍࣋ͬͯΔ͜ͱΛ͍ࣔͯ͠ΔɻՃ
͑ͯɺਓखʹΑΔ෼ੳͷ݁Ռɺ‫ޠݴ‬ԣஅ࣭໰Ԡ౴ʹӨ‫ڹ‬Λ‫͔͍ͭ͘͢΅ٴ‬ͷ຋༁ཁҼΛಛఆͨ͠ɻ

2. σʔληοτຊ‫Ͱڀݚ‬͸ɺ࣭໰Ԡ౴ʹ͓͚Δ຋༁ͷӨ‫ڹ‬Λௐࠪ͢Δͨ

1

Vol.2015-NL-223 No.12
2015/9/28

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical ReportΊɺඪ४తͳ࣭໰Ԡ౴ධՁσʔληοτΛ‫ʹج‬ɺਓख຋༁ද 1֤ςετηοτʹ‫·ؚ‬ΕΔ࣭໰จͱਖ਼ղ࿦ཧࣜͷྫͱ‫ػ‬ց຋༁Λ༻͍ͯ৽ͨͳσʔληοτΛ࡞੒ͨ͠ɻຊઅSetQuestionͰ͸ɺ͜ͷσʔληοτͷ࡞੒ํ๏ʹ͍ͭͯड़΂ΔɻOR

what is europe ’s area‫ͳͱج‬Δσʔληοτͱͯ͠ɺFree917[4] Λ༻͍ͨɻJAϤʔϩούͷ໘ੵ͸

Free917 ͸ Freebase ͱ‫ݺ‬͹ΕΔେ‫ن‬໛஌ࣝϕʔεΛ༻͍ͨHTwhat is the area of europe (location.location.area

GTthe area of europe

YT

the area of europeMothe area of europeTrawhat is the area of europe࣭໰Ԡ౴ͷͨΊʹ࡞੒͞Ε͓ͯΓɺ࣭໰Ԡ౴ͷ‫͘޿ʹڀݚ‬ར༻͞Ε͍ͯΔ [4], [5]ɻ͜ͷσʔληοτ͸ 917 ରͷ࣭໰จͱਖ਼ղͰߏ੒͞ΕΔɻ֤ਖ਼ղ͸ɺFreebase ʹೖྗͨ͠ͱ͖ͷग़ྗ͕࣭໰ʹର͢Δਖ਼౴ͱͳΔ࿦ཧࣜͰ༩͑ΒΕΔɻ

Logical formen.europe)ઌߦ‫[ ڀݚ‬4] ʹै͍ɺ͜ͷσʔληοτΛ train ηοτ (512ର)ɺdev ηοτ (129 ର)ɺtest ηοτ (276 ର) ʹ෼ׂͨ͠ɻKĐĐŝĚĞŶƚĂůŽůůĞŐĞ͕ŽůƵŵďŝĂhŶŝǀĞƌƐŝƚǇҎ߱ɺ͜ͷ຋༁લͷ test ηοτΛ OR ηοτͱ‫Ϳݺ‬ɻ࣍ʹɺ5 छྨͷ຋༁ख๏ʹΑΔ຋༁݁ՌΛ༻͍࣭ͯ໰σʔǆĞĐƵƚĞŽŶĂƚĂďĂƐĞληοτΛ࡞੒ͨ͠ɻ·ͣɺOR ηοτʹ‫·ؚ‬ΕΔ࣭໰จdǇƉĞ͘hŶŝǀĞƌƐŝƚǇ ĚƵĐĂƚŝŽŶ͘ĂƌĂĐŬKďĂŵĂΛਓखͰ࿨༁͠ɺ೔ຊ‫࣭ޠ‬໰จͱਖ਼ղ࿦ཧࣜͷର͔Β੒ΔσʔληοτΛ࡞੒ͨ͠ (JA ηοτͱ‫)Ϳݺ‬ɻ࣍ʹɺJAďƌŝĚŐŝŶŐĚƵĐĂƚŝŽŶdǇƉĞ͘hŶŝǀĞƌƐŝƚǇηοτͷ࣭໰จΛҎԼʹड़΂Δ֤ख๏Ͱӳ༁͠ɺ຋༁͞ΕĂƌĂĐŬKďĂŵĂͨӳ‫࣭ޠ‬໰จͱਖ਼ղ࿦ཧࣜͷର͔Β੒ΔσʔληοτΛ࡞੒ͨ͠ɻ֤ςετηοτͷྫΛද̍ʹࣔ͢ɻĂůŝŐŶŵĞŶƚਓख຋༁ ຋༁‫ʹऀۀ‬೔ӳ຋༁Λґཔ͠ɺ࣭໰จͷ೔ӳ຋tŚŝĐŚ༁Λߦͬͨɻ͜ΕʹΑͬͯ࡞੒ͨ͠σʔληοτΛਤ 1HT ηοτͱ‫Ϳݺ‬ɻĐŽůůĞŐĞĂůŝŐŶŵĞŶƚĚŝĚKďĂŵĂŐŽƚŽ͍

SEMPRE ϑϨʔϜϫʔΫʹΑΔ࣭໰Ԡ౴ͷಈ࡞ྫ঎༻຋༁γεςϜ Web ϖʔδΛ௨ͯ͠ར༻Ͱ͖Δ঎༻຋༁γεςϜͰ͋Δ Google ຋༁ *1 ͱ Yahoo!຋༁ *2 Λ͏ͳେ‫ن‬໛஌ࣝϕʔεΛར༻͢Δ࣭໰Ԡ౴ϑϨʔϜϫʔΫར༻ͯ͠೔ӳ຋༁Λߦͬͨɻ͜ΕΒͷ຋༁γεςϜͷͰ͋ΔɻຊઅͰ͸ɺSEMPRE ͷಈ࡞Λ؆ܿʹड़΂ɺͲͷৄࡉ͸ެ։͞Ε͍ͯͳ͍͕ɺGoogle ຋༁͸େ‫ن‬໛ͳΑ͏ͳ຋༁͕Ө‫ڹ‬Λ༩͑Δͱߟ͑ΒΕΔ͔Λड़΂Δɻਤ 1౷‫ܭ‬త‫ػ‬ց຋༁ɺYahoo!຋༁͸ϧʔϧϕʔε‫ػ‬ց຋༁ʹ SEMPRE ϑϨʔϜϫʔΫͷಈ࡞ྫΛࣔ͢ɻΛ‫ͨ͠ʹج‬΋ͷͱࢥΘΕΔɻGoogle ຋༁ͷ຋༁݁ՌΞϥΠϝϯτ (Alignment)

SEMPRE ͸ɺࣗવ‫ޠݴ‬ͷϑΛ༻͍ͯ࡞੒ͨ͠σʔληοτΛ GT ηοτɺYahooϨʔζͱରԠ͢Δ࿦ཧࣜͷϚοϐϯάΛඞཁͱ͢Δɻ຋༁ͷ຋༁݁ՌΛ༻͍ͯ࡞੒ͨ͠΋ͷΛ YT ηοτͱ͜ΕΛϨΩγίϯ (Lexicon) ͱ‫Ϳݺ‬ɻϨΩγίϯ͸‫Ϳݺ‬ɻେ‫ن‬໛ͳςΩετίʔύεͱ஌ࣝϕʔεΛ༻͍ͯߏ

Moses Moses[6] Λ༻͍ͯ࡞੒͞ΕͨϑϨʔζϕʔε‫ػ‬ցங͞ΕΔɻຊ‫Ͱڀݚ‬͸ ClueWeb09*4 [8] ͱ‫ݺ‬͹ΕΔς຋༁Λ༻͍࣭ͯ໰จΛ຋༁ͨ͠ɻMoses ͷֶशʹ͸ɺΩετίʔύεͱ Freebase Λ༻͍ΔɻΞϥΠϝϯτ

277 ສจͷίʔύεΛ༻͍ͨɻMoses ʹΑΔ຋༁݁Ռ(alignment) ͱ‫ݺ‬͹ΕΔॲཧͰ͸ɺϨΩγίϯΛ༻͍Λ༻͍ͯ࡞੒ͨ͠σʔληοτΛ Mo ηοτͱ‫Ϳݺ‬ɻ࣭ͯ໰จதͷϑϨʔζΛ࿦ཧࣜʹม‫͢׵‬Δɻ

Travatar Travatar[7] ʹΑͬͯ࡞੒͞Εͨɺߏจ໦ϕʔΞϥΠϝϯτʹӨ‫ڹ‬Λ‫͑ߟͱ͢΅ٴ‬ΒΕΔ຋༁ͷཁҼεͷ‫ػ‬ց຋༁γεςϜΛ༻͍࣭ͯ໰จΛӳ༁ͨ͠ɻߏ͸ɺ୯‫ޠ‬ͷมԽͰ͋Δɻ࣭໰จͷதͷ෦෼จࣈྻ͸Ξจ໦ϕʔεͷ‫ػ‬ց຋༁͸ɺ೔ӳɾӳ೔຋༁ʹ͓͍ͯߴϥΠϝϯτʹ͓͚Δ࿦ཧࣜͷબ୒ʹ༻͍ΒΕΔͨΊɺ͍ੑೳΛࣔ͢͜ͱ͕஌ΒΕ͍ͯΔɻֶशʹ༻͍ͨσʔ‫ޡ‬຋༁͞Εͨ୯‫ޠ‬͸ΞϥΠϝϯτͰͷࣦഊΛҾ͖‫͜ى‬λ͸ Moses ͱಉ༷Ͱ͋ΔɻTravatar ʹΑΔ຋༁݁Ռ͢ͱߟ͑ΒΕΔɻ

Λ༻͍ͯ࡞੒ͨ͠σʔληοτΛ Tra ηοτͱ‫Ϳݺ‬ɻϒϦοδϯά (Bridging) ஌ࣝϕʔεʹೖྗ͢ΔΫΤϦΛੜ੒͢ΔͨΊɺྡ઀ͨ͠࿦ཧࣜΛ౷߹͢ΔɻϒϦο

3. ࣭໰Ԡ౴γεςϜδϯά͸ྡ઀͢Δ࿦ཧ͔ࣜΒड़‫ͳͱޠ‬Δ࿦ཧࣜΛੜ੒͢Δಈ࡞Ͱ͋Δɻਤ̍ͷྫͰ͸ɺBarackObama ͱ࣭໰Ԡ౴Λߦ͏ͨΊɺຊ‫Ͱڀݚ‬͸ SEMPRE[5] ͱ͍͏ϑ
*3ϨʔϜϫʔΫΛར༻ͨ͠ɻType.University ͔Β Education ͕ੜ੒͞Ε͍ͯΔɻ

SEMPRE ͸ɺFreebase ͷΑϒϦοδϯάʹӨ‫ڹ‬Λ‫͑ߟͱ͢΅ٴ‬ΒΕΔ຋༁ͷཁҼ
*1
*2
*3

https://translate.google.co.jp/
http://honyaku.yahoo.co.jp/
http://nlp.stanford.edu/software/sempre/

c 2015 Information Processing Society of Japan͸ɺ‫ॱޠ‬ͷมԽͰ͋Δɻ‫͕ॱޠ‬ҟͳΔͱΞϥΠϝϯτ
*4

http://www.lemurproject.org/clueweb09.php/2Vol.2015-NL-223 No.12
2015/9/28

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical ReportͰੜ੒͞ΕΔ࿦ཧࣜͷॱং͕มԽ͢ΔͨΊɺྡ઀͢Δ

Ͱ͋Δɻ௝͍͠ n-gram ʹΑΓߴ͍ॏΈ͕෇͘Α͏ʹ࿦ཧࣜͷ૊Έ߹Θ͕ͤมԽ͢Δɻઃఆ͞ΕΔɻ͕ͨͬͯ͠ɺසग़͢Δ “of” ΍ “in” ͷΑείΞϦϯά (Scoring)γεςϜ͸ΞϥΠϝϯτͱϒ͏ͳ‫ػ‬ೳ‫ͱޠ‬ൺ΂ͯɺ಺༰‫ޠ‬ͷҰகʹॏ఺Λ͓͍ͨධϦοδϯά͔Βଟ਺ͷީิΛग़ྗ͠ɺείΞϦϯάͰՁΛߦ͏ɻධՁ஋͸ 0 Ҏ্ͷ࣮਺Ͱɺେ͖͍΄Ͳྑ͍ධՁؔ਺ʹ‫ิީ͍ͯͮج‬ͷྑ͞Λ‫͢ࢉܭ‬Δɻ࣭໰Ԡ౴ධՁͱͳΔɻ‫ث‬ͷֶशͰ͸ɺਖ਼ղΛฦ͢͜ͱ͕Ͱ͖ͨީิʹߴ͍ε‫ڐ‬༰ੑ (Acceptability)ίΞ͕෇͘Α͏ධՁؔ਺Λ࠷దԽ͢Δɻ‫ڐ‬༰ੑ͸ਓؒʹΑΔ 5 ஈ֊ͷධՁͰ͋Δɻ͜ͷई౓͸ɺ1 ͔Β 3 ͷධՁͰҙຯతਖ਼͠‫ޠݴ‬ԣஅ࣭໰Ԡ౴ʹ࠷దͳධՁؔ਺͸୯‫࣭ޠݴ‬໰Ԡ౴͞Λɺ3 ͔Β 5 ͷධՁͰจ๏తਖ਼͠͞ΛධՁ͢Δ͜ͱͱҟͳΔՄೳੑ͕͋Γɺ຋༁͸͜ͷॲཧʹ΋Ө‫͢ڹ‬ΔͰɺྲྀெ͞ͱࣗવੑΛ྆ํߟྀͨ͠ई౓ͱͳΔɻ

Մೳੑ͕͋Δɻ͔͠͠ͳ͕Βɺ‫ޠݴ‬ԣஅ࣭໰Ԡ౴ʹ࠷JA ηοτͷ࣭໰จΛೖྗͱ͠ɺOR ηοτͷ࣭໰จΛࢀదԽ͢ΔΑ͏ֶश͢ΔͨΊʹ͸຋༁͞Εֶͨशσʔλর༁ͱͨ࣌͠ͷ֤຋༁݁ՌͷධՁ஋Λਤ 2 ʹࣔ͢ɻNISTηοτ͕ඞཁͰ͋Γɺͦͷ࡞੒ʹ͸େ͖ͳίετ͕͔είΞ͸্‫͕ݶ‬ઃఆ͞Εͳ͍ධՁ஋ͷͨΊɺࢀর༁ͱಉ༷

͔ΔͨΊɺຊߘͰ͸͜Εʹؔ͢Δௐࠪ͸ߦ͍ͬͯͳ͍ɻͷจΛೖྗͨ͠৔߹ͷධՁ஋Ͱਖ਼‫ن‬Խͨ͠ɻ

4. ࣮‫ݧ‬ઃఆຊ࣮‫Ͱݧ‬͸ɺ‫ޠݴ‬ԣஅ࣭໰Ԡ౴ʹ͓͍ͯͲͷΑ͏ͳ຋༁ͷཁҼ͕Ө‫ڹ‬Λ‫͔͢΅ٴ‬Λௐࠪͨ͠ɻͦͷͨΊʹɺ2 અͰड़΂ͨσʔληοτͱ 3 અͰड़΂࣭ͨ໰Ԡ౴‫ث‬Λ༻͍ɺ೔ϭϬ͘ϴϬ͘ϲຊ‫ޠ‬ͷ࣭໰จΛ຋༁γεςϜͰӳ‫ޠ‬ͷ࣭໰จʹม‫͠׵‬ɺӳϬ͘ϰ‫ޠ‬ͷ୯‫࣭ޠݴ‬໰Ԡ౴‫ʹث‬Αͬͯղ౴ΛಘΔͱ͍͏ঢ়‫گ‬Λ૝Ϭ͘Ϯఆ࣮ͨ͠‫ݧ‬Λߦͬͨɻ

4.1 ࣮‫݁ݧ‬Ռ 1ɿ༁࣭ධՁ
·ͣɺ4 ͭͷ༁࣭ࣗಈධՁई౓ (BLEU+1[9]ɺWER[10]ɺϬ
>hнϭ
,d'dZ/^zdDŽਤ 2E/^ddƌĂϭͲtZ

ĐĐĞƉƚĂͲďŝůŝƚǇ༁࣭ධՁ஋ (ฏ‫)ۉ‬NIST[11]ɺRIBES[12]) ͱਓखʹΑΔ‫ڐ‬༰ੑධՁ (Acceptability)[13] Λ༻͍ͯ࡞੒ͨ͠σʔληοτͷ༁࣭ΛධՁ͠

ਤ 2 ΑΓɺਓख຋༁ͷ༁࣭͸શͯͷධՁई౓ʹ͓͍ͯ‫ػ‬ͨɻҎԼʹ֤ධՁई౓ͷৄࡉΛࣔ͢ɻց຋༁ΑΓ΋ߴ͘ɺ্࣭Ͱ͋Δ͜ͱ͕ಡΈऔΕΔɻ࣍ʹɺ

BLEU+1 BLEU[14] ͸޿͘ར༻͞Ε͍ͯΔ‫ػ‬ց຋༁ࣗGT ͱ YT ʹண໨͢ΔͱɺBLEU ͱ NIST Ͱ͸ GT ͕ߴ͘ɺಈධՁई౓Ͱ͋ΔɻBLEU+1 ͸ BLEU ʹฏ‫׈‬ԽΛಋ

RIBES ͱ‫ڐ‬༰ੑਓखධՁͰ͸ YT ͕ߴ͍ɻ͜Ε͸ઌߦ‫ݚ‬ೖ͠ɺ୯จͰ΋‫݁ͳ୺ۃ‬Ռ͕ग़ʹ͍͘Α͏֦ுͨ͠ई‫[ ڀ‬12] ͱಉ༷ͷ݁Ռͱͳ͓ͬͯΓɺ೔ӳ຋༁Ͱͷ RIBES౓Ͱ͋Δɻ͜ΕΒͷई౓͸ n-gram ͷҰக཰ʹ‫͍ͮج‬ͷ‫ڐ‬༰ੑਓखධՁͱͷ૬͕ؔߴ͍ͱ͍͏ಛੑ͕֬ೝ͞Ε͓ͯΓɺධՁ஋͸ 0 ͔Β 1 ͷ࣮਺Ͱɺࢀর༁ͱ‫׬‬શʹͨɻ࣍અͰɺ͜ͷΑ͏ͳಛੑ͕ਓؒ૬खͰ͸ͳ͘‫ޠݴ‬ཧղҰகͨ͠৔߹ʹ 1 ͱͳΔɻΛߦ͏‫ػ‬ց૬खͰ΋ಉ༷ʹ‫ݱ‬ΕΔ͔Ͳ͏͔Λ‫͢ূݕ‬Δɻ

WER Word error rate(WER) ͸ೋͭͷจͷؒͷฤू‫ڑ‬཭Λจষ௕Ͱਖ਼‫ن‬Խͨ͠΋ͷͰ͋ΔɻධՁ஋͸ 0 Ҏ্ͷ࣮਺Ͱɺࢀর༁ΑΓ΋௕͍จ௕Λ࣋ͭ຋༁Ծઆ͕ೖ

4.2 ࣮‫݁ݧ‬Ռ 2ɿ࣭໰Ԡ౴݁Ռ࣍ʹɺ࡞੒ͨ͠σʔληοτΛ༻͍࣭ͯ໰Ԡ౴Λߦͬͨɻྗ͞Εͨ࣌͸ 1 Λ௒͑Δ৔߹͕͋ΔɻWER ͸ BLEU͜͜Ͱɺςετηοτͱͯ͠࢖༻࣭ͨ͠໰ 276 ໰ͷ͏ͪ 12ͱಉ༷ʹ୯‫ޠ‬୯ҐͰͷҰகʹண໨ͨ͠ධՁई౓Ͱ͋Δ໰Ͱɺਖ਼ղ࿦ཧࣜΛ Freebase ʹೖྗͨ͠ࡍʹग़ྗ͕ಘΒΕ͕ɺBLEU ΑΓ΋‫͋Ͱ֨ݫʹॱޠ‬ΔɻWER ͸‫ޡ‬Γ཰ͣɺ͜ΕΒΛআ͍ͨ 264 ໰ͷ݁ՌΛ༻͍ͯߦͬͨɻ

Ͱ͋ΔͨΊɺධՁ஋͕௿͍ํ͕ߴධՁͱͳΔɻͦͷ֤ͨσʔληοτͷ࣭໰Ԡ౴ͷ݁ՌΛਤ 3 ʹࣔ͢ɻΊɺ࣠ͷํ޲ΛଞͷධՁई౓ͱଗ͑ΔͨΊʹ 1−WERਤΑΓɺ‫ݩ‬ͷηοτ (OR) Ͱ͋ͬͯ΋໿ 53%ͷਫ਼౓ʹཹͷ஋Λ༻͍Δɻ

RIBES RIBES ͸຋༁Ծઆͱࢀর༁ͷ୯‫ޠ‬ͷॱҐ૬ؔ܎·͍ͬͯΔ͜ͱ͕Θ͔Δɻ·ͨɺHT ηοτͷਫ਼౓͸‫ػ‬ց຋༁Ͱ࡞੒ͨ͠σʔληοτʹൺ΂ߴ͍͜ͱ͕ಡΈऔΕΔɻ਺ʹ‫ͮ͘ج‬ई౓Ͱ͋Δɻ͜ͷई౓͸೔ӳɾӳ೔ͷΑ͏͔͠͠ͳ͕Βɺ4.1 ʹࣔͨ͠Α͏ʹߴ͍༁࣭Λ࣋ͭ HT ηοͳ‫ʹॱޠ‬େ͖ͳ૬ҧ͕͋Δ‫ޠݴ‬ରʹରͯ͠ଞͷई౓ΑτͰ͋ͬͯ΋ɺOR ηοτͱൺ΂Δͱ࣭໰Ԡ౴ਫ਼౓͸༗ҙΓ΋༗ޮͰ͋Δ͜ͱ͕ࣔ͞Ε͍ͯΔɻධՁ஋͸ 0 ͔Βʹ௿͍ͱ͍͏݁Ռͱͳͬͨ (p < 0.01)ɻ·ͨɺYT ͸ਓख

1 ͷ࣮਺Ͱɺେ͖͍΄Ͳྑ͍ධՁͱͳΔɻ‫ڐ‬༰ੑධՁʹ͓͍ͯ GT Λ্ճΔ͕ɺ࣭໰Ԡ౴ਫ਼౓͸ GT

NIST NIST ͸ n-gram ͷॏΈ෇Ұக཰ʹ‫͍ͨͮج‬ई౓c 2015 Information Processing Society of Japanʹྼ͍ͬͯΔ (p < 0.05)ɻ͜ΕΒͷ݁Ռ͸ɺਓؒʹͱͬͯ

3

Vol.2015-NL-223 No.12
2015/9/28

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Report݁Ռͱͳͬͨɻͭ·ΓɺେҬతͳ‫ޠݴ͕ॱޠ‬ԣஅ࣭໰Ԡ౴YĂĐĐƵƌĂĐǇϬ͘ϲͷͨΊͷ຋༁ʹ͸ͦΕ΄ͲॏཁͰ͸ͳ͍Մೳੑ͕͋Δͱ‫ݴ‬Ϭ͘ϱ͑Δɻ͜ΕΒͷ݁ՌΛ߹ΘͤΔͱɺ‫ʹॱޠ‬Ө‫ڹ‬Λड͚΍͢Ϭ͘ϰ͍ϒϦοδϯάΑΓ΋ɺ୯‫ޠ‬ͷมԽʹӨ‫ڹ‬Λड͚΍͍͢ΞϬ͘ϯϥΠϝϯτͷํ͕‫ޡ‬Γʹහ‫͋Ͱײ‬Δͱ͍͏Մೳੑ͕ࣔ͞Ε
͍ͯΔɻϬ͘Ϯ࣍ʹɺෆਖ਼ղάϧʔϓʹ͓͚Δ༁࣭ධՁ஋ͱ࣭໰Ԡ౴ਫ਼Ϭ͘ϭ౓ͷؔ܎Λਤ 5 ʹࣔ͢ɻෆਖ਼ղάϧʔϓʹ͓͍ͯ͸ɺਖ਼ղϬάϧʔϓͱൺֱ͢ΔͱશͯͷࣗಈධՁई౓ʹ͓͍ͯແ૬ؔ

KZ

ਤ 3,d'dzdDŽdƌĂ

֤σʔληοτʹ͓͚Δ࣭໰Ԡ౴ਫ਼౓ʹۙ͘ɺਓखධՁͷΈ͕Θ͔ͣʹ૬ؔΛ࣋ͭͱ͍͏݁Ռͱͳͬͨɻ͜ͷ݁Ռ͸ɺࢀর༁Ͱͷ࣭໰Ԡ౴͕ࣦഊ͍ͯ͠Δ৔߹ɺͦͷ࣭໰จ͸ෛྫͱͯ͢͠Βෆద੾Ͱ͋Δͱ͍͏͜ྑ͍຋༁ͱ࣭໰Ԡ౴ʹద͢Δ຋༁͸ҟͳΔͱ͍͏͜ͱΛࣔͱΛ͍ࣔͯ͠Δɻଈͪɺ‫ޠݴ‬ԣஅ࣭໰Ԡ౴ͷͨΊͷ຋༁‫ث‬͍ࠦͯ͠Δɻ࣍અͰɺ͜ΕΒͷ‫ݱ‬৅ʹ͍ͭͯৄࡉͳ෼ੳΛΛධՁ͢Δࡍɺ࣭໰Ԡ౴‫͕ث‬ਖ਼ղͰ͖Δ࣭໰จΛࢀর༁ͱߦ͏ɻͯ͠ධՁΛߦ͏ͷ͕޷·͍͠ɻ*55. ෼ੳͱߟ࡯

5.2 ࣄྫ෼ੳຊઅͰ͸ɺ຋༁ʹΑ࣭ͬͯ໰Ԡ౴ͷ݁Ռ͕มԽͨ͠ྫΛ

5.1 ࣭໰Ԡ౴ਫ਼౓ͱ༁࣭ͷؔ܎࣭໰Ԡ౴ਫ਼౓ʹӨ‫ڹ‬Λ‫͢΅ٴ‬຋༁݁ՌͷཁҼΛΑΓৄࡉʹ෼ੳ͢ΔͨΊɺ·ͣ༁࣭ධՁ஋ͱ࣭໰Ԡ౴ਫ਼౓ͷ૬ؔΛ‫͕ͳ͛ڍ‬ΒɺͲͷΑ͏ͳ຋༁݁ՌͷཁҼ͕Ө‫͍ͯ͠ڹ‬Δ͔
Λߟ࡯͢Δɻจ୯ҐͰ෼ੳͨ͠ɻ͔͠͠ͳ͕Βɺͨͱ࣭͑໰Ԡ౴༻ʹ࡞੒͞Εͨσʔληοτ (OR ηοτ) Ͱ͋ͬͯ΋໿൒਺ͷ࣭໰͸ਖ਼ղͰ͖͓ͯΒͣɺ຋༁ͷ݁ՌʹؔΘΒͣਖ਼ղ͢Δ͜ͱ͕೉͍࣭͠໰͕͋Δͱߟ͑ΒΕΔɻ͜ͷӨ‫ڹ‬ΛߟྀʹೖΕΔͨΊɺ࣭໰Λ 2 ͭͷάϧʔϓʹ෼͚ͨɻʮਖ਼ղάϧʔϓʯ͸ɺOR ηοτʹ͓͍ͯਖ਼ղ͢Δ͜ͱ͕Ͱ͖ͨ 141 ໰ͷ຋༁݁Ռ 141 × 5 = 705 ໰͔Β੒ΔάϧʔϓͰ͋Γɺʮෆਖ਼ղάϧʔϓʯ͸࢒Γͷ 123 ໰ͷ຋༁݁Ռ 123 × 5 = 615໰͔Β੒ΔάϧʔϓͰ͋Δɻ·ͣɺਖ਼ղάϧʔϓʹ͓͚Δ࣭໰Ԡ౴ਫ਼౓ͱ༁࣭ධՁ஋

ද 2 ಺༰‫ޠ‬มԽͷྫ

◦ OR when was interstate 579 formed- JA भؒߴ଎ಓ࿏ 579 ߸͕࡞ΒΕͨͷ͸͍ͭͰ͔͢
× HT when was interstate highway 579 made× GT when is the interstate highway no. 579 has been made× YT when is it that expressway 579 between states was made× Mo interstate highway 579) was made when
◦ Tra when interstate 579) was built◦ OR who was the librettist for the magic fluteͷؔ܎Λਤ 4 ʹࣔ͢ɻ͜ͷάϥϑʹ͓͍ͯɺ๮άϥϑ͸ධ- JA ຐథͷ୆ຊΛ࡞੒ͨ͠ͷ͸୭Ͱ͔͢Ձ஋ʹର͢Δ࣭໰਺ͷ෼෍Λද͠ɺંΕઢάϥϑ͸ධՁ஋× HT who wrote the libretto to the magic fluteʹର͢Δਖ਼౴཰ͷมԽΛද͢ɻྫͱͯ͠ɺBLEU+1 ͷ஋͕× GT who was it that created the script of the magic flute

0.2–0.3 ͷ࣭໰͸ਖ਼ղάϧʔϓͷ಺ 30%΄ͲΛ઎ΊɺͦΕ

× YT who is it to have made a script of the the magic fluteΒͷ࣭໰ͷਖ਼౴཰͸ 35%ఔ౓Ͱ͋Δɻ͜ͷਤΑΓɺຊ࣮‫ݧ‬× Mo the magic flute scripts who preparedʹ࢖༻ͨ͠શͯͷධՁई౓͸࣭໰Ԡ౴ਫ਼౓ͱ૬ؔΛ࣋ͪɺ× Tra who made of magic script‫ޠݴ‬ԣஅ࣭໰Ԡ౴ʹ͓͍ͯ༁࣭͸ॏཁͰ͋Δ͜ͱΛࣔͯ͠◦ -who librettist magic flute͍Δɻ·ͨɺ࣭໰Ԡ౴ਫ਼౓͸ NIST είΞͱ࠷΋ߴ͍૬ؔΛࣔͨ͠ɻલड़ͨ͠Α͏ʹɺNIST είΞ͸୯‫ޠ‬ͷग़‫ݱ‬ස౓Λߟྀͨ͠ई౓Ͱ͋Γɺ‫ػ‬ೳ‫ޠ‬ΑΓ΋಺༰‫ޠ‬Λॏཁࢹ͢Δಛ௃Λ࣋ͭɻ͜ͷ݁Ռ͔Βɺ಺༰‫ޠݴ͕ޠ‬ԣஅ࣭໰Ԡ౴ʹ͓͍ͯॏཁͳ໾ׂΛ࣋ͭͱߟ͑ΒΕΔɻ͜Ε͸ɺ಺༰‫ޠ‬
͕ 3 અʹड़΂ͨΞϥΠϝϯτʹ͓͚Δ࿦ཧࣜબ୒ʹ͓͍ͯॏཁͰ͋Δ͜ͱΛߟ͑Δͱࣗવͳ݁Ռͱ‫͑ݴ‬Δɻ·ͨɺNIST είΞʹΑͬͯ͜ͷӨ‫ڹ‬Λࣗಈతʹద੾ʹධՁͰ͖ΔՄೳੑ΋͜ͷ݁Ռ͔ΒಡΈऔΕΔɻ
ҰํͰɺ4 અʹࣔͨ͠Α͏ʹਓखධՁͱͷ૬͕ؔߴ͔ͬ
ͨ RIBES ͸ɺ࣭໰Ԡ౴ਫ਼౓ʹ͓͍ͯ͸૬͕ؔ௿͍ͱ͍͏

c 2015 Information Processing Society of Japan಺༰‫ޠ‬ͷมԽʹΑΔ࣭໰Ԡ౴݁ՌͷมԽͷྫΛද 2 ʹࣔ͢ɻ1 ͭ໨ͷྫͰ͸ɺ“interstate 579” ͱ͍͏಺༰‫͕ޠ‬຋༁ʹΑ༷ͬͯʑʹมԽ͍ͯ͠Δ (“interstate highway 579”ɺ

“expressway 579” ͳͲ)ɻOR ͱ Tra ͷจͷΈ͕ “interstate579” ͱ͍͏ϑϨʔζΛ‫ؚ‬ΜͰ͓ΓɺͲͪΒ΋ਖ਼ղ͞Ε͍ͯ
Δɻग़ྗ͞Εͨ࿦ཧࣜΛ‫ݟ‬ൺ΂Δͱɺෆਖ਼ղͰ࣭͋ͬͨ໰จ
Ͱ͸ “interstate 579” ͷΤϯςΟςΟ͕‫·ؚ‬Ε͓ͯΒͣɺผͷΤϯςΟςΟʹ‫ޡ‬ม‫͞׵‬Ε͍ͯͨɻྫ͑͹ɺHT ʹ‫·ؚ‬Ε*5ͲͪΒͷάϧʔϓʹ͓͍ͯ΋࣭໰ͷ෼෍͸ࣅ௨͓ͬͯΓɺ༁࣭ධՁई౓Ͱ͸͜ͷ໰୊Λղܾ͢Δ͜ͱ͸೉͍͠ͱ‫͑ݴ‬Δɻ4

Vol.2015-NL-223 No.12
2015/9/28

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Report>hнϭ>hнϭ$&ZϸсϬ͘ϴϵϵϵ$#&#"&"&"!*!)!(!'!&!%!$!#!"$&"$*$)
$(
$'$!
$&$%
$#$"

$"!*!)!(!'!&!%!$!#!"$"!*!)!(!'!&!%!$!#!"")"'"%"#")'%#"!*!)!(!'!&!%!$!#!"$&#&#"&"ZϸсϬ͘ϬϬϲϱ

&

ϭͲtZ

ϭͲtZ

#!
#ZϸсϬ͘ϲϴϵϰ

"!
"!

#!
#"!

ZϸсϬ͘ϬϵϮϮ

"!

Z/^
#&ZϸсϬ͘ϰϭϴϭ"&"&#"&"ZϸсϬ͘ϯϭϭϮ&E/^dZϸсϬ͘ϵϰϭϱĐĐĞƉƚĂďŝůŝƚǇ$ZϸсϬ͘ϴϴϵϳ#"&"&ਤ 4#$"!*!)!(!'!&!%!$!#!"

ZϸсϬ͘ϮϬϵϳĐĐĞƉƚĂďŝůŝƚǇ
$&""!*!)!(!'!&!%!$!#!"#&E/^d")"'"%"#")'%##&"%*%)%(%'%!
%&%$%#%"

Z/^$#"!*!)!(!'!&!%!$!#!"$%#&#"&ZϸсϬ͘ϱϰϲϴ"&&ධՁई౓஋ͱ࣭໰Ԡ౴ਫ਼౓ͷ૬ؔ (ਖ਼ղάϧʔϓ)"ਤ 5#$%&ධՁई౓஋ͱ࣭໰Ԡ౴ਫ਼౓ͷ૬ؔ (ෆਖ਼ղάϧʔϓ)ԣ࣠ɿධՁ஋ͷൣғԣ࣠ɿධՁ஋ͷൣғ๮άϥϑ (ࠨॎ࣠)ɿ࣭໰਺ͷׂ߹ (%)๮άϥϑ (ࠨॎ࣠)ɿ࣭໰਺ͷׂ߹ (%)ંΕઢ (ӈॎ࣠)ɿ࣭໰Ԡ౴ਫ਼౓ (ൣғ಺ฏ‫)ۉ‬ંΕઢ (ӈॎ࣠)ɿ࣭໰Ԡ౴ਫ਼౓ (ൣғ಺ฏ‫)ۉ‬c 2015 Information Processing Society of Japan"!*!)!(!'!&!%!$!#!"$5

Vol.2015-NL-223 No.12
2015/9/28

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Report

Δ “interstate highway 579” ͱ͍͏ϑϨʔζ͸ “interstateද 4จ๏‫ޡ‬Γͷྫhighway” ͱ͍͏ԻָΞϧόϜͷΤϯςΟςΟʹม‫͞׵‬Ε

◦ OR what library system is the sunset branch library in͍ͯͨɻ2 ͭ໨ͷྫ΋ಉ༷ʹɺ“librettist” ͱ͍͏಺༰‫͕ޠ‬- JA αϯηοτɾϒϥϯνਤॻ‫ؗ‬͸Ͳͷਤॻ‫ؗ‬γεςϜʹॴଐ͠·͔͢຋༁ʹΑ༷ͬͯʑʹมԽ͠ɺෆਖ਼ղͱͳ͍ͬͯΔɻ͜͜Ͱɺ◦ HT to what library system does sunset branch library belong৽ͨʹ “who librettist magic flute” ͱ͍͏࣭໰จΛ࡞੒࣭͠໰Ԡ౴Λߦͬͨͱ͜Ζɺਖ਼ղ͢Δ͜ͱ͕Ͱ͖ͨɻ͜ͷΑ͏ͳྫ͸ɺ಺༰‫͕ޠ‬มԽ͢Δ͜ͱͰΞϥΠϝϯτ͕ࣦഊ͠ɺ‫ͨͬޡ‬ΤϯςΟςΟ͕ੜ੒͞ΕΔ͜ͱ͕ඇৗʹॏཁͳ໰୊Ͱ͋Δ͜ͱΛ͍ࣔͯ͠Δɻ͜ͷ໰୊͸ɺ຋༁ͷաఔͰ‫ݻ‬༗ද‫ޠݱ‬ኮΛૉੑͱͯ͠૊ΈࠐΈɺߟྀ͢Δ͜ͱ
ͰվળͰ͖ΔՄೳੑ͕͋Δɻ
ද 3࣭໰λΠϓΛද͢‫ޠ‬ͷ‫ޡ‬༁ͷྫ◦ GT sunset branch library do you belong to any library system◦ YT which library system does the sunset branch library belong to◦ Mo sunset branch library, which belongs to the library system◦ Tra sunset branch library, belongs to the library system?
× OR what teams did babe ruth play for- JA ϕΠϒɾϧʔε͸ͲͷνʔϜͷબखͰ͔ͨ͠
× HT what team did babe ruth play for◦ GT did the players of any team babe ruth

◦ OR how many religions use the bible◦ YT was babe ruth a player of which team- JA ੟ॻΛ࢖͏फ‫ڭ‬͸͍ͭ͋͘Γ·͔͢◦ Mo how did babe ruth team× HT how many religions use sacred scriptures◦ Tra babe ruth was a team player◦ GT how many religions that use the bible◦ YT how many religion to use the bible are thereΔɻ͜ΕΒͷྫ͸ɺগͳ͘ͱ΋ Free917 ʹ‫·ؚ‬ΕΔΑ͏ͳ◦ Mo how many pieces of religion, but used the bible୯७ͳ࣭໰ʹ͓͍ͯ͸ɺ‫ॱޠ‬Λਖ਼͘͠ଊ͑Δ͜ͱ͸࣭໰Ԡ× Tra use the bible religions do you have౴ਫ਼౓ͷ޲্ͷ‫͔఺؍‬Β͸ඞͣ͠΋ॏཁͰͳ͍͜ͱΛࣔ͠
͍ͯΔɻ

◦ OR how many tv programs did danny devito produce- JA μχʔɾσϰΟʔτ͸Կ݅ͷςϨϏ൪૊Λϓϩσϡʔε͠·͔ͨ͠◦ HT how many television programs has danny devito produced

6. ݁࿦஌ࣝϕʔεΛ༻͍࣭ͨ໰Ԡ౴ʹ͓͚Δ຋༁ͷӨ‫ڹ‬Λௐࠪ

× GT danny devito or has produced what review television program͢ΔͨΊɺෳ਺ͷ຋༁ख๏Λ༻͍࣭ͯ໰σʔληοτΛ× YT did danni devito produce several tv programs࡞੒͠ɺ࣭໰Ԡ౴ਫ਼౓ͷൺֱΛߦͬͨɻ݁Ռͱͯ͠ɺࢀর

× Mo what kind of tv programs are produced by danny devito༁͕ਖ਼ղͰ͖ͨ৔߹ʹ‫ݶ‬Δ΋ͷͷɺ಺༰‫ޠ‬ͷมԽʹහ‫ײ‬× Tra danny devito has produced many tv programs

ͳ NIST είΞ͕࣭໰Ԡ౴ਫ਼౓ͱߴ͍૬ؔΛ࣋ͭ͜ͱ͕໌Β͔ͱͳͬͨɻ͞Βʹࣄྫ෼ੳʹΑͬͯɺ࣭໰Ԡ౴ͷ݁Ռ࣍ʹɺ࣭໰λΠϓΛද͢‫ޠ‬ͷ‫ޡ‬༁͕‫ݪ‬ҼͱͳΔྫΛද 3ʹӨ‫͏͠ڹ‬Δ຋༁ͷཁҼͰ͋Δ 3 ͭͷཁҼɺ಺༰‫ޠ‬ɺ࣭ʹࣔ͢ɻ1 ͭ໨ͷྫͰ͸ɺTra ͷ࣭໰จ͸ OR ͷ࣭໰จͷ໰λΠϓɺจ๏Λൃ‫ͨ͠ݟ‬ɻ͜ΕΒͷ݁Ռʹ‫͖ͮج‬ɺ‫ޠݴ‬಺༰‫ޠ‬Λશͯ‫ؚ‬ΜͰ͍Δʹ΋͔͔ΘΒͣෆਖ਼ղͱͳ͍ͬͯԣஅ࣭໰Ԡ౴λεΫʹ͓͚Δ‫ػ‬ց຋༁ͷධՁʹ͓͍ͯɺ1)

Δɻಉ͘͡ɺ2 ͭ໨ͷྫͰ͸ɺ“tv (television) programs”ɺ

NIST είΞ͔ɺ΋͘͠͸ผͷɺ಺༰‫ޠ‬ΛॏࢹͰ͖Δ༁࣭

“danny devito”ɺ“produce(d)” ͷ 3 ͭ͸શͯͷ຋༁݁ՌʹධՁई౓Λ༻͍Δ΂͖Ͱ͋Δɻ2) ࢀর༁͸࣭໰Ԡ౴Ͱਖ਼ղ

‫·ؚ‬Ε͍ͯΔ͕ɺHT Ҏ֎͸ਖ਼ղͰ͖ͳ͔ͬͨɻਖ਼ղͰ͖ՄೳͳจষͰߏ੒͢Δ΂͖Ͱ͋Δɻͱ͍͏ 2 ͭͷ͜ͱ͕Θ࣭ͨ໰จͱͦΕҎ֎ͷ࣭໰จΛൺֱ͢Δͱɺ“how many”͔ͬͨɻͱ͍͏࣭໰λΠϓΛද͢‫ޠ‬Λ‫ؚ‬ΜͰ͍Δ͜ͱ͕ඞཁͰ͋Δ͜ͷ݁Ռ͸ SEMPRE ͱ͍͏࣭໰Ԡ౴ϑϨʔϜϫʔΫʹ͜ͱ͕Θ͔ͬͨɻ͜ΕΒͷྫ͸ɺ࣭໰λΠϓΛਖ਼֬ʹଊ͑ɺ‫͍݁ͨͮج‬ՌͰ͋ΓɺSEMPRE ͸௨ৗͷ࣭໰Ԡ౴λεΫ຋༁͢Δ͜ͱͷॏཁੑΛ͍ࣔࠦͯ͠Δɻ͜͜Ͱɺ࣭໰λΠͰߴ͍ੑೳΛ͍ࣔͯ͠Δ͕ɺࠓ‫ޙ‬ผͷ࣭໰Ԡ౴γεςϜͰϓΛද͢‫ޠ‬͸಺༰‫ͱޠ‬ҟͳΓසग़͢ΔͨΊɺNIST είΞ΋ௐࠪΛߦ͏༧ఆͰ͋Δɻྫ͑͹ɺ‫͑׵͍ݴ‬Λߟྀ࣭ͨ͠ʹΑͬͯվળ͢Δ͜ͱ͸೉͘͠ɺ࣭໰Ԡ౴‫ݻ‬༗ͷࢦඪ͕ඞ໰Ԡ౴ϑϨʔϜϫʔΫ [15] Λ༻͍ͨ৔߹ɺද૚తͳ຋༁ͷཁͰ͋Δͱߟ͑ΒΕΔɻࠩҟʹ‫݁ͳ݈ؤ‬Ռ͕ಘΒΕΔͱߟ͑ΒΕΔɻ·ͨɺ͜ͷ෼จ๏ʹؔ࿈͢ΔྫΛද 4 ʹࣔ͢ɻ1 ͭ໨ͷྫͰ͸ɺYTੳ݁ՌΛϨεϙϯεϕʔεֶशͷ࿮૊Έͱ૊Έ߹Θͤͯ‫ػ‬Ҏ֎ͷ‫ػ‬ց຋༁ͷ݁Ռ͸จ๏͕੔͍ͬͯͳ͍ʹ΋ؔΘΒց຋༁ͷ࠷దԽΛߦ͏͜ͱ΋‫ݕ‬౼͍ͯ͠Δɻͣશͯਖ਼ղ͍ͯ͠ΔɻҰํ 2 ͭ໨ͷྫͰ͸ɺOR ͱ HT Ͱँࣙ͸จ๏͕ਖ਼͍͠ʹ΋ؔΘΒͣෆਖ਼ղͱͳ͍ͬͯΔɻOR ͱHT ͷ࣭໰Ԡ౴ͷ݁ՌΛௐ΂Δͱɺϕʔϒϧʔεͷଧܸ੒ຊ‫ڀݚ‬ͷҰ෦͸ɺNAIST ϏοάσʔλϓϩδΣΫτ͓੷Λग़ྗ͍ͯͨ͠ɻ͜Ε͸ɺ“babe ruth” ͱ “play” ͕ྡ઀ΑͼϚΠΫϩιϑτϦαʔν CORE ࿈‫ڀݚܞ‬ϓϩάϥϜ͓ͯ͠ΓɺϒϦοδϯάͷࡍʹ݁ͼ͍ͭͨͨΊͱߟ͑ΒΕͷ‫׆‬ಈͱͯ͠ߦͬͨ΋ͷͰ͢ɻc 2015 Information Processing Society of Japan6৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Report

Vol.2015-NL-223 No.12
2015/9/28

ࢀߟจ‫ݙ‬
[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]
[9]

[10]

[11]

[12]

[13]

[14]

[15]

Hyodo, T. and Akiba, T.: Improving Translation Modelfor SMT-based Cross Language Question Answering,
Proc. of FIT, Vol. 8, No. 2, pp. 289–292 (2009).
Riezler, S., Simianer, P. and Haas, C.: Response-basedlearning for grounded machine translation, Proc. of ACL(2014).
Haas, C. and Riezler, S.: Response-based Learning for
Machine Translation of Open-domain Database Queries,
Proc. of NAACL HLT, pp. 1339–1344 (2015).
Cai, Q. and Yates, A.: Large-scale Semantic Parsing
via Schema Matching and Lexicon Extension., Proc. ofACL, pp. 423–433 (2013).
Berant, J., Chou, A., Frostig, R. and Liang, P.: Semantic
Parsing on Freebase from Question-Answer Pairs., Proc.
of EMNLP, pp. 1533–1544 (2013).
Koehn, P., Hoang, H., Birch, A., Callison-Burch, C.,
Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran,C., Zens, R. et al.: Moses: Open source toolkit for statistical machine translation, Proc. of ACL, pp. 177–180(2007).
Neubig, G.: Travatar: A Forest-to-String MachineTranslation Engine based on Tree Transducers., Proc.
of ACL, pp. 91–96 (2013).
Callan, J., Hoy, M., Yoo, C. and Zhao, L.: Clueweb09
data set (2009).
Lin, C.-Y. and Och, F. J.: ORANGE: A Method for
Evaluating Automatic Evaluation Metrics for MachineTranslation, Proc. of COLING, pp. 501–507 (2004).
Leusch, G., Ueffing, N. and Ney, H.: A novel stringto-string distance measure with applications to machinetranslation evaluation, Proc. of MT Summit IX, pp.
240–247 (2003).
Doddington, G.: Automatic evaluation of machine translation quality using n-gram co-occurrence statistics,
Proc. of HLT, pp. 138–145 (2002).
Isozaki, H., Hirao, T., Duh, K., Sudoh, K. and Tsukada,
H.: Automatic evaluation of translation quality for distant language pairs, Proc. of EMNLP, pp. 944–952(2010).
Goto, I., Chow, K. P., Lu, B., Sumita, E. and Tsou,
B. K.: Overview of the patent machine translation taskat the NTCIR-10 workshop, Proc. of NTCIR-10, pp.
260–286 (2013).
Papineni, K., Roukos, S., Ward, T. and Zhu, W.-J.:
BLEU: a method for automatic evaluation of machinetranslation, Proc. of ACL, pp. 311–318 (2002).
Berant, J. and Liang, P.: Semantic parsing via paraphrasing, Proc. of ACL, Vol. 7, No. 1, pp. 1415–1425(2014).

c 2015 Information Processing Society of Japan7