FIT2014（第 13 回情報科学技術フォーラム）E-020
ӳ೔‫ػ‬ց຋༁ͷͨΊͷओࣙ‫ޙ‬ஔࣄલฒͼସ͑ʹ͓͚Δ‫ࢺྔݶ‬Ҡಈͷվળ
An Improvement in Quantiﬁers Movement of Head Finalization Reordering for E-J Machine Translation୩‫ ޱ‬ਖ਼‫* ܇‬1ஸ ਖୢ *1ࢁຊ ‫װ‬༤ *2

Masanori TANIGUCHI

Chenchen DING

Mikio YAMAMOTO

1. ͸͡Ίʹ
‫ݱ‬ঢ়ͷ౷‫ܭ‬త‫ػ‬ց຋༁ख๏͸ɺϑϨʔζͷ຋༁ͳͲͷ‫ॴہ‬తͳ຋༁͸ߴੑೳͰ͋Δ͕ɺ‫ޠ‬ͷҠಈͳͲେ‫ہ‬తͳௐ੔ʹ·ͩվྑͷ༨஍͕͋Δɻྫ͑͹ɺӳ෹຋༁ͳͲ‫ޠ‬଒తʹ͍ۙ‫ؒޠݴ‬ͷ຋༁ʹൺ΂ͯɺӳ೔຋༁ͳͲͷ‫ޠ‬ͷҠಈ͕େ͖͍‫ؒޠݴ‬ͷ຋༁ੑೳ͸௿͍ɻ͜ΕΛվળ͢ΔͨΊɺ‫ޠݴݪ‬Λ༧Ί໨త‫ͱޠݴ‬ಉ͡‫ͳͱॱޠ‬ΔΑ͏ʹฒͼସ͑Λߦͬͨ͋ͱ౷‫ܭ‬త‫ػ‬ց຋༁Λߦ͏ͱ͍͏ࣄલฒͼସ͑ख๏͕‫͞ڀݚ‬Ε͍ͯΔɻຊ࿦จͰ͸ɺࣄલฒͼସ͑ख๏ͷ͏ͪɺӳ೔޲͚Ͱγϯϓϧ͔ͭߴੑೳͳ HeadFinalization[2] ʹ஫໨͠ɺ͜ͷख๏Ͱࣦഊ͠΍͍͢‫ྔݶ‬ࢺͷฒͼସ͑Λվળ͢Δख๏Λ‫ݕ‬౼͢Δɻ຋༁࣮‫ݧ‬Λߦͬͨͱ͜ΖɺBLEU ͸ 0.32% ্ঢ͠ɺ༗ҙਫ४ 5% Ͱ༗ҙ͕ࠩೝΊΒΕͨɻɹɹɹɹɹɹਤ1ओࣙ‫ޙ‬ஔૢ࡞ͷྫɹɹɹɹɹɹɹ

2. ઌߦ‫ڀݚ‬
2.1.Head Finalizationɹ ɹɹɹɹHead Finalization[2] ͸೔ຊ‫ޠ‬ͷओࣙ‫ޙ‬ஔੑΛར༻ͯ͠ӳจΛ೔ຊ‫ͱޠ‬ಉ༷ͷ‫ʹॱޠ‬ฒͼସ͑Δख๏Ͱ͋Δɻ۩ମతʹ͸ɺओࣙ‫ۦ‬ಈ۟ߏ଄จ๏ʹΑΔߏจղੳͰಘΒΕͨ৘ใΛ‫ߏʹݩ‬จ໦Λ࡞੒͠ɺશͯͷϊʔυʹର͠ӳ‫ޠ‬ͷओࣙ (head) ͱͳΔϊʔυΛ‫ޙ‬ΖҠಈ͢Δͱ͍͏ૢ࡞Λߦ͏͜ͱʹΑΓฒͼସ͑Λ࣮‫͢ݱ‬Δɻߏจղੳ݁Ռ͔Β࡞੒ͨ͠ߏจ໦ͷྫΛਤ 1(ࠨ) ʹࣔ͢ɻഁઢͷํ޲ʹଘࡏ͢Δϊʔυ͕ओࣙϊʔυͱͳΔɻ্͔Β 2 ஈ໨VP ϊʔυͷࢠϊʔυͷΑ͏ʹओ͕ࣙલํʹҐஔ͢Δ৔߹͸ओࣙϊʔυΛ‫ޙ‬ΖʹҠಈ͢Δɻ͜ͷΑ͏ͳॲཧΛશϊʔυʹରͯ͠ߦ͏͜ͱʹΑΓɺਤ 1(ӈ) ͷΑ͏ʹӳจΛओࣙ‫ޙ‬ஔ‫͋Ͱޠݴ‬Δ೔ຊ‫ͱޠ‬ಉ༷ͷ‫ʹॱޠ‬ฒͼସ͑Δ͜ͱ͕Ͱ͖Δɻ͜ͷฒͼସ͑ʹ֨ॿࢺ૬౰‫ ( ޠ‬va1ɺva2) ͷ௥ՃͳͲͷࡉ͔͍ϧʔϧΛՃ͑ͯ͞Βʹ೔ຊ‫ޠ‬ͷ‫͚ͮۙʹॱޠ‬Δૢ࡞Λߦ͏ɻ

2.2.Head Finalization ͷ໰୊఺ӳ೔Ͱߏ଄తʹҟͳΔද‫ͳͱݱ‬Δ‫͕ޠ‬ଘࡏ͢ΔɻͦͷΑ͏ͳ‫ޠ‬͸ྫ͑͹‫ࢺྔݶ‬ͷҰ෦ʹ‫ݟ‬ΒΕɺ“no”ɺ“little”ɺ“low” ౳͕͜Εʹ֘౰͢Δɻߏ଄͕มԽ͢Ε͹ओࣙ΋มԽ͢ΔͨΊɺϊʔυؒͷओࣙؔ܎Λ༻͍ͯฒͼସ͑Λߦ͏ Head Finalization Ͱ͸͜ΕʹରԠͰ͖ͳ͍ɻ
ਤ 2(ࠨ) ͷ৔߹ɺ“no” ͷ෦෼͕೔ຊ‫ޠ‬ͷ൱ఆจͷߏ଄ͱҟͳΔͨΊɺฒͼସ͑Λߦͬͯ΋೔ຊ‫ޠ‬ͷద੾ͳ৔ॴ΁͸Ґஔ͠ͳ͍ɻฒͼସ͑‫ޙ‬ͷਤ 2(ӈ) Λ‫ݟ‬Δͱɺ೔ຊ‫ޠ‬ͷ “‫ܗ‬੒͠ͳ͍” ʹରԠ͢Δ “no” ͱ “forms” ͕େ͖͘཭Ε͍ͯΔ͜ͱ͕෼͔ΔɻͦͷͨΊɺ“no” ͱ “forms”͕ಉ͡ϑϨʔζͱͯ͠ѻΘΕͣɺ“no” ͷ຋༁͞ΕΔ৔ॴ͕ෆద੾ʹͳΔ৔߹΍ɺ‫ޠݴ‬ϞσϧʹΑΓ೔ຊ‫͠ͱޠ‬ਤ2“no” Λ‫ؚ‬Ήจͷओࣙ‫ޙ‬ஔྫɹɹ ɹɹɹɹͯෆࣗવͳҐஔͷ൱ఆࢺ͕࡟আ͞ΕΔ܏޲͕͋Δɻ
ਤ 2 ͷྫͰ͸ର৅୯‫ޠ‬͸೔ຊ‫͚͓ʹޠ‬Δ઀ඌ‫ʹޠ‬ରԠ͍ͯ͠Δ͕ɺ༻๏ʹΑͬͯ͸઀಄‫ʹޠ‬ରԠ͢Δ৔߹΋͋
Δɻ“a no load induced voltage is ʙ”(ແෛՙ༠‫ిى‬ѹ͕ʙ) Λྫͱͯࣔ͢͠ɻ‫ࢺྔݶ‬͸ߠఆจΛ൱ఆจʹม͑ΔͳͲจͷҙຯΛେ͖͘มߋ͠ɺ຋༁͞ΕΔ৔ॴʹΑͬͯ΋จͷҙຯ͕େ෯ʹมԽ͢Δɻ͕ͨͬͯ͠ɺର৅୯‫͕ޠ‬೔ຊ‫͚͓ʹޠ‬Δ઀಄‫઀ͱޠ‬ඌ‫ޠ‬ͷͲͪΒʹରԠ͢Δͷ͔ͷ෼ྨΛߦͬͨ‫ޙ‬ɺద੾ͳҐஔ΁Ҡಈͤ͞Δඞཁ͕͋Δɻ

3. ఏҊख๏ຊߘͰ͸ɺӳ೔Ͱߏ଄͕ҟͳΔද‫ͳͱݱ‬ΔՄೳੑͷ͋Δ‫ࢺྔݶ‬ͷҰ෦Λ೔ຊ‫ޠ‬ͷద੾ͳҐஔʹҠಈ͢Δํ๏ΛఏҊ͢Δɻର৅୯‫ޠ‬ͷ೔ຊ‫͚͓ʹޠ‬Δద੾ͳҐஔΛɺӳ‫ޠ‬ͷߏ଄ͱಉ༷ͷ৔ॴ͔ɺର৅୯‫͕ޠ‬೔ຊ‫ͭ͘ͼ͍͓݁ͯʹޠ‬Մೳੑͷ͋Δಈࢺͷ‫ޙ‬ͷ 2 ΧॴͱԾఆ͠ɺSVM ʹΑΔҠಈ൑ఆΛߦ͏ɻSVM ͷૉੑʹ͸ɺର৅୯‫ޠ‬ɺର৅୯‫ޠ‬ͷओࣙͱͳΔ‫ ޠ‬we ɺର৅୯‫·ؚ͕ޠ‬ΕΔઅͷಈࢺ wj ɺͷ֤ϊʔυͷཁૉΛ༻͍Δɻ֤ϊʔυͷཁૉʹ͸ߏจղੳͰಘΒΕͨ඼ࢺ౳ͷ৘ใΛ༻͍ΔɻྫΛਤ 3 ʹࣔ͢ɻwe ͸ର৅୯‫ޠ‬ͷ਌ϊʔυ͔ΒओࣙΛͨͲΓ౸ୡͨ͠‫ޠ‬ͱͳΓɺwj ͸ର৅୯‫ޠ‬Λҙຯͷ্Ͱแ‫ؚ͢‬Δಈࢺ۟ϊʔυ͔ΒओࣙΛͨͲΓ౸ୡͨ͠‫ͳͱޠ‬Δɻ͜ͷ৔߹ɺର৅
୯‫ޠ‬͸ “no”ɺwe ͸ “line”ɺwj ͸ “forms” ͱͳΔɻର৅

*1 ஜ೾େֶେֶӃγεςϜ৘ใ޻ֶ‫ڀݚ‬Պ {m.taniguchi,tei}@mibel.cs.tsukuba.ac.jp*2 ஜ೾େֶେֶӃγεςϜ৘ใ޻ֶ‫ ܥ‬myama@cs.tsukuba.ac.jp251
第 2 分冊Copyright © 2014 by
The Institute of Electronics, Information and Communication Engineers andInformation Processing Society of Japan All rights reserved.

FIT2014（第 13 回情報科学技術フォーラム）ද1SVM ͷ‫ࢣڭ‬σʔλ਺ର৅୯‫ޠ‬‫ࢣڭ‬σʔλ਺

no255

little151

less204ද 2 ຋༁݁Ռͷ BLEU[୯Ґ:%](ଠࣈ͸֤ख๏ͷ࠷ߴ஋Λࣔ͠ɺ*͸ϒʔτετϥοϓɾϦαϯϓϦϯά๏ʹΑΓ Head Finalization ͷ࠷ߴ஋ (35.14) ͱ༗ҙਫ४
5% Ͱ༗ҙ͕ࠩ͋ͬͨ΋ͷΛࣔ͢)ɹɹɹɹɹdl =Head Finalization
Proposedɹɹਤ 3 SVM Ͱ༻͍Δૉੑϊʔυͷྫ (ର৅୯‫ޠ‬Λแ‫ؚ‬͢Δ࠷ۙͷಈࢺ͔۟ΒओࣙΛͨͲͬͨઌ͕ૉੑϊʔυ1ɺର৅୯‫ޠ‬ͷ਌ϊʔυ͔ΒओࣙΛͨͲͬͨઌ͕ૉੑϊʔυ 2ɺର৅୯‫ޠ‬ͷϊʔυ͕ૉੑϊʔυ 3 ͱͳΔ)

3
34.37
34.12

6
35.04
35.27

912
35.14
35.06
35.45* 35.46*

ද 3 ਤ 2 ͷ຋༁݁Ռ[HFE]
Head Finalizationɹɹ୯‫͕ޠ‬અ಺ʹଘࡏ͠ͳ͍৔߹ wj ͸ଘࡏ͠ͳ͍͕ɺ௚ۙ
ͷಈࢺ۟ͷओࣙͱͳΔ‫ޠ‬ɺಈࢺ͕۟ଘࡏ͠ͳ͚Ε͹ϧʔτϊʔυͷओࣙͱͳΔ‫ޠ‬Λ wj ͱ͓͖Ҡಈ൑ఆʹΑΓରॲΛߦ͏ɻର৅୯‫ޠ‬ͷϦετ͸ਓखͰ࡞੒͢Δɻ4. ධՁ
4.1. ࣮‫ݧ‬৚݅
Head Finalization ʹΑͬͯฒͼସ͑ΒΕͨจͱฒͼସ͑‫ࢺྔݶʹޙ‬ͷҠಈΛߦͬͨจͰ຋༁࣮‫ݧ‬Λ͠ൺֱΛߦ͏ɻ౷‫ܭ‬త‫ػ‬ց຋༁ͷσίʔμʹ Moses*3 ɺ୯‫ޠ‬ΞϥΠϝϯτʹ GIZA++*4 ɺ೔ຊ‫ܗޠ‬ଶૉղੳʹ Mecab*5 ɺߏจղੳʹ Enju*6 ɺҠಈ൑ఆʹ LIBLINEAR*7 Λ༻͍ͨɻίʔύε͸ NTCIR7 ͷಛ‫ڐ‬ίʔύε [1] Λ༻͍ɺ‫ݴ‬‫ޠ‬Ϟσϧ࡞੒ʹτϨʔχϯάίʔύεͷ໿ 180 ສจɺτϨʔχϯάʹɺτϨʔχϯάίʔύεͷ 1 จ 40 ୯‫ޠ‬Ҏ্ͷ΋ͷΛΧοτͨ͠໿ 110 ສจɺνϡʔχϯά (MERT)ʹνϡʔχϯάίʔύεͷ 915 จɺςετʹςετίʔύεͷ 1381 จΛ༻͍ͨɻ࣮‫ʹݧ‬͸ɺMoses ͷϑϨʔζϕʔε຋༁γεςϜΛ༻͍ɺ‫ޠݴ‬Ϟσϧʹ͸ Interpolated Kneser-Ney 5-gramΛ༻͍ͨɻ຋༁Ϟσϧʹ͸ɺgrow-diag-ﬁnal-and Λ༻͍ɺઃఆ͸ɺmax-phrase-length=7ɺttable-limit=20ɺ
stack=100 ͱͨ͠ɻSVM ͷૉੑʹ༻͍Δ֤ϊʔυͷཁૉ͸ɺEnju ʹΑΔߏจղੳͰಘΒΕͨཁૉͱ͠ɺϊʔυͷ࣋ͭ‫ͦޠ‬ͷ΋ͷͱɺͦͷ‫ޠ‬ͷ‫͋Ͱܗݪ‬Δ “base”ɺ඼ࢺ౳Λද͢ “cat”ɺ
“xcat”ɺ“pos”ɺ“pred”ɺ“type”ɺ“lexentry” Λ༻͍ͨɻର৅୯‫ޠ‬͸ӳ೔Ͱߏ଄͕ҟͳΔද‫ͳͱݱ‬ΔՄೳੑͷ͋Δ‫ޠ‬ͷ͏ͪɺग़‫਺ݱ‬ͷଟ͍ “no”ɺ“little”ɺ“less”ɺ
“never” ͷ 4 ‫ޠ‬Λબ୒ͨ͠ɻର৅୯‫ͱޠ‬τϨʔχϯάίʔύε͔Β࡞੒ͨ͠‫ࢣڭ‬σʔλͷσʔλ਺Λද 1 ʹࣔ͢ɻ‫ࢣڭ‬σʔλʹ͓͍ͯɺର৅୯‫“ ͕ޠ‬never” ͷ৔߹ɺ΄΅શͯͷจͰ೔ຊ‫͚͓ʹޠ‬Δ઀ඌ‫ʹޠ‬ରԠ͍ͯͨͨ͠ΊҠಈ൑ఆΛߦΘͣશͯҠಈ͢Δͱ͍͏ϧʔϧΛՃ͑ͨɻ൪߸Λද͢ “no .” ʹ͍ͭͯ͸೔ຊ‫͚͓ʹޠ‬Δಈࢺ

Proposed[HFE]
Proposed

this conﬁguration va1 nodis::formscrete output line va2 :::::͜ͷ ߏ੒ ͸ ɺ ཭ࢄ త ͳ ग़ྗ ઢ
Λ ::::‫ܗ‬੒ ::::
͢Δ

this conﬁguration va1 discrete
nooutput line va2 forms:::::::͜ͷ ߏ੒ ͸ ɺ ཭ࢄ త ͳ ग़ྗ ઢ
Λ ::::‫ܗ‬੒ ::
͠ ::::
ͳ͍ද 4 ର৅୯‫͕ޠ‬൓ө͞Ε͔ͨ൱͔ͷ໨ࢹௐࠪ݁Ռฒͼସ͑ํ๏੒ޭ‫਺ޠ‬ࣦഊ‫਺ޠ‬

Head Finalization
Proposed

1119135ͱ݁ͼ͔ͭͳ͍ͨΊҠಈ൑ఆΛߦΘͣશͯҠಈ͠ͳ͍ͱ͍͏ϧʔϧΛՃ͑ͨɻ

4.2. ࣮‫݁ݧ‬Ռ
distortion limit(dl) Λ ม ߋ ͠ ͯ ς ε τ ί ʔ ύ ε ͷ1381 จʹର͠ BLEU Λଌఆͨ͠ɻͦͷ݁ՌΛද 2 ʹɺ຋༁ྫΛද 3 ʹࣔ͢ɻද 3 ͷ HFE ͸ Head FinalizedEnglish ͷུͰ͋Γฒͼସ͑‫ޙ‬ͷӳจΛࢦ͢ɻ·ͨɺςετίʔύεதͷର৅୯‫·ؚ͕ޠ‬ΕΔจʹରͯ͠ɺ࠷΋ߴ͍ BLEU ͱͳΔ dl ͷ৔߹ʹର৅୯‫͕ޠ‬຋༁݁Ռʹ൓ө͞Ε͍ͯΔ͔ͷௐࠪΛ໨ࢹͰߦͬͨ݁ՌΛද 4 ʹࣔ͢ɻද 4 ͷ੒ޭ‫ޠ‬͸ɺର৅୯‫͕ޠ‬຋༁݁Ռʹ൓ө͞Εͨ‫ͨ͠ͱޠ‬ɻ

5. ͓ΘΓʹ
ද 2ɺද 4 ͷ݁Ռ͔ΒɺมߋՕॴ͕গͳׂ͍ʹ຋༁ਫ਼౓͕޲্͍ͯ͠Δ͜ͱ͕෼͔Δɻ‫ݱ‬ঢ়ͷ՝୊ͱͯ͠ɺର
৅୯‫ޠ‬ͷϦετͱͦͷ‫ࢣڭ‬σʔλΛ໨ࢹͰͷ൑அʹΑΓ࡞੒͍ͯ͠Δ఺͕͋͛ΒΕΔɻࠓ‫ޙ‬ɺ୯‫ޠ‬ͷΞϥΠϝϯτ৘ใΛ༻͍ͯ͜ΕΒͷࣗಈԽΛߦ͏༧ఆͰ͋Δɻࢀߟจ‫ݙ‬[1] Fujii, A., Utiyama, M., Yamamoto, M., and Utsuro,T. (2008), Overview of the Patent Translation Task at
the NTCIR-7 Workshop, In Proceedings of the 7th NTCIR Workshop Meeting on Evaluation of Information
Access Technologie, 389-400.
[2] Isozaki, H., Sudoh, K., Tsukada, H., Duh, K. (2012)
HPSG-Based Preprocessing for English-to-JapaneseTranslation, ACM Transactions on Asian Language
Processing, 11(3):8:1–8:16.

*3 http://www.statmt.org/moses/*4 http://www.statmt.org/moses/giza/GIZA++.html*5 http://mecab.googlecode.com/svn/trunk/mecab/doc/index.html*6 http://www.nactem.ac.uk/enju/index.ja.html*7 http://www.csie.ntu.edu.tw/~cjlin/liblinear/252
第 2 分冊Copyright © 2014 by
The Institute of Electronics, Information and Communication Engineers andInformation Processing Society of Japan All rights reserved.