Vol.2015-SLP-109 No.13
2015/12/2৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Reportର࿩ঢ়ଶਪఆͷͨΊͷ֎෦஌ࣝϕʔεΛར༻ͨ͠ҙຯతૉੑͷఏҊੴ઒ ༿ࢠ1ฏԬ ୓໵1

ਫ্ խത1٢໺ ޾Ұ࿠1

Graham Neubig1

தଜ ఩1֓ཁɿର࿩Λ௨ͯ͠࿩ऀͷҙਤΛਪఆ͢Δ͜ͱΛର࿩ঢ়ଶਪఆͱ‫ͼݺ‬ɼର࿩γεςϜʹͱͬͯඇৗʹॏཁͳ՝୊ͷͻͱͭͰ͋Δɽਓಉ࢜ͷର࿩ʹ͓͍ͯର࿩ঢ়ଶਪఆΛߦ͍ɼͦͷਪఆਫ਼౓Λൺֱ͢Δ Shared Task
ͱͯ͠ Dialog State Tracking Challenge 4 (DSTC4) ͕͋Δɽຊ‫Ͱڀݚ‬͸ɼDSTC4 ʹ͓͍ͯ Long-ShortTerm Memory (LSTM) Λ༻͍ͨਪఆ‫ث‬Λߏஙͨ͠ɽ·ͨɼൃ࿩จͷද૚͔ΒಘΔ͜ͱ͕೉͍͠୯‫ޠ‬ͷҙຯత৘ใΛߟྀ͢ΔͨΊɼେ‫ن‬໛ؔ܎σʔλϕʔεͰ͋Δ Wikidata Λ༻͍֦ͯுΛߦͬͨɽWikidata ʹ͸ɼ୯‫ޠ‬ͷಉٛ‫ޠ‬΍આ໌จɼ୯‫ؒޠ‬ͷؔ܎ͳͲͷ৘ใ͕‫·ؚ‬Ε͍ͯΔɽ͜ΕΒͷ৘ใΛ༻͍ͨ݁Ռɼର࿩ঢ়ଶͷਪఆਫ਼౓͕޲্ͨ͠ɽ1. ͸͡Ίʹ͍ͨର࿩ঢ়ଶਪఆ‫ث‬ͷߏஙͰ͸ɼର࿩தͷൃ࿩จͷ෼ࢄද‫ݱ‬Λೖྗͱͯ͠ड͚औΔϕʔεϥΠϯτϥοΧʔΛߏங͢ର࿩γεςϜʹͱͬͯɼର࿩૬खͷҙਤΛཧղ͢Δ͜ͱΔʢ̎અʣɽͦͯ͠ɼൃ࿩தʹ͋Δ୯‫ޠ‬ͷҙຯత৘ใΛද͢͸ඇৗʹॏཁͳ՝୊ͷͻͱͭͰ͋Δɽ૬खͷҙਤ΍໨తૉੑͷ֦ுΛߦ͏ʢ̏અʣɽϢʔβঢ়ଶͷਪఆʹɼ֎෦ʹ͸ɼର࿩͕ਐΉʹͭΕͯঃʑʹมΘΔɽ͜ͷΑ͏ʹɼର࿩͋Δ஌ࣝද‫ݱ‬Λར༻͢Δ͜ͱ͕༗ޮͰ͋Δ͜ͱ͕ࣔ͞ΕͯΛ௨ͯ͠มԽ͢Δ૬खͷҙਤΛਪఆ͢Δ͜ͱΛɼର࿩ঢ়ଶ

͍Δ [1]ɽͦ͜Ͱɼ୯‫ޠ‬ͷҙຯత৘ใΛѻ͏ͨΊɼେ‫ن‬໛ؔਪఆͱ‫Ϳݺ‬ɽର࿩γεςϜ͕ɼஞ࣍ର࿩ঢ়ଶΛਖ਼͘͠ਪఆ

܎σʔλϕʔεͰ͋Δ Wikidata Λ༻͍ͨɽҰൠతʹɼൃ͢Δ͜ͱͰɼର࿩૬खʹ͋Θͤͨద੾ͳߦಈબ୒͕Մೳͱ࿩จͷද૚ͷΈ͔Β֤୯‫ͯ΂͕ͭ࣋͢ޠ‬ͷ֓೦తɾҙຯతͳΔɽಛʹ૬खͷൃ࿩ʹର͠ɼෳ਺ͷฦ౴ީิ͕͋Δ৔߹ɼ৘ใΛѻ͏͜ͱ͸೉͍͠ɽWikidata ͷΑ͏ͳؔ܎σʔλ૬खͷҙਤ΍໨తΛਖ਼͘͠೺Ѳ͍ͯ͠Ε͹ɼର࿩γεςϜϕʔεʹ͸ɼ୯‫ޠ‬ͷಉٛ‫ޠ‬΍આ໌ɼ·ͨ୯‫ؒޠ‬ͷؔ܎ͳͲ͸ΑΓਖ਼͍͠ฦ౴Λߦ͏͜ͱ͕‫ظ‬଴Ͱ͖Δɽͷ৘ใ͕‫ه‬ड़͞Ε͍ͯΔɽͦͷͨΊɼൃ࿩จʹ‫·ؚ‬Ε͍ͯ

Dialog State Tracking Challenge (DSTC) ͱ͸ɼର࿩ʹΔ୯‫ޠ‬ͷΤϯτϦΛࢀর͢Δ͜ͱͰɼ୯‫ޠ‬ͷҙຯత৘ใΛ͓͚Δର࿩ঢ়ଶΛਪఆ͠ɼͦͷਪఆਫ਼౓Λൺֱ͢Δ SharedҾ͖ग़͢͜ͱ͕Ͱ͖Δͱ‫ظ‬଴͞ΕΔɽ֎෦஌ࣝϕʔεͷ֦

Task Ͱ͋ΔɽDSTC3 ·Ͱͷ DSTC Ͱ͸ɼλεΫࢦ޲‫ܕ‬ରுΛߦ͍ɼҙຯత৘ใΛ༻͍ͨ݁Ռɼର࿩ঢ়ଶͷਪఆਫ਼౓࿩γεςϜͱਓؒͷର࿩ϩάʹରͯ͠ɼਓؒͷର࿩ঢ়ଶΛ͕޲্ͨ͜͠ͱΛ࣮‫ʹݧ‬Αͬͯ֬ೝͨ͠ʢ̐અʣɽਪఆ͍ͯͨ͠ɽ͜Εʹର͠ɼࠓճզʑ͕औΓ૊Μͩ DSTC4Ͱ͸ɼਓಉ࢜ͷର࿩ϩάʹରͯ͠ର࿩ঢ়ଶਪఆΛߦ͏ɽ͜

2. LSTM Λ༻͍ͨର࿩ঢ়ଶਪఆ‫ث‬ͷߏஙΕ͸ɼ͜Ε·ͰͷγεςϜʹର͢Δਓؒͷൃ࿩ͱҟͳΓɼա‫ڈ‬ͷ DSTC ʹ͓͍ͯɼRecurrent Neural Networksਓಉ࢜ͷର࿩ʹ͓͚Δൃ࿩Λର৅ͱ͢ΔͨΊɼΑΓ෯޿͍(RNN) ͕ର࿩ঢ়ଶਪఆʹ༗ޮͰ͋Δ͜ͱ͕ࣔ͞Ε͍ͯ‫ݴ‬༿‫͍ݣ‬΍͚ͩͨ͘จ๏Λଟ༻ͨ͠ൃ࿩͕ग़‫͢ݱ‬Δɽͦͷ

Δ [2][3]ɽ͔͠͠ɼRNN ͸௕͍‫ྻܥ‬σʔλΛѻ͏৔߹ɼ‫ܥ‬ͨΊɼର࿩ঢ়ଶਪఆͷͨΊͷϞσϧԽ͕ΑΓࠔ೉ʹͳΓɼྻ͕ਐΉʹͭΕͯӅΕ૚ʹอ࣋͞Ε͍ͯΔ‫͍ݹ‬৘ใ͕‫ݮ‬͜Ε·Ͱͷ DSTC ΑΓ΋೉͍͠λεΫͰ͋Δͱ͍͑Δɽਰ͠ɼ௕‫཭ڑ‬ͷ৘ใ͕อ࣋Ͱ͖ͳ͍ͱ͍͏໰୊͕͋ͬͨɽຊ‫Ͱڀݚ‬͸ɼDSTC4 ʹऔΓ૊Ήʹ͋ͨΓɼ(Long-ShortLSTM ͸ɼ͜ͷ‫ݮ‬ਰͷ໰୊Λܰ‫͢ݮ‬ΔΑ͏ʹӅΕ૚ͷೖTerm Memory) LSTM Λ༻͍ͨର࿩ঢ়ଶਪఆ‫ث‬Λߏங͠ɼྗɼ๨٫ɼग़ྗΛ੍‫ͨ͠ޚ‬΋ͷͰ͋Δ [4]ɽͦͷͨΊɼRNN୯‫ޠ‬ͷҙຯత৘ใΛද͢ૉੑͷ֦ுΛߦͬͨɽLSTM Λ༻ͱൺֱͯ͠ɼ௕͍‫ྻܥ‬σʔλͷঢ়ଶਪఆʹରͯ͠ΑΓޮՌతͰ͋Δ͜ͱ͕‫ظ‬଴͞ΕΔɽ1ಸྑઌ୺Պֶٕज़େֶӃେֶ ৘ใՊֶ‫ڀݚ‬ՊGraduate School of Information Science, Nara Institute ofScience and Technologyⓒ 2015 Information Processing Society of Japan

DSTC4 Ͱ͸ɼ͋Β͔͡Ί༻ҙ͞ΕͨϕʔεϥΠϯͱͳΔਪఆ‫͕͋ث‬Δɽ͜ͷϕʔεϥΠϯͱͳΔਪఆ‫ͱث‬ɼLSTM

1

Vol.2015-SLP-109 No.13
2015/12/2৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical ReportʹΑΔର࿩ঢ়ଶਪఆ‫ث‬Λ͋Θͤɼର࿩ঢ়ଶਪఆ‫ث‬Λߏஙͨ͠ɽ͜ΕΛຊ‫͚͓ʹڀݚ‬ΔϕʔεϥΠϯτϥοΧʔͱ͢ΔɽϕʔεϥΠϯτϥοΧʔͰ͸ɼ୯‫ൃͱޠ‬࿩಺ͷ‫ॱޠ‬Λ༻͍ΔɽҰൠʹର࿩ঢ়ଶਪఆͰ͸ɼਪఆ͢Δ΂͖ঢ়ଶʹରͯ͠‫܇‬࿅σʔλͷྔ͕গͳ͍ͨΊɼ୯ʹ୯‫ޠ‬ϕΫτϧΛ༻͍ΔͱεύʔεʹͳΓ΍͍͢ɽ͜ͷεύʔεੑΛղܾ͢Δͨਤ 1 ҙຯλάΛࢀরͨ͠ૉੑΊɼզʑ͸ doc2vec[5][6] Λ༻͍ͯ୯‫ޠ‬ϕΫτϧΛ 300 ࣍‫ݩ‬ͷϕΫτϧʹѹॖͨ͠ɽ͜ΕʹΑͬͯɼग़ྗ͞ΕΔϕΫτ

ද 1DSTC4 Ͱఆٛ͞Ε͍ͯΔҙຯλάϧ͸ɼ୯‫ͦͱޠ‬ͷ‫ॱޠ‬ͷ৘ใΛ࣋ͭҙຯϕΫτϧͱͳΔɽMAIN

SUBCATEGORY͜ΕΛ LSTM ͷೖྗͱ͠ɼग़ྗΛର࿩ঢ়ଶʢϑϨʔϜͱͦ

AREA

COUNTRY,ͷεϩοτʣͱͨ͠ɽ

3. ֎෦஌ࣝϕʔεΛ༻͍֦ͨு

DET

DISTRICT,ACCESS,BELIEF,BUILDING,EVENT, PRICE, NATURE, HISTORY,ൃ࿩จͷද૚͔ΒಘΔ͜ͱ͕೉͍͠୯‫ޠ‬ͷҙຯత৘ใΛ
ߟྀ͢ΔͨΊɼେ‫ن‬໛ؔ܎σʔλϕʔεͰ͋Δ Wikidata

CITY,NEIGHBORHOOD

MEAL,MONUMENT,STROLL, VIEW
FEEΛ༻͍ΔɽWikidata ͱ͸ɼWikipedia ͷؔ܎σʔλϕʔε

ATTRACTION, SERVICES, PRODUCTSΛఏ‫͢ڙ‬ΔϓϩδΣΫτͰ࡞੒͞Ε͍ͯΔσʔλϕʔεͰFOOD—

͋Δ [7]ɽWikidata ʹ͸ɼͦΕͧΕͷ୯‫ʹޠ‬ରͯ͠ labels

LOC

TEMPLE, RESTAURANT, SHOP,ʢ୯‫໊ޠ‬ʣɼaliasesʢಉٛ‫ޠ‬ʣɼdescriptionsʢઆ໌จʣ
ɼclaims

CULTURAL, GARDEN, ATTRAC-ʢؔ࿈‫ޠ‬ʣͳͲͷ৘ใ͕෇༩͞Ε͍ͯΔɽ͜ΕΒͷ৘ใΛ

TION, HOTEL, WATERSIDE, EDU-

༻͍Δ͜ͱͰɼ୯‫ޠ‬ද૚ʹ͸‫ݱ‬Εͳ͍ҙຯతͳૉੑͷ֦ு͕ՄೳͰ͋Δɽ·ͨɼؔ࿈‫ͯؔ͠ʹޠ‬͸୯‫ؒޠ‬ͷؔ܎͕ෳ

CATION, ROAD, AIRPORTTIME

DATE, INTERVAL, START, END,OPEN, CLOSE਺ఆٛ͞Ε͓ͯΓɼͦͷؔ܎Λ୧Δ͜ͱͰग़‫ޠͨ͠ݱ‬ͷநTRSP

STATION, TYPE৅Խ͕ՄೳʹͳΔͱ‫ظ‬଴͞ΕΔɽͦ͜Ͱɼຊ‫Ͱڀݚ‬͸ɼ͜WEATHER—ΕΒͷҙຯత৘ใΛར༻ͨ͠ૉੑΛఏҊ͢Δɽૉੑͷϥϕϧ໊ͱͯ͠͸ɼlabelsʢ୯‫໊ޠ‬ʣͱ aliasesʢಉகͨ͠৔߹͸ɼͦͷ SUBCATEGORY ͷ্ҐΫϥεͱٛ͠‫ޠ‬ʣͱͯ͠ఆٛ͞Ε͍ͯΔ୯‫ޠ‬Λ༻͍Δɽϥϕϧ໊͕ൃͯఆٛ͞Ε͍ͯΔ MAIN ͷ୯‫ޠ‬εϩοτ΋ 1 ͱ͢Δɽ͜Ε࿩தͷ୯‫ͱޠ‬Ұகͨ͠৔߹ɼͦͷΤϯτϦ͔Βੜ੒͞ΕΔʹΑΓநग़͞ΕΔૉੑͷ۩ମྫΛਤ 1 ʹࣔ͢ɽ͜͜Ͱ͸ɼૉੑΛൃ࿩ʹର͢Δૉੑͱͯ͠௥Ճ͢Δɽͳ͓ɼϥϕϧ໊

Belgium ͷ descriptions(આ໌จ) ʹ country ͕Ұக͕ͨͨ͠ൃ࿩தͷෳ਺ͷ୯‫ͱޠ‬Ұகͨ͠৔߹͸ɼͦΕͧΕͷૉੑΊɼcountry εϩοτΛ 1 ͱ͠ɼͦͷ্ҐΫϥεͷ area εͷ࿦ཧ࿨Λͱͬͨ݁ՌΛൃ࿩ʹର͢Δૉੑͱͯ͠௥Ճ͠

ϩοτ΋ 1 ͱ͍ͯ͠Δɽͨɽ֦ுͱͯ͠͸ɼҙຯλάΛࢀর֦ͨ͠ுͱɼؔ࿈‫ʹޠ‬ΑΔ֦ுΛఏҊ͢Δɽ

3.2 ؔ࿈‫ʹޠ‬ΑΔ֦ு
Wikidata ಺ͷ claimsʢؔ࿈‫ޠ‬ʣʹ͸ɼ֤ labelsʢ୯‫໊ޠ‬ʣ

3.1 ҙຯλάΛࢀর֦ͨ͠ுʹର͠ɼ͍͔ͭ͘ͷؔ࿈‫·ؚ͕ޠ‬Ε͍ͯΔɽ୯‫ͦͱޠ‬ͷؔDSTC4 Ͱ͸ɼൃ࿩಺ͷ୯‫ʹޠ‬ର͠ɼ͍͔ͭ͘ͷҙຯత࿈‫ؒޠ‬ͷؔ܎΋ซͤͯఆٛ͞Ε͓ͯΓɼࠓճ͸ͦͷؔ܎ͷ৘ใ͕ҙຯλάͱͯ͠෇༩͞Ε͍ͯΔ [8]ɽද 1 ʹ͜ͷҙछྨʹ஫໨ͯ͠ૉੑΛ֦ுͨ͠ɽ୯‫ؒޠ‬ͷؔ܎ʹΑͬͯඥຯλάͷఆٛΛࣔ͢ɽ͜ΕΒͷ୯‫ޠ‬͸Ϣʔβൃ࿩ͷҙਤʹ͚ͮΒΕͨؔ࿈‫ޠ‬ͷྫΛਤ 2 ʹࣔ͢ɽྫ͑͹ɼRamen ͷؔΘΔॏཁͳ୯‫͋Ͱޠ‬Γɼ͜ΕΒͷ୯‫ؔ͢ʹޠ‬ΔૉੑΛ֦

claimsʢؔ࿈‫ޠ‬ʣ಺Ͱ͸ɼ”instance ofʢ෦෼ؔ܎ʹ͋Δ΋ு͢Δ͜ͱʹΑͬͯɼΑΓޮՌతʹਪఆ‫ث‬Λ֦ு͢Δ͜ͱͷʣ”ͱͯ͠ Japanese cuisine ͕͋Δɽ୯‫ޠ‬ϕΫτϧΛ࡞

͕Ͱ͖Δͱߟ͑ΒΕΔɽͦ͜Ͱɼ͜ΕΒͷҙຯλάΛ࣋ͭΔࡍɼdoc2vec ʹΑͬͯҙຯϕΫτϧʹม‫͞׵‬ΕΔલͱ‫ޙ‬୯‫͕ޠ‬ɼWikidata ͷ౰֘୯‫ޠ‬ΤϯτϦʹ͋Δ claimsʢؔͷͦΕͧΕʹ௥Ճ͢Δ 2 ௨ΓͷૉੑΛࢼ͢ɽ࿈‫ޠ‬ʣͱ descriptionsʢઆ໌จʣͷதʹ‫·ؚ‬ΕΔ͔ௐ΂ɼͦ

3.2.1 ؔ࿈‫ޠ‬Λ୯‫ޠ‬ϕΫτϧʹ௥Ճͷස౓ΛϕΫτϧԽͨ͠ɽ͜ͷ֦ுૉੑͷεϩοτ͸ɼද·ͣɼग़‫ʹޠݱ‬ରͯ͠ҎԼͷ 3 ͭͷؔ܎Λ࣋ͭؔ࿈‫ޠ‬

1 ʹ‫͢ࡌܝ‬Δ MAIN ͱ SUBCATEGORY ͷશ 44 ‫͋Ͱݸ‬ͷස౓ΛϕΫτϧԽͨ͠ɽWikidata ʹ͋ΔશΤϯτϦͷΔɽ͜ΕΒͷ୯‫ ͕ޠ‬Wikidata ಺ͷ claimsʢؔ࿈‫ޠ‬ʣ·ͨclaimsʢؔ࿈‫ޠ‬ʣͰɼҎԼͷؔ܎ʹΑͬͯࢀর͞Εͨ୯‫ޠ‬͸ descriptionsʢઆ໌จʣʹ‫·ؚ‬Εͨ৔߹ɼͦͷ୯‫ޠ‬ͷεΛશͯॻ͖ग़͠ɼࢀর͞Εͨճ਺͕ 1500 ճҎ্ͷ‫ ܭ‬287

ϩοτΛ 1 ͱ͢Δɽ͜ͷࡍɼSUBCATEGORY ͷ୯‫͕ޠ‬Ұ‫ݸ‬ͷ୯‫໊ޠ‬Λૉੑͷεϩοτͱͯ͠༩͑Δɽ

ⓒ 2015 Information Processing Society of Japan2

Vol.2015-SLP-109 No.13
2015/12/2

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Reportද 2 ϕʔεϥΠϯɼSem. TagsɼSem. Tags + Rel. Words ͷ݁Ռख๏Accuracy Precision Recall F1ϕʔεϥΠϯ

0.0239

0.300

0.287

0.293

+ Sem. Tags

0.0239

0.303

0.292

0.297

+ Sem. Tags

0.0244

0.301

0.288

0.295

+ Rel. Words
ਤ 2୯‫ؒޠ‬ͷؔ܎ͱؔ࿈‫ޠ‬ͷ۩ମྫ
ද 3 ҙຯλάΛࢀর֦ͨ͠ுʹΑΔ TRANSPORTATION ΧςΰϦͷਫ਼౓޲্ਤ 3 ؔ࿈‫ޠ‬Λ୯‫ޠ‬ϕΫτϧʹ௥Ճ͢ΔૉੑͷྫN

F1ϕʔεϥΠϯ

471

0.425

+ Sem. Tags

513

0.524

ࠩ෼

420.0990• AccuracyɿεϩοτɼϑϨʔϜΛ‫ؚ‬Ή 1 ൃ࿩ʹର͢Δਪఆ‫ث‬ͷग़ྗ݁Ռͷਖ਼౴཰• Commons categoryʢ‫ڞ‬௨ΧςΰϦʣ• Precisionɿਪఆ‫ث‬ͷग़ྗ݁Ռͷ͏ͪਖ਼ղͨ͠εϩοτ• instance ofʢ࣮ྫʣ• Recallɿਖ਼ղͷ͏ͪਖ਼͘͠ਪఆ͞Εͨεϩοτͷׂ߹• part ofʢ෦෼ؔ܎ʹ͋Δ΋ͷʣ

Wikidata ͷ֤ΤϯτϦͷ claimsʢؔ࿈‫ޠ‬ʣ಺ʹ্‫Ͱه‬ఆΊͨසग़ؔ࿈‫·ؚ͕ޠ‬Ε͍ͯΔ৔߹ɼͦͷ୯‫ޠ‬ͷεϩοτΛ 1ͷׂ߹• F-measureɿPrecision ͱ Recall ͷௐ࿨ฏ‫ۉ‬࣮‫ͯ͠ͱݧ‬ɼҎԼͷ֦ு͞Εͨ 3 ͭͷਪఆ‫ث‬Λൺֱͨ͠ɽͱ͢Δɽ͜ͷૉੑ͸ɼ௚઀ૉੑϕΫτϧʹରͯ͠௥Ճ͢Δɽ( 1 ) ҙຯλάΛࢀরͨ͠ૉੑΛ֦ு (Sem. Tags)ૉੑͷ۩ମྫΛਤ 3 ʹࣔ͢ɽ͜͜Ͱ͸ɼBelgium ͷ claims( 2 ) ҙຯλάΛࢀরͨ͠ૉੑͱؔ࿈‫ޠ‬Λ୯‫ޠ‬ϕΫτϧʹ௥ʢؔ࿈‫ޠ‬ʣ಺ʹසग़ؔ࿈‫ޠ‬ͷ Europe ͱ United Nations ͕Ճͨ͠ૉੑΛ֦ு (Sem. Tags + Rel. Words)‫·ؚ‬Ε͍ͯͨͨΊɼͦͷεϩοτΛ 1 ͱ͍ͯ͠Δɽ

( 3 ) ؔ࿈‫ޠ‬ΛҙຯϕΫτϧʹ௥Ճͨ͠ૉੑΛ֦ு

3.2.2 ؔ࿈‫ޠ‬ΛҙຯϕΫτϧʹ௥ՃͦΕͧΕͷ࣮‫݁ݧ‬Ռʹ͍ͭͯɼ࣍અҎ߱Ͱड़΂Δɽ

1 ൃ࿩ͷग़‫ʹޠݱ‬ରͯ͠ɼWikidata ಺Ͱఆٛ͞Ε͍ͯΔؔ࿈‫ޠ‬Λɼͦͷ··ൃ࿩಺༰ͱͯ͠௚઀௥Ճ͢Δɽͪ͜ΒͰ͸ɼҎԼͷ 7 ͭͷؔ܎ʹ஫໨͠ɼͦΕͧΕͷؔ܎Ͱ݁͹Εͨؔ࿈‫ޠ‬Λ௥Ճ͢Δɽ

4.2 ࣮‫݁ݧ‬ՌϕʔεϥΠϯτϥοΧʔͷ݁ՌͱɼҙຯλάΛࢀরͨ͠ૉੑΛ༻͍ͨ݁Ռ (Sem. Tags)ɼҙຯλάΛࢀরͨ͠ૉੑ

• subclass ofʢαϒΫϥεʣͱؔ࿈‫ޠ‬ΛҙຯϕΫτϧʹ௥Ճͨ͠ૉੑΛ֦ுͨ݁͠Ռ

• capitalʢट౎໊ʣ

4.2.1 ҙຯλάΛࢀর֦ͨ͠ு

• part ofʢ෦෼ؔ܎ʹ͋Δ΋ͷʣ͸໿ 0.4% ͷ޲্͕‫ݟ‬ΒΕͨɽಛʹɼTRANSPORTATION• topic’s main categoryʢτϐοΫͷϝΠϯΧςΰϦʣੑʹΑͬͯ TYPE εϩοτͷਪఆਫ਼౓͕޲্ͨ͠ʢද 3ʣɽ

• Commons categoryʢ‫ڞ‬௨ΧςΰϦʣ• continentʢॴଐ͢Δ஍Ҭʣ• member ofʢҰһؔ܎ʣ(Sem. Tags + Rel. Words) Λද 2 ʹࣔ͢ɽҙຯλάΛࢀরͨ͠ૉੑΛ༻͍ͨ݁Ռ (Sem. Tags)ɼF ஋τϐοΫͰਫ਼౓޲্͕‫ݟ‬ΒΕɼͦͷͳ͔Ͱ΋ࠓճՃ͑ͨૉ͜ͷૉੑ͸ൃ࿩ʹ௚઀௥Ճ͍ͯ͠ΔͨΊɼdoc2vec ͷೖྗͱͯ͠௥Ճ͞ΕɼҙຯϕΫτϧʹม‫͞׵‬ΕΔɽ

4. ධՁ࣮‫ݧ‬

4.2.2 ୯‫ޠ‬ϕΫτϧͱͯؔ͠࿈‫ޠ‬Λ༻͍ͨૉੑ
4.2.1 ʹՃ͑ɼWikidata ʹ͓͚Δؔ࿈‫ޠ‬ͷҙຯత৘ใΛ୯‫ޠ‬ϕΫτϧͱͯ͠༻͍ͨૉੑΛՃ͑ͨ݁Ռ (Sem. tags +ఏҊͨ͠ૉੑͷධՁΛߦ͏ͨΊɼҎԼͷ࣮‫ݧ‬ΛߦͬͨɽRel. Words)ɼF ஋͸໿ 0.1% ͷਫ਼౓޲্ʹཹ·ͬͨɽ4.2.1ϕʔεϥΠϯτϥοΧʔͱͯ͠ɼ2 અͰߏஙͨ͠୯‫ͦͱޠ‬ͷͱ͖ͱಉ༷ʹɼTRANSPORTATION τϐοΫͷ TYPEͷҙຯϕΫτϧͷΈ͔Βֶशͨ͠ਪఆ‫ث‬Λ༻͍ΔɽϕʔεεϩοτʹޮՌ͕ΈΒΕ͕ͨɼҙຯλάͷΈΛ༻͍ͨ৔߹

ϥΠϯτϥοΧʔʹɼఏҊͨ͠ૉੑΛ௥Ճ͢Δ͜ͱͰਪఆΑΓਫ਼౓ͷ޲্͕খ͘͞ɼ݁Ռͱͯ͠શମͷਫ਼౓޲্͸ਫ਼౓͕Ͳͷఔ౓޲্͢Δ͔ΛධՁ͢Δɽ

4.2.1 ʹ‫ٴ‬͹ͳ͔ͬͨɽ
4.2.3 ҙຯϕΫτϧͱͯؔ͠࿈‫ޠ‬Λ༻͍ͨૉੑ

4.1 ࣮‫ݧ‬৚݅ɾධՁࢦඪࠓճ͸֤λʔϯͷର࿩ঢ়ଶʹ஫໨͠ɼҎԼͷධՁࢦඪΛ༻͍ͯਪఆਫ਼౓ΛධՁ͢Δɽ

ⓒ 2015 Information Processing Society of Japanද 4 ʹؔ࿈‫ޠ‬ΛҙຯϕΫτϧʹ௥Ճͨ͠ૉੑΛ֦ுͨ݁͠ՌΛࣔ͢ɽද 4 ͔Βɼ࠷΋ਫ਼౓޲্͕‫ݟ‬ΒΕͨͷ͸”topic’smain category”Ͱ͋ͬͨɽҎ߱Ͱ͸ɼͦΕͧΕͷૉੑΛՃ
3

Vol.2015-SLP-109 No.13
2015/12/2

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Reportද 4͍͔ͭ͘ͷεϩοτͰਫ਼౓͕Լ͕ͬͨྫ΋͋ͬͨɽಛʹɼؔ࿈‫ޠ‬ΛҙຯϕΫτϧʹ௥Ճ֦ͨ͠ுͷ࣮‫݁ݧ‬Ռ

Accuracy

Precision

RecallF1FROM εϩοτ΍ TO εϩοτͷਫ਼౓͸௿Լ܏޲ʹ͋ͬ

subclass of

0.0246

0.300

0.285

0.292

Commons category

0.0179

0.281

0.309

0.294

ͨɽ·ͨɼ”Commons category”ͷؔ࿈‫ޠ‬Λ௥Ճ͢Δ͜ͱ

capital0.0230

0.303

0.288

0.295

continent

0.0234

0.301

0.291

0.296

ACCOMMODATION τϐοΫͰ͸ɼ”part of”, ”mem-part of0.0249

0.312

0.287

0.299

ber of”, ”topic’s main category”Λ௥Ճͨ͠৔߹ɼ໿ 3% ఔmember of0.0237

0.314

0.292

0.302

౓ͷਫ਼౓޲্͕‫ݟ‬ΒΕͨɽ͍ͣΕͷؔ܎Λ௥Ճͨ͠৔߹

topic’s main category

0.0254

0.317

0.292

0.304

΋ɼACCOMMODATION τϐοΫͷ PLACE εϩοτʹ

ͰɼTICKET εϩοτͷਪఆਫ਼౓͕ 5% ऑԼ͕͍ͬͯΔɽؔͯ͠͸ਫ਼౓޲্͕‫ݟ‬ΒΕɼಛʹɼ্‫ه‬ͷ 3 छྨͷؔ܎Λ௥͑ͨ݁Ռɼ۩ମతʹͲͷεϩοτ͕มԽ͔ͨ͠ߟ࡯͢ΔɽՃͨ͠৔߹͸͍ͣΕ΋ 4% લ‫ޙ‬ͷਫ਼౓޲্͕͋ͬͨɽҰํ

SHOPPING τϐοΫʹؔ͠ɼ”Commons category”ͷ

Ͱɼ”continent”, ”subclass of”, ”Commons category”ͷؔؔ ܎ Λ ௥ Ճ ͠ ͨ ࣌ ͷ Έ ໿ 0.2% ఔ ౓ ͷ Θ ͣ ͔ ͳ ਫ਼ ౓ ޲܎Λ࣋ͭؔ࿈‫ޠ‬Λ௥Ճͨ͠৔߹͸ ACCOMMODATION τ্ ͕ Έ Β Ε ͨ ɽ۩ ମ త ʹ ͸ ɼSHOPPING τ ϐ ο Ϋ ͷϐοΫͷਪఆਫ਼౓͕Լ͕͍ͬͯͨɽACCOMMODATIONTYPE OF PLACE ʹؔ͢Δঢ়ଶਪఆͷਫ਼౓͕໿ 3.9% ఔτϐοΫͷ NEIGHBOURHOOD εϩοτʹؔͯ͠͸ɼ͍౓޲্ͨ͠ҰํͰɼNEIGHBOURHOOD εϩοτʹؔͣΕͷؔ܎Λ௥Ճͯ͠΋ਫ਼౓ͷ௿Լ͕‫ݟ‬ΒΕͨɽ͢Δਪఆਫ਼౓͸໿ 2.9% ఔ౓Լ͕͍ͬͯͨɽ”Commonscategory”Ҏ֎ͷؔ܎Λ௥Ճͨ͠৔߹ɼ‫ڞ‬௨ͯ͠ NEIGHBOURHOOD εϩοτʹؔ͢Δਪఆਫ਼౓͕໿ 0.6% ఔ౓Լ͕ΓɼͦΕҎ֎ͷεϩοτ͸มԽ͍ͯ͠ͳ͔ͬͨɽ

5. ·ͱΊ
LSTM ʹ‫͍ͨͮج‬ର࿩ঢ়ଶਪఆ‫֎ʹث‬෦஌ࣝϕʔεΛ֦ு͢Δख๏ΛఏҊͨ͠ɽ͜ͷ݁Ռɼ֎෦஌ࣝϕʔεΛ༻͍

FOOD τϐοΫʹؔ͠ɼ”continent”ͱ”capital”ͷؔ܎ͨҙຯతૉੑΛՃ͑Δ͜ͱͰɼ͍͔ͭ͘ͷର࿩ঢ়ଶͷਪఆΛ௥Ճͯ͠΋ਫ਼౓ʹมԽ͸‫ݟ‬ΒΕͣɼͦΕҎ֎ͷؔ܎ʹͭਫ਼౓্͕͕Δ͜ͱ͕Θ͔ͬͨɽWikidata ʹ͸ࠃ໊΍஍໊͍ͯ͸‫ͳ͔ۇ‬௿Լ͕‫ݟ‬ΒΕͨɽಛʹɼ”part of”, ”topic’sͷ৘ใ͕ଟ͘‫·ؚ‬Ε͓ͯΓɼಛʹަ௨‫ؔʹؔػ‬࿈ͨ͠ର࿩

main category”, ”subclass of”ͷ 3 छྨͷؔ܎Λ௥Ճͨ͠ঢ়ଶͷਪఆਫ਼౓্͕͕ͬͨͷͰ͸ͳ͍͔ͱߟ͑ΒΕΔɽ৔߹ɼFOOD τϐοΫͷਪఆਫ਼౓͕ͦΕͧΕ໿ 1% ఔ౓Լࠓ‫ޙ‬ͷ՝୊ͱͯ͠͸ɼෳ਺ͷؔ܎Λ૊Έ߹Θͤͨ݁Ռɼ

͕ͬͨɽ”continent”ͱ”capital”Λআ͘ଞͷؔ܎Λ௥Ճͨ͠ର࿩ঢ়ଶਪఆͷਫ਼౓ʹͲͷΑ͏ͳมԽ͕ΈΒΕΔ͔֬ೝ͢৔߹ɼFOOD τϐοΫͷ CUISINE, TYPE OF PLACE,Δඞཁ͕͋Δͱߟ͍͑ͯΔɽ

PLACE ౳ͷεϩοτʹର͠ɼ‫ڞ‬௨ͯ͠ѱӨ‫͕ͨͬ͋ڹ‬ɽҰํͰɼ”Common category”ͷؔ܎Λ௥Ճͨ࣌͠ͷΈɼࢀߟจ‫ݙ‬

FOOD εϩοτͷ MEAL TIMEɼDISH εϩοτʹର͠

[1]ͯ͸ͦΕͧΕ 2% ͱ 1% ఔ౓ͷਫ਼౓޲্͕‫ݟ‬ΒΕͨɽ

ATTRACTION τϐοΫʹؔͯ͠͸ɼ”part of”, ”sub-[2]class of”, ”topic’s main category”ͷ ؔ ࿈ ‫ ޠ‬Λ ௥ Ճ ͢ Δ͜ͱͰ໿ 0.2% ఔ౓ͷ޲্͕‫ݟ‬ΒΕͨɽҰํͰɼ”conti-nent”, ”capital”Λ௥Ճ͢Δ͜ͱͰ 0.1% ఔ౓ͷѱӨ‫͕ڹ‬[3]͋ͬͨɽ”Commons category”ͷؔ࿈‫ޠ‬Λ௥Ճ͢Δ͜ͱͰɼATTRACTION τϐοΫͷ TYPE OF PLACE εϩοτͱ TIME εϩοτʹର͠ɼͦΕͧΕ 9%ɼ7.6% ఔ౓ͷਫ਼[4]౓޲্͕‫ݟ‬ΒΕ͕ͨɼҰํͰ PLACE εϩοτʹରͯ͠͸[5]3.7% ఔ౓ͷਫ਼౓ͷ௿Լ͕‫ݟ‬ΒΕͨɽશͯͷؔ܎Λ௥Ճͨ͠[6]݁Ռɼ‫ڞ‬௨ͯ͠ ATTRACTION τϐοΫͷ NEIGHBOURεϩοτʹѱӨ‫ڹ‬Λ༩͍͑ͯͨɽ

TRANSPORTATION τϐοΫʹؔͯ͠͸ɼ͍ͣΕͷؔ[7]܎΋ਪఆʹର͠ྑ͍Ө‫ڹ‬Λ༩͍͑ͯΔɽಛʹɼ”Commonscategory”, ”topic’s main category”ͷؔ࿈‫ޠ‬Λ௥Ճͨ͜͠
ͱͰ 4% ఔ౓ͷ޲্͕ɼ”member of”ͷؔ࿈‫ޠ‬Λ௥Ճͨ͜͠
ͱͰ 3.2% ఔ౓ͷ޲্͕‫ݟ‬ΒΕͨɽ্‫ه‬ͷ 3 छྨͷؔ܎Λ

[8]Yi Ma, Paul A. Crook, Ruhi Sarikaya, Eric Fosler-Lussier:Knowledge graph inference for spoken dialog systems. In
Proc. IEEE-ICASSP, 2015.
Matthew Henderson, Blaise Thomson, and Steve Young:
Robust dialog state tracking using delexicalised recurrent
neural networks and unsupervised adaptation. In Proc.
IEEE-SLT, pages 360–365. IEEE, 2014.
Matthew Henderson, Blaise Thomson, and Steve Young:
Word-based dialog state tracking with recurrent neuralnetworks. In Proc. SIGDIAL, page 292, 2014.
Sepp Hochreiter and Jürgen Schmidhuber: Long shortterm memory. Neural computation, 9(8):1735–1780, 1997.
Quoc V Le and Tomas Mikolov: Distributed representations of sentences and documents. In Proc. ICML, 2014.
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeﬀ Dean: Distributed representations of words
and phrases and their compositionality. In Proc. NIPS,pages 3111–3119, 2013.
D. Vrandečić and M. Krötzsch: Wikidata: a free collaborative knowledgebase, Communications of the ACM, vol.
57, no. 10, pp. 7885, 2014.
Seokwan Kim, Luis Fernando D’Haro, Rafael E. Banchs,
Jason Williams, and Matthew Henderson: The FourthDialog State Tracking Challenge. In Proc. IWSDS, 2016.

௥Ճ͢Δ͜ͱͰɼTRANSPORTATION τϐοΫͷ TYPEεϩοτͷਪఆਫ਼౓͕ 10% Ҏ্޲্͍ͯͨ͠ɽͨͩ͠ɼⓒ 2015 Information Processing Society of Japan4