Vol.2017-MUS-116 No.21
2017/8/26

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Report

TextTimeline:จࣈදࣔΛอ࣋ͨ͠ൃ࿩ςΩετͷԻ‫ڹ‬ಛ௃ՄࢹԽத໺ ྙ༃1,a)Ճ౻ ३1,b)‫ޙ‬౻ ਅ޹1,c)֓ཁɿൃ࿩Λ൐͏จࣈςΩετʹ͓͍ͯɺ֤จࣈͷൃ੠λΠϛϯά΍ͦͷԻ‫ڹ‬ಛ௃ྔΛ೺ѲͰ͖ΔΑ͏ʹՄࢹԽ͢Δ TextTimeline ΛఏҊ͠ɺෳ਺ͷ࣮‫ํݱ‬๏Λൺֱ͢Δɻจষ΍Վࢺ౳ͷςΩετʹ͓͍ͯɺͦͷ֤จࣈ͸‫ݻ‬ఆతͳ෯Λ࣋ͭϑΥϯτͰද‫͞ݱ‬ΕΔʹ΋͔͔ΘΒͣɺͦΕΒʹରԠ͢Δൃ࿩ͷ࣌ؒ௕͸ଟ͘ͷ৔߹ՄมͰ͋Δɻ͕ͨͬͯ͠Ի‫ڹ‬ಛ௃ΛՄࢹԽ͢ΔͨΊʹɺैདྷɺϐΞϊϩʔϧ౳ͷΑ͏ʹԻ੠ͷ࣌ؒ࣠Λ‫ݻ‬ఆʢ༏ઌʣͯ͠จࣈΛ෼ׂදࣔ͢Δํ๏΍ɺ‫ʹٯ‬ɺΧϥΦέՎࢺ΍ࢻۛͷۛӵේ౳ͷΑ͏ʹจࣈҐஔΛ‫ݻ‬ఆ֤ͯ͠จࣈͷԻ‫ڹ‬ಛ௃Λද‫͢ݱ‬Δํ๏͕͋ͬͨɻ͔͠͠લऀ͸ɺจࣈҐஔ͕Ի੠ʹ੍໿Λड͚ɺจࣈؒͷॏͳΓ΍ۭനʹΑͬͯςΩετͷେ‫ہ‬తͳؔ܎Λ೺Ѳ͠ʹ͘͘ɺ‫ऀޙ‬͸ɺԻ‫ڹ‬ಛ௃ΛԻ੠ͷ࣌ؒ࣠௨ΓʹՄࢹԽͰ͖ͳ͍໰୊͕͋ͬͨɻͦ͜Ͱ TextTimeline Ͱ͸ɺςΩετදࣔΛ༏ઌ͠ͳ͕ΒԻ‫ڹ‬ಛ௃ΛจࣈͷपลʹຒΊࠐΉ͕ɺͦͷࡍʹ͸Ի੠ͷ࣌ؒ࣠ΛอͪɺৄࡉͳԻ‫ڹ‬ಛ௃ͷՄࢹԽ΋Մೳʹ͢Δɻ

1. ͸͡Ίʹ$ ఠଢ峘ৎ৑ກ峼ર੔͸ଟ༷ͳ৔໘Ͱଘࡏ͢Δ͕ɺͦͷதͰ΋ɺָ‫ۂ‬தͷՎࢺ

た͍͏ൃ࿩ํ๏͕ॏཁͱͳΔɻྫ͑͹ɺՎএʹ͓͍ͯ͸ɺԻߴɾԻྔ౳ͷՄࢹԽʢϑΟʔυόοΫʣ͕Վএೳྗ޲্ʹ
༗ޮͰ͋Δ͜ͱ͕஌ΒΕ͍ͯΔʢ [1, 2] ౳ʣɻಉ༷ʹɺൃ࿩
‫܇‬࿅Λର৅ͱ͍͔ͨͭ͘͠ͷ CALLʢComputer-Assisted

Language LearningʣγεςϜʹ͓͍ͯ΋Ի‫ڹ‬ಛ௃ͷՄࢹԽ͕࠾༻͞Ε͓ͯΓ *1 ɺԻߴɾԻྔɾൃ࿩௕͞ΛจࣈςΩετͱ༥߹ͤͯ͞ՄࢹԽ͢ΔΠϯλϥΫγϣϯʹΑΓɺൃ࿩ͷද‫͕ྗݱ‬վળ͢Δ͜ͱ͕ใࠂ͞Ε͍ͯΔ [3, 4]ɻ
·ͨɺӳձ࿩ʹ͓͚Δൃ੠ϦζϜͷ‫ޡ‬Γ͸ɺϛείϛϡ
χέʔγϣϯͷ‫ݪ‬ҼͱͳΔ͜ͱ͕஌ΒΕ͓ͯΓ [5, 6]*2 ɺΞϝϦΧ߹ऺࠃʹ͓͚ΔࢠͲ΋ͷൃ࿩‫ڭ‬ҭʹ͓͍ͯ͸ɺ଎౓
1

a)
b)
c)
*1
*2

࢈‫ٕۀ‬ज़૯߹‫ॴڀݚ‬
National Institute of Advanced Industrial Science and Technology (AIST)
t.nakano [at] aist.go.jp
jun.kato [at] aist.go.jp
m.goto [at] aist.go.jp
https://en.wikipedia.org/wiki/Rosetta_Stone_(software) ౳ɻ“McDonald’s” ͱ͍͏ӳ୯‫ޠ‬͸ 3 ԻઅͰ͋Γɺ2 Իઅ໨ʹ‫ޠ‬ኮ‫ڧ‬
੎ʢlexical stressʣΛ୲͏ɻ͔͠͠೔ຊ‫Ͱޠ‬͸ “makudonarudo”
ͷ 6 ԻઅͰͷൃԻͱͳΓɺ‫ޙ‬Ζ͔Β 3 ൪໨ʹΞΫηϯτ͕ஔ͔Ε
Δ [6]ɻ·ͨɺ೔ຊਓӳ‫ʹޠ‬৮Εͨ‫͕ݧܦ‬গͳ͍ΞϝϦΧਓඃ‫ݧ‬ऀʹର͠ɺ೔ຊਓӳ‫ޠ‬ͷཧղ౓͕௿͔ͬͨͱ͍͏ใࠂ͕͋Δ [5]ɻⓒ 2017 Information Processing Society of Japan

立ち止まる時とどち΍֎ࠃ‫ֶޠ‬शʹ͓͚ΔςΩετͳͲ͸ɺʮԿΛʯൃ੠ͯ͠
͍Δ͔ͱ͍͏ൃ࿩಺༰ʹՃ͑ɺʮͲ͏ʯൃ੠͍ͯ͠Δ͔ͱ

き

再生時刻

ࣈນͷΑ͏ʹɺਓؒͷൃ࿩಺༰Λ‫ه‬ड़ͨ͠จࣈςΩετ% 崮崕崡崰਀ં峼ર੔

る

再生時刻୻‫ك‬৅ਵ崧崌嵇嵛崘峑ਘ৹਀ં

まhttps://en.wikipedia.org/wiki/Shiginより引用୻‫ك‬崼崊崶嵕嵤嵓਀ਠ‫ق‬ఠৈ峒ఠশ‫ك‬ਤ1୻‫ك‬ધஊ૯峕స岮্峼਀ંൃ࿩ςΩετͷԻ‫ڹ‬ಛ௃ՄࢹԽʹ͓͚Δྫɻ(A) Ի੠ͷ࣌ؒ࣠Λ༏ઌͤͨ͞ՄࢹԽɺ(B) ςΩετදࣔΛ༏ઌͤͨ͞ՄࢹԽɻ

ͱਖ਼֬͞ʹՃ͑ɺద੾ͳද৘෇͚ʢproper expressionʣ[7]΍ࣗવੑʢease or naturalness of readingʣ[8] ΋ʮྲྀெ͞ʯ
ͷఆٛʹՃ͑ΒΕ͍ͯΔɻ͕ͨͬͯ͠ɺʮͲ͏ʯൃ੠ͯ͠
͍Δ͔Λద੾ʹՄࢹԽ͢Δ͜ͱ͸ɺԻ੠Λհͨ͠ίϛϡχέʔγϣϯ΍ද‫ݱ‬ɺ‫ڭ‬ҭͷՄೳੑΛ֦͛Δͱߟ͑ΒΕΔɻ
ैདྷɺ࿕ಡԻ੠΍Վ੠ʹؔͯ͠ɺൃ࿩಺༰ͷจࣈςΩετͱൃ࿩ͷԻ‫ڹ‬ಛ௃Λಉ࣌ʹදࣔ͢ΔՄࢹԽ͕਺ଟ͘ఏҊ͞Ε͖ͯͨɻ͜͜ͰɺςΩετͷ֤จࣈ͸‫ݻ‬ఆతͳ෯ʢ͋
Δ͍͸֤จࣈͷදࣔʹదͨ͠෯ʣΛ࣋ͭϑΥϯτͰද‫͞ݱ‬
ΕΔ͕ɺ֤จࣈʹରԠ͢Δൃ࿩Ի੠ͷ࣌ؒ௕͸ՄมͰ͋Δ
ͨΊɺදࣔͷࡍʹͲͪΒΛ༏ઌͤ͞Δ͔Ͱɺೋ௨ΓͷՄࢹԽํ๏͕͋Δʢਤ 1ʣɻ

(1) Ի੠ͷ࣌ؒ࣠Λ༏ઌ ൃ࿩ςΩετͷද͕ࣔԻ੠ͷ੍໿Λड͚Δɻ࿩੠ɾՎ੠ͷ࣌ؒ࣠ʹ߹ΘͤͯɺςΩετͷ෼ׂද͕ࣔඞཁɻ

(2) จষɾՎࢺͷදࣔΛ༏ઌ ൃ࿩ςΩετͷද͕ࣔԻ੠
ͷ੍໿Λड͚ͳ͍ɻ֤จࣈʹԻ‫ڹ‬ಛ௃Λ෇༩͢Δ͔ɺ

1

Vol.2017-MUS-116 No.21
2017/8/26

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical ReportจࣈͷԣʹԻ‫ڹ‬ಛ௃ΛՄࢹԽ͢Δɻྫ͑͹ɺલऀʹ͸ϐΞϊϩʔϧ΍ָේ౳ɺ‫ʹऀޙ‬͸ΧϥΦ

2. ؔ࿈‫ڀݚ‬έՎࢺͷϋΠϥΠτදࣔ΍ۛӵේʢࢻۛͷָේද‫ݱ‬ʣʹ͓͚Δൃ੠ํ๏ͷදࣔ౳͕͋ΔɻલऀͷΑ͏ʹԻ੠ͷ࣌ؒ࣠Λ༏ઌͤ͞Δ৔߹ɺจࣈʹ੍໿Λड͚Δ͜ͱͳ͘ɺԻ‫ڹ‬ಛ௃Λࣗ༝ʹՄࢹԽͰ͖Δɻ͜Ε͸ɺʮͲ͏࿩͔͢ʯ
ʮͲ͏ՎΘΕ͍ͯΔ͔ʯͷදࣔΛ༏ઌ͍ͤͯ͞Δͱ͍͑ΔɻͦͷࡍɺςΩετදࣔ͸ൃ࿩࣌ؒʹ
ରԠ෇͚Δ͜ͱʹͳΔ͕ɺදࣔҐஔ͕ൃ࿩಺༰ʹΑ੍ͬͯ‫͞ݶ‬ΕΔͨΊɺදࣔ͢ΔεϖʔεΛ֬อͰ͖ͳ͔ͬͨΓɺจࣈʢ୯‫ޠ‬ʣؒʹେ͖ͳۭന͕ੜͯ͡͠·͏৔߹͕͋Δɻ
͕ͨͬͯ͠ɺ࿕ಡ͍ͨ͠จষ΍ՎࢺͷετʔϦʔΛ೺Ѳ͢Δ্Ͱɺ୯‫ؒޠ‬ͷେ‫ہ‬తͳؔ܎Λ೺Ѳ͠ʹ͘͘ͳͬͯ͠·͏Մೳੑ͕͋Δɻྫ͑͹ɺ೔ຊ‫ͯؔ͠ʹޠ‬͸จઅؒ΁ͷεϖʔεૠೖ͸৑௕ͰಡΈ଎౓ͷ௿ԼΛ΋ͨΒ݁͢Ռ͕ใࠂ
͞Ε͓ͯΓ [9]ɺ·ͨจࣈςΩετͷಡΈ΍͕͢͞ɺͦͷఏࣔํ๏ʢจࣈ഑ஔ΍վߦҐஔʣʹӨ‫͢ڹ‬Δ͜ͱ͕஌ΒΕ͍ͯΔ͕ [10–12]ɺͦͷΑ͏ͳ஌‫ݟ‬Λ‫͍͘ʹ͔͠׆‬ɻҰํɺ‫ऀޙ‬ͷΑ͏ʹจࣈදࣔΛ༏ઌͤ͞Δ৔߹ɺจࣈͷදࣔҐஔ΍αΠζʹԻ੠ଆ͔Βͷ੍໿͕ͳ͍ͨΊɺςΩετͷେ‫ہ‬తͳؔ܎Λอଘͨ͠Γɺදࣔͷ࢓ํΛ޻෉ͨ͠ද
‫ݱ‬खஈͱͳΓ͏Δɻ͕ͨͬͯ͠ɺ
ʮԿΛ࿩͢ʯ͔ɺ΋͘͠͸ʮԿ͕ՎΘΕ͍ͯΔʯ͔ͷද͕ࣔ༏ઌͰ͖Δɻ͔͠͠ɺςΩετʹ߹ΘͤΔͨΊʹɺैདྷɺԻ੠ͷ࣌ؒ࣠Λඇઢ‫ܗ‬৳ॖͤͯ͞ՄࢹԽ͢Δඞཁ͕͋Γɺ֤Ի௕΍ൃԻλΠϛϯάΛ
ࣄલʹ೺Ѳ͠ʹ͍͘ *3 ɻͦͷΑ͏ͳԻ௕΍ൃԻλΠϛϯά͸ɺՎ੠‫ͼٴ‬࿩੠ʹ͓͍ͯ΋ॏཁͰ͋Δɻྫ͑͹ɺӳ‫ޠ‬Ͱ͸Ի௕Λ stress ஌֮ͷख͕͔Γʹ͍ͯ͠Δ͜ͱ͕஌ΒΕ͓ͯΓ [13]ɺ·ͨ೔ຊ‫ޠ‬΍‫͚͓ʹޠࠃؖ‬Δ฼Իͷແ੠Խ͕ࣗવͳൃԻʹ͸ॏཁͰ͋Δ͕ɺͦΕʹ͸ൃԻ։࢝λΠϛϯά΍Ի௕΋ؔ܎͢Δɻ͞Βʹඇઢ‫ܗ‬৳ॖ͸ɺ࣮ࡍͷ෼ੳ݁ՌΛѹॖͤ͞Δඞཁੑ͕ੜ͡Δ৔߹͕͋Δ *4 ɻͦ͜ͰຊߘͰ͸ɺςΩετදࣔΛ༏ઌͤͯ͞ҙຯతͳ಺༰Λ೺Ѳ͢Δ͜ͱΛՄೳͱ͠ͳ͕Βɺͦͷൃ੠ํ๏΋ৄࡉʹ೺ѲͰ͖ΔΑ͏ͳՄࢹԽํ๏ΛఏҊ͠ɺTextTimeline ͱ‫Ϳݺ‬ɻTextTimeline Ͱ͸ɺൃ࿩Ի੠ͷ࣌ؒ࣠ΛςΩετදࣔʹ߹Θͤͯɺม‫ܗ‬΋͘͠͸ճసͤ͞Δ͕ඇઢ‫ܗ‬৳ॖ͸ߦΘͳ͍ɻ͜ΕʹΑͬͯɺԻ੠ͷ࣌ؒ࣠௨Γͷ৘ใදࣔΛՄೳͱ͠ɺԻ੠ͷൃ੠಺༰ͷ෼ੳ݁ՌΛςΩετ෇ۙʹදࣔ
ͤ͞ΔԠ༻ʹ޲͚ͨɺ‫ڞ‬௨తͳՄࢹԽ‫ج‬൫ͷߏஙΛ໨ࢦ͢ɻैདྷɺςΩετͱରԠ෇͍ͨൃ੠ΛՄࢹԽ͢Δख๏͸ɺ਺ଟ͘ఏҊ͞Ε͖ͯͨɻͦΕΒ͸લड़ͷΑ͏ʹɺԻ੠༏ઌ
දࣔͱςΩετ༏ઌදࣔͷೋछྨʹՃ͑ɺ͞Βʹ࣌ؒ࣠ͷཻ౓ͷ‫͔఺؍‬Β΋෼ྨͰ͖Δɻ۩ମతʹ͸ɺԻ੠୯Ґ΋͘͠͸ςΩετ୯ҐͰͷԻ‫ڹ‬ಛ௃ͷදࣔͰ͋Γɺલऀ͸Ի‫ڹ‬ಛ௃ͦͷ΋ͷɺ‫ऀޙ‬͸จࣈʹ߹ΘͤͨѹॖදࣔͱͳΔɻ
·ͨɺTextTimeline ʹ͓͍ͯ͸Ի੠ͷ࣌ؒ࣠Λม‫͢ܗ‬Δ
͕ɺ࣌‫ྻܥ‬ϝσΟΞͷ࣌ؒ࣠Λม‫ͤ͞ܗ‬Δ‫͕͋ڀݚ‬Δɻ

2.1 Ի੠༏ઌදࣔʴԻ੠୯Ґಛ௃Ի੠ͷ࣌ؒ࣠Λ༏ઌͤͯ͞ɺԻ੠୯ҐͰԻ‫ڹ‬ಛ௃ΛՄࢹ
Խ͢Δํ๏͸ɺैདྷ޿͘࢖ΘΕ͖ͯͨɻ͜ͷΑ͏ͳํ਑ʹ
͓͚ΔɺՎ੠ͷൃ੠಺༰ΛՄࢹԽ͢ΔҰൠతͳํ๏ͱ͠
ͯɺָේͱϐΞϊϩʔϧද͕ࣔ͋ΔɻԻߴͷҧ͍ΛҐஔͷ্ԼͰද‫Ͱ্ͨ͠ݱ‬ɺָේͰ͸֤ԻՁ͕‫߸ه‬Խ͞ΕɺϐΞϊϩʔϧͰ͸Ի௕ͱͱ΋ʹۣ‫Ͱܗ‬ද‫͞ݱ‬ΕΔɻ௨ৗͷָේͰ͸Իූʹ߹ΘͤΔΑ͏ʹՎࢺ͕ซ‫͞ه‬ΕɺϐΞϊϩʔϧͰ͸֤ՎࢺͷԻઅʢ೔ຊ‫ޠ‬ͷ৔߹ɺͻΒ͕ͳʣ౳΍୯‫͕ޠ‬ରԠ෇͚ΒΕΔɻ
ϐΞϊϩʔϧ͸ɺΧϥΦέͷը໘΍ɺՎ੠߹੒΍Վএࢧԉʹ͓͍ͯ΋༻͍ΒΕΔɻKenmochi et al. ʹΑΔՎ੠߹੒ιϑτ΢ΣΞ VOCALOID ͷ੍࡞ը໘ [14]ɺத໺ ଞʹΑΔՎ
੠߹੒ύϥϝʔλਪఆΠϯλϑΣʔε VocaListener [15]ɺ
ͦͯ͠ɺ߳ࢁ ଞʹΑΔ߹এֶशࢧԉγεςϜ [16] ͷͦΕͧΕ͸ɺϐΞϊϩʔϧදࣔʹ߹ΘͤͯՎࢺͷԻઅ͕දࣔ͞Ε͍ͯͨɻ·ͨ Nakano et al. ʹΑΔɺՎ੠࿥ԻΠϯλϑΣʔε VocaReﬁner Ͱ͸ɺԻߴɾԻྔɾԻ৭มԽʹɺՎࢺͷςΩετ͕‫ܗ‬ଶૉ୯ҐͰରԠ෇͚ΒΕɺԻૉ࣌ࠁ΋ՄࢹԽ͍ͯͨ͠ [17] ɻͦͷଞɺ΄ͱΜͲ͸ՎࢺͷදࣔΛ൐͍ͬͯͳ
͍͕ɺՎ੠ͷԻ‫ڹ‬ಛ௃ΛϦΞϧλΠϜʹࢹ֮ϑΟʔυόοΫ͢Δ͜ͱͰɺՎএ‫܇‬࿅ʹ‫͢༻׆‬Δ‫ڀݚ‬͸ Howard et al.
ͷ SINGAD [18] Ҏ߱ɺ༷ʑͳ‫͕͋ڀݚ‬Δ [1, 2, 16, 19–21]ɻ
࿩੠ʹؔͯ͠͸ɺCALL ʹ͓͍ͯԻߴ‫੻ي‬౳Λදࣔ͢Δ
৔߹͕͋ΓɺPetal et al. ͸ ReadN’Karaoke ʢV2ɿ౷߹ͷΈʣͰɺςΩετʹԻߴɾԻྔ‫੻ي‬Λॏ৞දࣔͤͨ͞ [3]ɻ·ͨɺRahman et al. ͸Իૉ୯Ґ *5 ͰɺௐԻҐஔͷՄࢹԽΛߦͬͨ [22]ɻͦͷଞɺςΩετͷදࣔΛ൐͍ͬͯͳ͍
͕ɺSchaefer et al. ͸ԻߴͱԻྔΛ্ԼҐஔͷҧ͍΍αΠζͷҧ͍Ͱද‫[ ͠ݱ‬23] ΍ɺPietrowicz et al. ͸Իૉͷҧ͍Λ৭ͷҧ͍ͰՄࢹԽͨ͠ [24]ɻ

*3*4͜ΕΒͷ‫ڀݚ‬͸ɺԻ੠୯Ґಛ௃ͷՄࢹԽͰ͋Γɺ‫ݻ‬ఆྫ͑͹ΧϥΦέՎࢺ౳ɺൃԻʹ߹ΘͤͨจࣈͷϋΠϥΠτදࣔ΋ɺԻ੠ͷ࣌ؒ࣠Λจࣈදࣔʹ߹Θͤͯඇઢ‫ܗ‬৳ॖͨ݁͠ՌͰ͋
Δɻ·ͨ͜ͷΑ͏ͳಈతͳϋΠϥΠτදࣔ͸͞Βʹɺಛఆͷ෼ੳ݁ՌΛ֬ೝ͢ΔͨΊʹɺΫϦοΫͨ͠Γ࣌ؒΛࢦఆ͢ΔͳͲԿΒ͔ͷखஈ͕ඞཁͱͳΓɺҰཡදࣔʹ͸޲͔ͳ͍ɻ
ྫ͑͹ɺԻઅ୯Ґͷ૬ରԻߴදࣔ͸ɺฏ‫ʹ࡞ૢۉ‬Αͬͯ৘ใ͕ѹॖ͞ΕΔɻ·ͨɺແԻ΍จࣈؒͷԻͳͲΛදࣔ͠ʹ͍͘ɻⓒ 2017 Information Processing Society of Japan͞Εͨ෼ੳγϑτ෯ʢ10ms ౳ʣʹ‫ͮ͘ج‬ՄࢹԽɺ΋͘͠͸ɺԻૉ୯Ґʹ‫ͮ͘ج‬ՄࢹԽ͕ͳ͞Ε͖ͯͨɻͦͷ఺Ͱ͸

TextTimeline ͱؔ܎͕͋Δ͕ɺςΩετҐஔ͕Ի੠ʹ੍໿
*5Իૉ͸ɺจࣈͰද‫͞ݱ‬ΕΔ͕Ի੠୯Ґͱͯ͠ѻ͏ɻ

2

Vol.2017-MUS-116 No.21
2017/8/26

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical ReportΛड͚Δ఺ͰҟͳΔɻ

ԣʹՎএελΠϧΛՄࢹԽ͢Δํ๏͕͋Δʢྫ͑͹ɺۛӵේ [25] *6 ʣɻ·ͨɺ௨ৗͷςΩετʹର͢Δ৘ใຒΊࠐΈ

2.2 Ի੠༏ઌදࣔʴςΩετ୯Ґಛ௃ʹ͸ Tufte ͷ sparklines ͕͋Γ [30]ɺͦΕΛԻָʹԠ༻͠Ի੠Λ༏ઌදࣔ͠ͳ͕ΒςΩετ୯ҐͰԻ‫ڹ‬ಛ௃ΛՄࢹͨɺՎࢺͷԻઅຖͷԻߴɺίʔυɺϦζϜΛຒΊࠐΉ Oh

Խ͢ΔͨΊʹ͸ɺԻ‫ڹ‬ಛ௃ΛจࣈͷϨΠΞ΢τ΍σβΠϯ

ͷ Musical sparklines ͕͋Δ [31]ɻͦ͜Ͱ͸͞ΒʹɺҙຯʹຒΊࠐΉඞཁ͕͋Δɻ͋Δ୯‫ޠ‬Λଠͨ͘͠ΓɺԻָͱςΩετͷେ‫ہ‬తͳ‫܁‬ΓฦՎ੠ʹ͓͍ͯ͸ɺࢻۛͷָේද‫͍͓ͯʹݱ‬ɺՎࢺʢจࣈʣ

͠΋ՄࢹԽ͞Ε͓ͯΓ [31]ɺfocus+context ʢﬁsheyeʣද‫ݱ‬Λ‫ޒ‬ઢේ্ʹ഑ஔ͢Δ͜ͱ͕͋Δ [25]ɻDiaz-Marino et alͷҰछͱͯ͠ߟ͑ΒΕΔ [32, 33]ɻͦͷଞɺদӜ ଞʹΑΔ

͸ɺΧϥΦέͷΑ͏ͳϋΠϥΠτදࣔʹՃ͑ɺՎͷԻߴʹ੠࣭ʹԠͨ͡จࣈϑΥϯτͷมߋʹؔ͢Δ‫͕͋ڀݚ‬Δ [34]ɻ

‫͍ͯͮج‬ɺԻઅ୯ҐͰՎࢺςΩετΛ্Լͤͯ͞දࣔ͢Δ

લઅಉ༷ɺ͜ΕΒ͸ɺςΩετͷେҬతͳදࣔ΋Մೳͱ

LyricText ΛఏҊͨ͠ [26]ɻͦ͜Ͱ͸ɺ੠ͷछྨʢSpoken,

͢Δ͕ɺԻ‫ڹ‬ಛ௃͸͞Βʹѹॖͨ͠ՄࢹԽΛඞཁͱ͢Δͨ

Sonorant, and YellʣΛ৭Ͱද‫ͨ͠ݱ‬ଞɺ௕ΊͷແԻͷ࣍ͷΊɺՄࢹԽՄೳͳ৘ใ੍͕‫͞ݶ‬ΕΔɻ

ൃԻ։࢝ΛΞχϝʔγϣϯͰද‫ͨ͠ݱ‬ɻ·ͨ Kato et al. ʹΑΔՎࢺΞχϝʔγϣϯ੍࡞ࢧԉ‫ ڥ؀‬TextAlive [27] ͸ɺ

2.5 ࣌ؒ࣠ͷมߋൃԻλΠϛϯάͱ͍͏ಛ௃ʹ‫ ͍ͨͮج‬Kinetic TypographyͷσβΠϯΛࢧԉ͢Δɻ

TextTimeline Ͱ͸ɺԻ੠ͷ࣌ؒ࣠Λม‫ͤ͞ܗ‬Δ͕ɺͦΕͱؔ࿈ͯ͠ɺγʔΫόʔΛ֦ு͢Δ‫͕͜ڀݚ‬Ε·Ͱଟ͘‫ݚ‬࿩੠ʹ͓͍ͯ͸ɺPetal et al. ʹΑΔ ReadN’KaraokeʢV1ɿ‫͞ڀ‬Ε͖ͯͨɻྫ͑͹ɺγʔΫόʔΛ੾ΓషΓͨ͠Γ‫͛ۂ‬ԻߴɾԻ௕ɾԻྔɾ౷߹ͷશͯʣͰ͸ɺԻߴɾԻ௕ʹ‫ͮج‬ͨΓͯ͠Ի੍ָ࡞Λߦ͏੨໦ ଞʹΑΔ SeekRopes [35] ΍ɺ͍ͯจࣈҐஔΛҠಈͯ͠දࣔ͠ɺԻྔʹ‫͍ͯͮج‬ೱ͞Λม୳ࡧతσʔλ෼ੳΛ໨తͱͯ͠γʔΫόʔΛม‫ͤ͞ܗ‬Δߴߋͨ͠ [3]ɻ·ͨ Rude ͸ɺจࣈͷ഑ஔ΍αΠζɾଠ͞ΛԻౢ ଞʹΑΔ TbVP Browser [36] ͳͲͰ͋Δɻ

௕ɾԻߴɾԻྔʹԠͯ͡ม‫͢ܗ‬ΔఏҊΛߦͬͨ [4]ɻҎ্ͷख๏͸ɺςΩετͷҐஔ͕Ի੠ʹ߹Θͤͯมߋ͞
ΕɺԻ‫ڹ‬ಛ௃΋ςΩετ୯ҐͰՄࢹԽ͞ΕΔͨΊɺText-

Timeline ͱ͸ํ਑͕ҟͳΔɻ

͔͜͠͠ΕΒ͸ɺςΩετ౳ɺ࣌‫ྻܥ‬ϝσΟΞҎ֎ͱͷରԠ෇͚Λ͍ͯ͠ͳ͍఺Ͱɺຊ‫ͱڀݚ‬͸໨త͕ҟͳΔɻ

3. TextTimeline ͷσβΠϯ
TextTimeline ͸ɺςΩετ༏ઌදࣔΛߦ͍ɺ͔ͭԻ‫ڹ‬ಛ

2.3 ςΩετ༏ઌදࣔʴԻ੠୯Ґಛ௃௃ྔΛԻ੠ͷ࣌ؒ࣠௨Γʹදࣔ͢Δɻͨͩ͠ɺԻ੠࣌ؒ࣠

ςΩετදࣔΛ༏ઌͤ͞ͳ͕ΒԻ੠୯Ґಛ௃ΛՄࢹԽ͢ͷํ޲౳ʹΑ༷ͬͯʑͳ࣮‫ํݱ‬๏͕ߟ͑ΒΕΔͨΊൺֱ‫ݕ‬Δํ๏ͷҰͭʹɺΧϥΦέʹ͓͚Δ࠾఺ը໘౳ɺՎࢺͷς

౼͢ΔɻຊষͰ͸ɺTextTimeline ʹ͓͚ΔՄࢹԽํ๏ͷσΩετͱԻ‫ڹ‬ಛ௃Λซ‫ͦͯ͠ه‬ΕͧΕͰ࣌ؒ࣠Λද‫͢ݱ‬Δ

βΠϯʹ͓͍ͯɺຬͨ͢΂੍͖໿৚݅ͱɺ֤σβΠϯʹ͓ํ๏͕͋Δɻͭ·ΓɺൃԻλΠϛϯάʹ߹ΘͤͨՎࢺ͕‫ڧ‬

͚Δಛ௃ʢҎ߱ɺૉੑͱ‫Ϳݺ‬ʣΛड़΂Δɻͦͷ‫ޙ‬ɺ࣮‫ݱ‬Մௐදࣔ͞ΕΔͱͱ΋ʹɺԻ‫ڹ‬ಛ௃্ͷ࣌ࠁ΋Ҡಈ͠ɺͦΕೳͳ༷ʑͳσβΠϯͷ࣮ྫʹ͍ͭͯɺͦΕͧΕͷಛ௃ΛٞΒͷઈରతͳදࣔҐஔ͕ҟͳΔɻͦͷଞɺPetal et al. ʹΑ࿦͢Δɻ

Δ ReadN’KaraokeʢV2: ԻߴɾԻྔʣ[3] ͕͋ΓɺԻߴͱԻྔͷ࣌ؒ࣠ΛςΩετʹ߹Θͤͯඇઢ‫ܗ‬৳ॖͨ͠ɻ

ຊߘͰ͸ɺ೔ຊ‫ͱޠ‬ӳ‫ʹޠ‬ରԠ͢Δ͜ͱΛ૝ఆ͠ɺԣॻ
͖ͷςΩετΛલఏͱ͢Δɻ·ͨɺςΩετͷ୯Ґͱͯ͜͠ͷΑ͏ͳՄࢹԽํ਑͸ɺԻߴɾԻྔ‫੻ي‬౳Λ֬ೝՄೳ͸ɺΧϥΦέ΍ Kinetic Typography ͷΑ͏ʹҰจࣈͣͭͰɺTextTimeline ͱํ਑͕࠷΋͍ۙɻ͔͠͠ɺલऀ͸Իූ࣌ؒΛද‫͢ݱ‬ΔͷͰ͸ͳ͘ɺϦζϜΛද‫͠ݱ‬ɺҙຯͷ͋ΔͱԻઅͳͲͷࡉ͔ͳରԠ͕දࣔͰ͖ͣɺ‫ऀޙ‬͸࣌ؒ࣠ͷඇൃԻͷ୯Ґͱͯ͠ͷԻઅΛ༻͍Δɻͨͩ͠ɺද্ࣔͷจࣈઢ‫ܗ‬৳ॖʹΑͬͯԻ௕΍λΠϛϯάΛ೺Ѳ͠ʹ͍͘ɻ਺ͱԻઅͷ਺ʹ͸ҧ͍͕͋Δ͜ͱ͕ଟ͍ͨΊɺ·ͣ೔ຊ‫ޠ‬͸‫ܗ‬ଶૉɺӳ‫ޠ‬͸ۭനͰ۠੾ΒΕͨ୯‫ʹޠ‬෼ׂ͢Δɻͦͷ

2.4 ςΩετ༏ઌදࣔʴςΩετ୯Ґಛ௃‫ޙ‬ɺ‫ܗ‬ଶૉ΋͘͠͸ӳ୯‫ޠ‬ΛԻઅͷ਺Ͱ෼ׂͯ͠ѻ͏ɻςΩετͷදࣔΛ༏ઌͤͯ͞ɺൃ࿩಺༰ΛՄࢹԽ͢ΔҰ
ൠతͳํ๏ͱͯ͠ɺΧϥΦέʹ͓͚ΔՎࢺͷϋΠϥΠτද

3.1 ੍໿

͕ࣔ͋ΔɻͦͷΑ͏ͳදࣔʹؔ͢Δ‫ͯ͠ͱڀݚ‬͸ɺFujiharaςΩετͱԻ‫ڹ‬ಛ௃ྔΛ༥߹తʹՄࢹԽ͢ΔͨΊʹɺσet al. ʹΑΔՎࢺςΩετΛՎ੠ʹಉ‫ͤ͞ظ‬Δ LyricSyn-βΠϯʹ͓͍ͯҎԼͷ੍໿Λઃ͚Δɻ

chronizer [28] ΍ɺ͞ΒʹྨࣅՎࢺ΋දࣔͤ͞Δ Nakano etൃԻ࣌ࠁΛಉҰͷΧʔιϧͰද͢͜ͱ ൃԻ͞Ε͍ͯΔԻ

al. ͷ LyricListPlayer [29] ͳͲ͕ఏҊ͞Ε͖ͯͨɻ੠ʹରԠ͢ΔจࣈͱɺͦͷԻ‫ڹ‬ಛ௃ྔͷ࣌ࠁΛදͦ͢ͷଞɺจࣈྖҬ΁৘ใΛຒΊࠐΉ͜ͱͰɺςΩετͷ
දࣔҐஔΛԻ੠ͱಠཱʹσβΠϯͰ͖Δํ๏ͱͯ͠ɺจࣈ
ⓒ 2017 Information Processing Society of Japan*6

https://en.wikipedia.org/wiki/Shigin3Vol.2017-MUS-116 No.21
2017/8/26

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Report

テキスト

立ち止まる時

音響特徴軸

テキスト

横

立ち止まる時

縦方向に
拡張した
音響特徴軸

縦

縦

区分線形

円弧

ਤ 2

4 छྨͷՄࢹԽσβΠϯҊɻશͯʮൃԻ࣌ࠁΛಉҰͷΧʔιϧ

ਤ 3 ʮॎʯΛ֦ுͯ͠௓༂Λͳͨ͘͠σβΠϯҊɻ
テキストͰද͢ʯʮΧʔιϧ͕౳଎Ҡಈ͢Δʯͷೋͭͷ੍໿Λຬͨ͢ɻΧʔιϧʢͷ‫ػ‬ೳΛ࣋ͬͨද‫ݱ‬ʣ͕Ұͭʹ·ͱ·ͬͯ

立ち止まる時

縦方向に
拡張した
音響特徴軸

区分線形

͍Δ͜ͱɻͦΕͧΕ͕ಠཱʹද‫͞ݱ‬Ε͍ͯΔ৔߹ɺ࠶ੜલʹจࣈͱԻ‫ڹ‬ಛ௃ͷରԠؔ܎Λ೺Ѳ͢Δ͜ͱ͕Ͱ͖ͣɺ·ͨ࠶ੜதͷରԠ෇͚΋ࠔ೉Ͱ͋ΔɻΧʔιϧ͕౳଎Ҡಈ͢Δ͜ͱ Χʔιϧ͕౳଎Ͱಈͨ͘Ίʹ͸ɺԻ੠ͷ࣌ؒ࣠Λ৳ॖͳ͘อଘ͢Δඞཁ͕͋ΔɻͦΕʹΑͬͯɺൃԻλΠϛϯά΋ద੾ʹද‫͖Ͱݱ‬Δɻ

2.3 અʹ͓͚ΔɺςΩετͱԻ‫ڹ‬ಛ௃ͷซ‫ه‬͸લऀͷ੍໿Λ

ਤ 4 ʮ۠෼ઢ‫ܗ‬ʯΛ֦ுͯ͠௓༂Λͳͨ͘͠σβΠϯҊɻຬ͓ͨͯ͠ΒͣɺPetal et al. ʹΑΔ ReadN’KaraokeʢV2:ԻߴɾԻྔʣ[3] ͸‫ऀޙ‬ͷ੍໿Λຬ͍ͨͯ͠ͳ͍ɻ

Goﬃn et al. ͸ 7 छྨͷ഑ஔํ๏ΛఏҊ͕ͨ͠ [37]ɺʮߦ

Ҏ্ͷ੍໿Λຬͨ͢Α͏ʹ TextTimeline ΛσβΠϯؒ͢ʯ΁ͷ഑ஔ͕ɺ৘ใಉ࢜ͷॏͳΓ͕ͳ͘ɺςΩετදࣔΔඞཁ͕͋Δ͕ɺԣํ޲ͷςΩετʹରͯ͠Ի‫ڹ‬ಛ௃ͷ࣌ʹ੍໿͕গͳ͘ɺԻ‫ڹ‬ಛ௃ͷ֬ೝʹϚ΢εΦʔόʔͳͲͷؒ࣠ͱͯ͠͸ɺʮԣʯʮॎʯʮͦΕҎ֎ʯͷࡾछྨͷํ޲͕બΠϯλϥΫγϣϯΛཁ͞ͳ͍఺Ͱద͍ͯ͠Δͱ൑அͨ͠ɻ

୒ՄೳͰ͋Δʢৄࡉ͸ 3.3 અͰ‫ޙ‬ड़ʣɻ͜͜ͰɺԻ‫ڹ‬ಛ௃Λߦؒʹ഑ஔ͢ΔͨΊʹ͸ྖҬ͕ඞཁͱͳΓɺෳ਺ߦͷจࣈදࣔʹؔͯ͠͸Ұछͷ੍໿ͱͳΔɻ

3.2 ૉੑ

͔͠͠ɺͦͷྖҬͷαΠζ΍ҙຯ͕ɺԻ੠ʹґଘͯ͠มΘσβΠϯͷಛ௃Λٞ࿦͢ΔͨΊʹɺҎԼͷૉੑΛߟ͑Δɻ

Βͳ͚Ε͹ɺςΩετͷσβΠϯʹӨ‫͕ڹ‬গͳ͍ͱߟ͑Δɻ͜ΕΒ͸ɺಉ࣌ʹෳ਺Λຬͨ͢͜ͱ͕೉͍͠৔߹͕͋Δ͕ɺ৔߹ʹΑͬͯ͸ɺීஈ͸ߦؒΛંΓͨͨΜͰ͓͍ͨΓ [38]ɺ

࢖༻Մೳͳঢ়‫گ‬Λٞ࿦͢Δ͜ͱͰɺ࢖͍෼͚͕ՄೳͱͳΔɻԼͷߦʹॏ৞දࣔͤ͞ΔՄࢹԽΛߦ͑͹ [39]ɺ௨ৗͷςΩ͕࣌ؒ࣠ৗʹ‫͍͕ͯͬܨ‬Δ͔ ࢹઢͷҠಈྔΛ࠷খʹ͢Δετʹద༻ՄೳͰ͋ΔɻͨΊʹ͸ɺ͕࣌ؒ࣠ͭͳ͕͍ͬͯΔඞཁ͕͋Δɻ΋్͕࣌ؒ࣠͠தͰ్੾Ε͍ͯΔ৔߹ʢҎ߱ɺ௓༂ͱ‫Ϳݺ‬ʣɺϢʔβ͕࣍ͷҐஔΛ୳͢ඞཁ͕͋Γɺ৔߹ʹΑͬͯ͸ΧʔιϧΛ‫͏ࣦݟ‬Մೳੑ͕͋Δɻ

3.3 σβΠϯҊલઅ·ͰͰٞ࿦੍ͨ͠໿Λຬͨ͢Ի੠࣠ʹ͍ͭͯɺ4 छྨͷσβΠϯͱͯ͠ʮԣʯ
ʮॎʯʮ۠෼ઢ‫ܗ‬ʯʮԁ‫ހ‬ʯΛਤ 2͕࣌ؒ࣠ಉ͡ํ޲ʹಈ͔͘ Χʔιϧ͕ৗʹࠨ͔Βӈ΁ҠʹɺͦΕͧΕͷૉੑΛද 1 ͷ্ 4 ߦʹࣔͨ͠ɻʮԣʯ͸ɺς

ಈ͢ΔͳͲɺಉҰͷํ޲ʹಈ͘͜ͱͰɺͦΕͱ௚ަ͢Ωετͱಉ͡ԣํ޲ͷԻ੠࣠ΛɺԻઅ୯ҐͰʮվߦʯͨ͠

Δํ޲ʹಉ͡ҙຯΛ࣋ͨͤ΍͘͢ͳΓɺ݁Ռͱͯ࣠͠

σβΠϯҊͰ͋Δɻ͜ΕʹΑͬͯɺඇઢ‫ܗ‬৳ॖ͢Δ͜ͱͳ্ͷԻ‫ڹ‬ಛ௃Λൺֱ͠΍͘͢ͳΔɻ

͘ɺԻઅʹ߹Θͤͨ࣌ؒ࣠Λ࣮‫͖Ͱݱ‬Δ͕ɺվߦʹΑΔ௓

ՄࢹԽʹඞཁͳྖҬαΠζ ςΩετ෇ۙʹ৘ใΛຒΊࠐ༂Λ‫ؚ‬ΜͰ͠·͏ɻͦͷΑ͏ͳվߦΛͳͨ͘͢Ίʹɺ࣌ؒΉ৔߹ɺྖҬ͕ඞཁͱͳΔɻͦͷαΠζ͕େ͖͍ͱɺ

࣠Λʮॎʯʹ͢Δͱɺվߦ͸ෆཁͱͳΔ͕Իઅؒͷ௓༂͕ෳ਺ߦͷ৔߹ʹςΩετ༏ઌදࣔΛอͪʹ͍͘ɻ

࢒Δɻ͞Βʹɺ͜ͷ௓༂Λ‫ݮ‬Βͨ͢Ίʹʮ۠෼ઢ‫ܗ‬ʯΛɺʮՄࢹԽҐஔʯ΋ૉੑͱͯ͠ߟ͑ΒΕΔ͕ɺຊߘ͜ͷଞɺ௓༂Λͳͨ͘͢Ίʹʮԁ‫ހ‬ʯͷ͕࣮࣠‫ݱ‬ՄೳͰ͋ΔɻͰ͸શͯจࣈͷԼʢߦؒʣʹ഑ஔ͢ΔલఏͰͷٞ࿦Λߦ͏ɻ·ͣ͸͜ΕΒΛൺֱ͢Δͱɺʮԣʯ͸Իઅͷ௕͞ʹΑͬͯैདྷɺ಺༰ʹؔ࿈ͨ͠৘ใͷςΩετத΁ͷ഑ஔʹ͓͍ͯվߦͷ਺͕มΘͬͯ͠·͏ͨΊɺԻઅؒͷ௕͞ͷൺֱ͕೉ⓒ 2017 Information Processing Society of Japan4

Vol.2017-MUS-116 No.21
2017/8/26

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Reportද 1 ֤σβΠϯͷૉੑɿ࣠ʹ௓༂͠ͳ͍৔߹ɺΧʔιϧ͕ಉҰํ޲

テキスト

ʹҠಈ͢Δ৔߹ɺྖҬαΠζ͕૬ରతʹখ͍͞৔߹ʹ˓ɺͦΕҎ֎Λʷͱͨ͠ɻͨͩ͠ɺྖҬαΠζʹؔͯ͠ͷΈɺ ﬁsheye

再生カーソル࣠ͷσβΠϯ

௓༂ͳ͔͠

ಉҰํ޲͔

ྖҬαΠζ

ԣ

ʷ

˓

˓

ॎ

ʷ

˓

˓

۠෼ઢ‫ܗ‬

ʷ

ʷ

˓

ԁ‫ހ‬

˓

ʷ

˓

ॎʢ֦ுʣ

˓

˓

ʷ

۠෼ઢ‫ܗ‬ʢ֦ுʣ

˓

ʷ

ʷ

ॎʢﬁsheyeʣ˓˓˚۠෼ઢ‫ܗ‬ʢﬁsheyeʣ

˓

ʷ

˚

音声軸

view Λ࠾༻͢Δ͜ͱͰɺվળͰ͖ͨ͜ͱΛ˚Ͱࣔͨ͠ɻ

Fisheye viewによる拡大表示
音節単位で可視化ਤ 5ʮॎʯΛ֦ுͯ͠௓༂Λͳ͘͠ɺﬁsheye view Λಋೖͨ͠

TextTimeline ͷ࣮૷ը໘ɻ

ʹεΫϩʔϧදࣔ͞ΕΔɻςΩετԼ෦ͷ௚ઢ͕࠶ੜΧʔ͍͕͠ɺͦΕҎ֎͸ɺͲͷԻઅ͕௕͘ൃ੠͞Ε͍ͯΔ͔ΛࢹιϧͰ͋ΓɺԻ‫ڹ‬ಛ௃ྔ͕ΧʔιϧʹͨͲΓண͍ͨࡍʹɺʮԣʯʮॎʯʮ۠෼ઢ‫ܗ‬ʯʹ͸֮తʹ೺Ѳ͠΍͍͢ɻ͔͠͠ɺ

֘౰͢ΔԻ੠͕࠶ੜ͞ΕΔɻͦΕͧΕ௓༂͕ൃੜͯ͠͠·͏ɻ࠷΋௓༂͕গͳ͍ʮ۠෼
ઢ‫ܗ‬ʯΛ࣮૷ͯ֬͠ೝͨ͠ͱ͜Ζɺ௚ઢ্ʹ͓͍ͯ͸Χʔιϧ͸౳଎ʹҠಈ͢Δ͕ɺ௓༂͕‫·ؚ‬ΕΔ͜ͱͰ౳଎Ҡಈ

4.2 ΞϥΠϯϝϯτൃ ࿩ ͱ ς Ω ε τ จ ࣈ ͷ ର Ԡ ෇ ͚ ʹ ͸ ɺLyricSynchro-Λ‫͔ͨͬ͘ʹ͡ײ‬ɻ͕ͨͬͯ͠௓༂Λ൐͏ͱɺԻ੠࠶ੜத

nizer [28] ‫ ͼٴ‬LyricListPlayer [29] ͱಉ༷ͷख๏Λ༻͍ͨɻʹԻ‫ڹ‬ಛ௃Λ֬ೝ͠ʹ͍͘Մೳੑ͕͋ΔɻҰํɺʮԁ‫ހ‬ʯʹ۩ମతʹ͸ɺൃ࿩͞ΕͨԻ੠৴߸͔Β MFCCɺΔMFCCɺ͸௓༂͕‫·ؚ‬Εͳ͍͕ɺ͕࣠௚ઢͰͳ͘ͳΔͨΊɺ͜͜ʹΔ ύϫʔΛ 10ms ຖʹநग़͠ɺ೔ຊ‫ޠ‬Իૉͱӳ‫ޠ‬ԻૉͷԻ‫ڹ‬ಛ௃Λඳըͨ͠৔߹ʹൺֱ͠ʹ͍͘Մೳੑ͕͋Δɻ

HMM ʹ‫͍ͨͮج‬Ի‫ڹ‬Ϟσϧʢmonophone HMMʣΛ༻͍

͜͜Ͱɺ
ʮॎʯ
ʮ۠෼ઢ‫ܗ‬ʯΛॎํ޲ʹ֦ு͢Δͱ௓༂Λ‫׬‬ͯೝࣝͨ͠ɻ೔ຊ‫ޠ‬ͷಡΈ͸ MeCab [40] Ͱ‫ܗ‬ଶૉ‫ͼٴ‬ಡશʹͳ͘͢͜ͱ͕Ͱ͖ΔͨΊɺͦΕΒ 2 छྨͷσβΠϯΛ

ΈΛਪఆ͠ɺͦΕΛԻૉྻʹม‫ͨ͠׵‬ɻ·ͨɺӳ‫ޠ‬ͷಡΈ

ਤ 3 ‫ͼٴ‬ਤ 4 ʹɺૉੑΛද 1 ͷ 5,6 ߦ໨ʹࣔ͢ɻ͔ͦ͠͠

͸ The CMU Pronouncing Dictionary [41] Λ༻͍ͯಘͨɻ

ͷ··Ͱ͸ɺจࣈ਺͕૿͑Δ͝ͱʹྖҬαΠζ͕୯ௐ૿Ճ

Իઅͷ਺͸ɺ‫ܗ‬ଶૉɾ୯‫ޠ‬தͷ฼Իͷ਺ʹΑܾͬͯఆ͢

͢ΔͨΊɺจࣈ਺ʹґଘͤͣʹྖҬαΠζΛ‫ݻ‬ఆ͢ΔͨΊΔɻ೔ຊ‫͍ͯͭʹޠ‬͸ɺʮ฼Իʯ΋͘͠͸ʮࢠԻͱ฼ԻʯΛʹɺﬁsheye view (focus+context) ද‫ݱ‬Λ࠾༻ͯ͠ [32, 33]ҰͭͷԻઅͱͯ͠ѻͬͨɻӳ‫͍ͯͭʹޠ‬͸ɺ֤฼Իͷલ‫ޙ‬࣮૷ͨ͠ɻૉੑΛද 1 ͷ 7,8 ߦ໨ʹࣔ͢ɻ͜ͷΑ͏ʹͯ͠ͷࢠԻΛ෇༩ͨ͠෼ׂΛߦͬͨɻ͜ͷΑ͏ʹͯ͠ಘͨԻઅ

֦ுͨ͠ʮॎʯͷσβΠϯ͸ɺશͯͷૉੑʹ͓͍ͯɺ๬·ΛจࣈͱରԠ෇͚Δඞཁ͕͋Δ͕ɺӳ୯‫ޠ‬΍‫Ͳͳࣈ׽‬ɺจ͍͠ੑ࣭Λ͍࣋ͬͯΔɻࣈͷ‫ڥ‬քΛԻઅ৘ใ͔Β໌֬ʹܾΊΒΕͳ͍͜ͱ͕ଟ͍ɻ

Ҏ্͔Βɺຊ‫ڀݚ‬ͷ໨తʹ͓͍ͯ͸ ﬁsheye view Λಋೖͨ͠ʮॎʯͷ֦ுσβΠϯ͕ɺ૬ରతʹద͍ͯ͠Δͱߟ͑

ͦ͜Ͱɺ‫ܗ‬ଶૉɾ୯‫ޠ‬୯Ґͷจࣈ௕͞ΛԻઅ਺Ͱ౳෼ׂ͠
ͯɺจࣈද্ࣔͷ۠ؒͱͨ͠ʢਤ 5ʣɻΒΕΔɻ

4. ࣮૷‫ূݕͼٴ‬લষͰड़΂ͨΑ͏ʹɺﬁsheye view Λಋೖͨ͠ʮॎʯͷ

4.3 ϢʔβʹΑΔϑΟʔυόοΫ
TextTimeline ͷಛ௃Λ‫͢ূݕ‬ΔͨΊʹɺ6 ਓͷϢʔβ
ʢஉੑ 5 ਓ: U1-U4, U6ɺঁੑ 1 ਓ: U5ʣʹɺҎԼͷࡾछྨ

֦ுσβΠϯͷ࣮૷ը໘Λਤ 5 ʹࣔ͠ɺ͜ΕҎ߱͸͜ͷσͷΠϯλϑΣʔεΛ࢖༻ͯ͠΋Β͍ɺ‫ײ‬૝ΛಘͨɻβΠϯͷΠϯλϑΣʔεΛ TextTimeline ͱ‫Ϳݺ‬ɻຊষͰD1) ςΩετͱԻ੠ͷฒߦදࣔʢਤ 6ʣ͸ɺTextTimeline ͷ࣮૷ํ๏ͱɺͦͷ༗ޮੑΛ‫͢ূݕ‬Δɻ

D2) ද 1 ʹ͓͚Δʮॎʯʢਤ 6ʣ
D3) TextTimelineʢਤ 5ʣ

4.1 ΠϯλϑΣʔεຊ࣮૷Ͱ͸ɺԻྔΛ TextTimeline ্ʹඳըͨ͠ʢਤ 5ʣɻର৅Ի੠͸ɺAIST ϋϛϯάσʔλϕʔε [42] ʹ‫·ؚ‬ΕΔɺҰਓͷঁੑ͕Վͬͨೋͭͷ൐૗ͳ͠Վএͱͦͷ࿕ಡԻ੠Ͱ

֤Իઅʹ͓͚ΔԻྔ͸ɺࠨӈରশͳ෯Ͱද‫͞ݱ‬ΕɺԻઅͷ

͋ΔɻϢʔβ͸ D1ʙD3 Λ࢖͍ͳ͕ΒɺͦΕΒͷԻ੠Λ 20தԝʹηϯλϦϯά͞ΕΔɻԻ੠࣠Λॎʹͨ͜͠ͱͰɺԻ

෼ఔ౓ௌऔͨ͠ɻ

ྔΛࣔ͢ԣ෯͕૿͑ͯ΋ॏෳ͠ͳ͍ͨΊɺશͯͷԻઅͷԻྔ͸ɺൺֱՄೳͳΑ͏ʹಉ͡෯Ͱද‫ͨ͠ݱ‬ɻՄࢹԽ͞ΕͨԻ‫ڹ‬ಛ௃ྔ͸ɺԻ੠ͷ࠶ੜͱͱ΋ʹ্ํ޲ⓒ 2017 Information Processing Society of JapanಘΒΕͨϑΟʔυόοΫʢPros/ConsʣΛɺ·ͱΊͳ͕ΒҎԼʹࣔ͢ɻ·ͣൃԻλΠϛϯάʹؔͯ͠ɺैདྷσβΠϯͷ D1 ʹ͍ͭͯ͸ɺൃԻλΠϛϯά΍Իྔͷେখͷൺֱ

5

Vol.2017-MUS-116 No.21
2017/8/26

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical ReportϯҊΛൺֱͨ͠ɻͦͷத͔Βɺԣํ޲ͷςΩετʹରͯ͠ɺ

D1（従来デザイン）
再生カーソル（テキスト）

ͦΕͱ௚ަ͢Δॎํ޲ͷ࣌ؒ࣠Λઃఆͨ͠σβΠϯΛ࠾༻͠ɺ࣌ؒ࣠ͷ௓༂Λͳ͘͠ɺﬁsheye view ʹΑͬͯจࣈ਺
ʹґଘ͠ʹ͍͘ՄࢹԽྖҬͷ࣮૷ΛఏҊͨ͠ɻ࠷ऴతͳσβΠϯͰ͸ɺՄࢹԽʹඞཁͳྖҬαΠζ͕େ͖͘ͳ͕ͬͨɺීஈ͸ߦؒΛંΓͨͨΉ [38]ɺ΋͘͠͸Լͷߦʹॏ৞දࣔͤ͞ΔՄࢹԽ [39] ʹΑΓɺෳ਺ߦςΩετ΁ͷద༻΋Մೳͩͱߟ͍͑ͯΔɻ·ͨϢʔβ͔ΒͷϑΟʔυόοΫΑΓɺվળͷՄೳੑ͕ࣔࠦ͞ΕͨͨΊɺԻྔҎ֎

再生カーソル（音声）D2（音声軸の跳躍を含むデザイン）ͷԻ‫ڹ‬ಛ௃ྔͷՄࢹԽΛ‫ؚ‬Ίͯɺࠓ‫ޙ‬ͷ‫ڀݚ‬ΛਐΊ͍ͯ͘ɻಛʹɺԻߴͷՄࢹԽ͕՝୊Ͱ͋Δɻँࣙຊ‫ڀݚ‬ͷҰ෦͸ɺJSPS Պ‫ݚ‬අ JP17K12721 ͓Αͼ JST
ACCEL (JPMJAC1602) ͷࢧԉΛड͚·ͨ͠ɻ·ͨɺAISTϋϛϯάσʔλϕʔεΛ࢖༻͠·ͨ͠ɻࢀߟจ‫ݙ‬
再生カーソル（音声）ਤ6ఏҊσβΠϯ D3ʢTextTimelineʣͱൺֱ͢ΔͨΊͷɺैདྷσɻD2 ʹ͸࣌ؒ࣠ͷ௓༂βΠϯʢD1ʣ‫ͼٴ‬ൺֱσβΠϯʢD2ʣ

[1]

[2]

͕‫·ؚ‬ΕΔͨΊɺͦͷӨ‫ڹ‬Λௐࠪ͢Δ໨త͕͋Δɻ

͕෼͔Γ΍͍͢ͱ͍͏ίϝϯτͱͱ΋ʹɺʮจࣈͱԻྔͷ[3]ରԠ͕Θ͔Γʹ͍͘ (U1, U2, U3, U4 and U6)ʯͱ͍͏ίϝϯτΛಘͨɻͦΕʹରͯ͠ɺD3 ʹ͍ͭͯʮ֤Իઅͷλ[4]Πϛϯά͕༧ଌ͠΍͍͢ (U1, U2, U3 and U4)ʯͱ͍͏ίϝϯτ͕ಘΒΕͨɻ͜Ε͸ɺ͜Ε·Ͱͷߟ࡯ͱରԠ͢Δɻ
·ͨ D2 ʹ͍ͭͯ͸ɺແԻ‫ޙ‬ͷൃԻ։͕࢝෼͔Γʹ͍͘ͱ[5]͍͏ίϝϯτ͕͕͋ͬͨɺࠓճͷ࣮૷ʹ͓͍ͯແԻΛද‫ݱ‬͍ͯ͠ͳ͔ͬͨ͜ͱ͕‫ݪ‬ҼͰ͋ΔՄೳੑ͕͋Γɺࠓ‫ޙ‬վળ

[6]ͯ͠࠶֬ೝ͍ͨ͠ɻ
·ͨɺD3 ͷԻྔදࣔʹؔͯ͠͸ɺจࣈͱԻྔͷରԠ͕

[7]෼͔Γ΍͘͢ɺจࣈʹԊͬͯྲྀΕΔσβΠϯͷ৽͠͞΍ָ͠͞ʹؔ͢Δίϝϯτ͕͋ͬͨɻ͔͠͠ҰํͰɺϑϨʔζ͕௕͍৔߹ʹԻྔ͕‫͔ͨͬ͘ʹ͑ݟ‬ΓɺจࣈͱԻྔʹ‫཭ڑ‬͕͋ͬͯରԠ͕෼͔Γʹ͍͘ͱ͍͏ίϝϯτ΋͋Γɺվળ

[8]఺͕Ұ෦໌Β͔ʹͳͬͨɻ‫ʹٯ‬ɺD2 Ͱ͸จࣈͱԻྔͷରԠ͕෼͔Γ΍͘͢ɺ֤Իઅͷ௕͕͞೺Ѳ͠΍͍͢ͱ͍͏ίϝϯτ͕͋ͬͨ͜ͱ͔ΒɺD2 ͱ D3 Λ༥߹ͤͨ͞Α͏ͳද[9]ࣔʹΑͬͯɺΑΓվળͰ͖ΔՄೳੑ͕͋Δɻ

5. ͓ΘΓʹ

[10]ຊߘͰ͸ɺൃ࿩Λ൐͏จࣈςΩετͷՄࢹԽʹ͍ͭͯɺจࣈͷදࣔΛ༏ઌͤ͞ͳ͕Βɺͦͷൃ࿩Ի੠ͷ࣌ؒ࣠ΛՄࢹԽ͢Δ TextTimeline ΛఏҊͨ͠ɻԻ੠ͷ࣌ؒ࣠௨ΓʹɺςΩετͱԻ‫ڹ‬ಛ௃ྔΛ༥߹తʹՄࢹԽ͢ΔͨΊʹɺΠϯλϑΣʔεσβΠϯʹ੍͓͍ͯ໿Λઃ͚ͯ 8 छྨͷσβΠⓒ 2017 Information Processing Society of Japan[11]

Hoppe, D., Sadakata, M. and Desain, P.: Developmentof real-time visual feedback assistance in singing training: a review, Journal of computer assisted learning,
Vol. 22, pp. 308–316 (2006).
Moschos, F., Georgaki, A. and Kouroupetroglou, G.:
FONASKEIN: An Interactive Application Software for
the Practice of the Singing Voice, Proc. SMC 2016, pp.
326–331 (2016).
Patel, R. and Furr, W.: ReadN’Karaoke: Visualizing
Prosody in Children’s Books for Expressive Oral Reading, Proc. CHI 2011, pp. 3203–3206 (2011).
Rude, M.: Native-like Duration Ratio of Stressed vs.
Unstressed Syllables through Visualizing Prosody, Proc.
Speech Prosody 2012 (2012).
Minematsu, N., Okabe, K., Ogaki, K. and Hirose, K.:
Measurement of Objective Intelligibility of Japanese Accented English Using ERJ (English Read by Japanese)
Database, Proc. Interspeech 2011, pp. 1481–1484 (2011).
υφΤϦΫιϯɿӳ‫ޠ‬ͷϦζϜͱୈೋ‫ڭޠݴ‬ҭ΁ͷԠ༻ɼ೔ຊԻ‫ֶڹ‬ձࢽɼ Vol. 69, No. 4, pp. 184–190 (2013).
National Institute of Child Health and Human Development: Report of the National Reading Panel. TeachingChildren to Read: An Evidence-based Assessment of
the Scientiﬁc Research Literature on Reading and its
Implications for Reading Instruction, US Government
Printing Oﬃce (2000).
of Educational Progress (NAEP), N. A.:
Listening to Children Read Aloud:Oral Fluency,
http://nces.ed.gov/pubs95/web/95762.asp.
Sainio, M., Hyönä, J., Bingushi, K. and Bertram, R.:
The role of interword spacing in reading Japanese: An
eye movement study, Vision Research, Vol. 47, No. 20,
pp. 2575–2584 (2007).
த໺૱ࢠɼۚᖒ‫و‬೭ɼ຀‫ݪ‬ɹޭɼࠇ໦଎ਓɼ্ాҰ‫و‬ɼҪ໺लҰɼҏ෱෦ୡɿԻ੠ೝٕࣝज़Λར༻ͨ͠ࣈນఄࣔγεςϜͷ‫ؔ͢ʹ༻׆‬Δ‫ڀݚ‬ʕௌ֮ো֐ऀͷχʔζʹଈͨ͠ఄࣔํ๏ʕɼϝσΟΞ‫ڭ‬ҭ‫ڀݚ‬ɼVol. 5, No. 2, pp. 63–72(2008).
ଜా‫ًڡ‬ɼେ໺੣‫׮‬ɼদ‫ݪ‬ໜथɿಡΈ΍͍͢ࣈນੜ੒ͷͨΊͷߨԋςΩετ΁ͷվߦૠೖɼిࢠ৘ใ௨৴ֶձ࿦จ
ࢽɼVol. J92-D, No. 9, pp. 1621–1631 (2009).

6

Vol.2017-MUS-116 No.21
2017/8/26

৘ใॲཧֶձ‫ڀݚ‬ใࠂ
IPSJ SIG Technical Report

[12]

[13]
[14]

[15]

[16]

[17]

[18]

[19]

[20]

[21]

[22]

[23]

[24]
[25]

[26]

[27]

[28]

[29]

[30]
[31]

খྛ५ฏɼؔ‫ޱ‬ɹོɼ৽ງӳೋɼ઒ౢູ෉ɿจઅ୯ҐΛߟྀͨ͠จࣈ഑ஔͷ޻෉͕΋ͨΒ͢೔ຊ‫ࢠిޠ‬ϦʔμʔͷՄಡੑ޲্ɼਓ޻஌ೳֶձ࿦จࢽ 32(2A)ɼ Vol. 32, No. 2A,
pp. 1–24 (2017).
Fry, D. B.: Intuitive visualization of pitch and loudnessin speech, JASA, Vol. 27, pp. 765–768 (1955).
Kenmochi, H. and Ohshita, H.: VOCALOID – Commercial Singing Synthesizer based on Sample Concatenation, Proc. 8th Annual Conference of the International
Speech Communication Association (INTERSPEECH
2007) (2007).
த໺ྙ༃ɼ‫ޙ‬౻ਅ޹ɿVocaListenerɿϢʔβՎএͷԻߴ͓ΑͼԻྔΛਅࣅΔՎ੠߹੒γεςϜɼ৘ใॲཧֶձ࿦จ
ࢽɼVol. 52, No. 12, pp. 3853–3867 (2011).
߳ࢁਸ਼‫ܙ‬ɼத੢ɹকɼԬ෦ਅ࣮ɼઙপ࿨ࢤɼҏ౦Ұయɼҝ຤ོ߂ɼ‫ڮ‬ຊণາɿࢦಋऀ஌ࣝʹ‫߹ͮ͘ج‬এֶशࢧԉγεςϜͷߏஙͱͦͷධՁɼ৘ใॲཧֶձ࿦จࢽɼVol. 51,
No. 2, pp. 365–379 (2010).
Nakano, T. and Goto, M.: VocaReﬁner: An Interactive
Singing Recording System with Integration of Multiple
Singing Recordings, Proc. SMAC-SMC2013 (2013).
Howard, D. M. and Welch, G. F.: Microcomputerbased singing ability assessment and development, Applied Acoustics, Vol. 27, pp. 89–102 (1989).
ฏҪॏߦɼย‫د‬੖߂ɼҪ‫ޱ‬੐࢜ɿՎͷௐࢠ֎Εʹର͢Δ࣏ྍࢧԉγεςϜɼిࢠ৘ใ௨৴ֶձ࿦จࢽɼVol. J84-D-II,
No. 9, pp. 1933–1941 (2001).
Nakano, T., Goto, M. and Hiraga, Y.: MiruSinger: A
Singing Skill Visualization Interface Using Real-Time
Feedback and Music CD Recordings as Referential Data,
Proc. ISMW 2007, pp. 75–76 (2008).
Mayor, O., Bonada, J. and Loscos, A.: Performance
Analysis and Scoring of the Singing Voice, Proc. AES
35th International Conference (2009).
Abdul-Rahman, A., Lein, J., Coles, K., Maguire, E.,
Meyer, M., Wynne, M., Johnson, C. R., Trefethen, A.
and Chen, M.: Rule-based Visual Mappings – with aCase Study on Poetry Visualization, Proc. EuroVis 2013(2013).
Schaefer, R. S., Beijer, L. J., Seuskens, W., Rietveld,
T. C. M. and Sadakata, M.: Intuitive visualization ofpitch and loudness in speech, Psychonomic Bulletin &Review, Vol. 23, pp. 548–555 (2016).
Pietrowicz, M. and Karahalios, K. G.: Visualizing Vocal
Expression, Proc. CHI 2014 (2014).
Nakayama, M.: Fundamental research on a singing training support system for Shigin: Japanese traditional
singing, Proc. IEEE SoutheastCon 2012, pp. 1–6 (2012).
Rob Diaz-Marino, S. C. and Greenberg, S.: LyricText:
An Animated Display of Song Lyrics, Report iLab-20051, Grouplab, Dept. Compute Science, University of Calgary, pp. 3203–3206 (2005).
Kato, J., Nakano, T. and Goto, M.: TextAlive: Integrated Design Environment for Kinetic Typography,
Proc. CHI 2015, pp. 3403–3412 (2015).
Fujihara, H. et al.: LyricSynchronizer: Automatic Synchronization System Between Musical Audio Signals and
Lyrics, IEEE Journal of Selected Topics in Signal Processing, Vol. 5, No. 6, pp. 1252–1261 (2011).
Nakano, T. and Goto, M.: LyricListPlayer: A
Consecutive-Query-by-Playback Interface for Retrieving
Similar Word Sequences from Diﬀerent Song Lyrics,
Proc. SMC 2016, pp. 344–349 (2016).
Tufte, E.: Beautiful Evidence, Graphics Press (2006).
Oh, J.: Text Visualization of Song Lyrics, Center forⓒ 2017 Information Processing Society of Japan

[32]
[33]

[34]

[35]

[36]

[37]

[38]

[39]

[40]
[41]
[42]

Computer Research in Music and Acoustics (2010).
Furnas, G. W.: Generalized ﬁsheye views, Proc. ACM
CHI’86, pp. 16–23 (1986).
Rao, R. and Card, S. K.: The table lens: merging graphical and symbolic representations in an interactive focus+context visualization for tabular information, Proc.
ACM CHI’94, pp. 318–322 (1994).
দӜହਔɼ֯୩྄༞ɼळఉ༞‫و‬ɼੁপ༎ଠɼ٠઒༟໵ɼഅ
৔఩ߊɼ۲ࢁ‫ٱ‬ඒࢠɿ੠࣭ϰΟδϡΞϥΠβͷఏҊɼ৘ใॲཧֶձΠϯλϥΫγϣϯ 2012 ࿦จूɼpp. 451–456(2012).
੨໦ಯ‫ق‬ɼ‫ٶ‬Լ๕໌ɿSeekRopesɿෳ਺εϥΠμͱγʔΫϩʔϓʹΑΔԻ੍ָ࡞ɼ৘ใॲཧֶձΠϯλϥΫγϣϯ
2011 ࿦จूɼpp. 429–432 (2011).
ߴౢষ༤ɼࢁຊ‫ګ‬༟ɼதখ࿏‫ٱ‬ඒ୅ɿ୳ࡧతσʔλ෼ੳͷͨΊͷ࣌ؒతͳ֓‫ࡉৄͱ؍‬ͷද‫͓ݱ‬ΑͼΠϯλϥΫγϣ
ϯʹؔ͢Δ‫ڀݚ‬ɼ৘ใॲཧֶձ࿦จࢽɼVol. 44, No. 11,
pp. 2767–2777 (2003).
Goﬃn, P., Willett, W., Fekete, J.-D. and Isenberg, P.:
Exploring the Placement and Design of Word-Scale Visualizations, IEEE Trans. on Visualization and Computer
Graphics, Vol. 20, No. 12, pp. 2291–2300 (2014).
Yoon, D., Chen, N., Guimbretiere, F. and Sellen, A.:
RichReview: Blending Ink, Speech, and Gesture to Support Collaborative Document Review, Proc. UIST 2014(2014).
Chang, B.-W., Mackinlay, J. D., Zellweger, P. T. andIgarashi, T.: A Negotiation Architecture for Fluid Documents, Proc. UIST’98, pp. 123–132 (1998).
Kudo, T.: MeCab: Yet Another Part-of-Speech andMorphological Analyzer, http://mecab.sourceforge.net/.
at CMU, S.: The CMU Pronouncing Dictionary,
http://www.speech.cs.cmu.edu/cgi-bin/cmudict.
‫ޙ‬౻ਅ޹ɼ੢ଜ୓ҰɿAIST ϋϛϯάσʔλϕʔεɿՎ੠‫༻ڀݚ‬Իָσʔλϕʔεɼ৘ใॲཧֶձ‫ڀݚ‬ใࠂԻָ৘
ใՊֶ‫ڀݚ‬ձɼ2005-MUS-61, pp. 7–12 (2005).

7