情報処理学会第 79 回全国大会

5L-01ࢢൢԻָ CD Λ༻͍ͨϢʔβՎএʹ൐૗Ի͕ࣗಈ௥ै͢ΔεϚʔτΧϥΦέγεςϜ࿨ా ༤հ †தଜ ӫଠ ‡† ‫౎ژ‬େֶ ޻ֶ෦৘ใֶՊ1.

ࢳࢁ ࠀण ‡‡ ‫౎ژ‬େֶ େֶӃ৘ใֶ‫ڀݚ‬Պ ஌ೳ৘ใֶઐ߈͸͡ΊʹԻָͷָ͠Έํʹ͸ՎΛՎ͏͜ͱ͕‫·ؚ‬Ε͓ͯΓɼ͜ͷָ͠Έํͷ‫ܗ‬ଶͷҰͭʹΧϥΦέ͕͋ΔɽΧϥΦέ࢈‫Ͱۀ‬͸ɼ൐૗Իͷ࡞੒ʹɼࢢൢ CD Ի‫ݯ‬Λઐ໳Ո͕ࣖͰௌ͖ͳ͕ΒखಈͰָේ (MIDI ϑΝΠϧ) Λॻ͖‫ͱ͢͜ى‬͍͏ํ๏͕࠾ΒΕ͍ͯΔɽ͜ͷํ๏Ͱ͸ɼ1 ‫ۂ‬ͷ൐૗Իͷੜ੒ʹലେͳ࿑ྗ͕ඞཁͰ͋Δ͚ͩͰͳ͘ɼMIDI Λ༻͍ͯ߹੒ͨ͠൐૗Իͷ඼࣭͸‫ݩ‬ͷࢢൢ CD Ի‫ͯͬྼʹݯ‬
͠·͏ɽ·ͨɼ͋Δ‫ۂ‬ͷςϯϙΛࣗ෼ͷ޷ΈʹΞϨϯδͯ͠Վ͍͍ͨͱࢥͬͨͱ͖ʹɼΧϥΦέͰ͸खಈͰ൐૗ԻͷςϯϙΛมߋ͠ͳ͚Ε͹ͳΒͳ͍ɽ͜ͷͱ͖ɼϢʔβ͸൐૗ԻͷςϯϙΛௌ͖ͳ͕Βࣗ෼ͷ޷Έʹ߹͏͔Ͳ͏͔൑ఆ͠ɼςϯϙઃఆΛඍௐ੔͢Δඞཁ͕͋Γɼख͕͔͔ؒΔɽ͕ͨͬͯ͠ɼࢢൢ CD Ի‫ݯ‬ͷΈ͔Β൐૗ԻΛੜ੒͠ɼ൐૗ԻͷςϯϙΛࣗಈͰϢʔβՎএʹ௥ैͤ͞Δ͜ͱ͕Ͱ͖Ε͹ɼϢʔβ͸շదʹՎ͏͜ͱ͕Ͱ͖Δͱߟ͑ΒΕΔɽ͜Ε·Ͱɼࢢൢ CD Ի‫͔ݯ‬ΒΧϥΦέͷ൐૗ԻΛੜ੒͠ɼͦΕΛϢʔβՎএʹ௥ैͤ͞ΔγεςϜ͕͍͔ͭ͘ఏҊ͞Ε͍ͯΔɽྫ͑͹ɼָේ‫ͼٴ‬Վࢺ৘ใ͕‫ط‬஌Ͱ͋Δͱ͍͏લఏͷ΋ͱͰɼϢʔβ͕ՎএͷϐονΛมߋͨ͠ࡍʹɼͦΕʹ߹ͬͨϐονͷ൐૗ԻΛ MIDI Λ༻͍ͯ߹੒͢ΔΧϥΦέγεςϜ [1] ͕ఏҊ͞Ε͍ͯΔɽ·ͨɼָේ౳ͷࣄલ৘ใΛ༻͍ͣɼࢢൢ CD Ի‫͔ݯ‬ΒΧϥΦέͷ൐૗ԻΛੜ੒͠ɼͦͷϐονͱςϯϙΛࣗ༝ʹมߋͰ͖ΔΧϥΦέγεςϜ [2] ΋ఏҊ͞Ε͍ͯΔɽ͜ͷγεςϜͰ͸ɼࢢൢ CD Ի‫ݯ‬தͷϘʔΧϧԻΛ཈੍͢Δ͜ͱͰΧϥΦέͷ൐૗Ի͕ੜ੒͞ΕΔɽ൐૗Իͷϐονͱςϯϙͷมߋ͸ɼϢʔβ͕खಈͰߦ͏ɽຊߘͰ͸ɼࢢൢ CD Ի‫͔ݯ‬Β൐૗ԻΛੜ੒͠ɼ൐૗ͷςϯϙΛϢʔβՎএʹࣗಈͰ௥ैͤͯ͞࠶ੜ͢ΔΧϥΦέγεςϜΛఏҊ͢ΔɽຊߘͰఏҊ͢ΔγεςϜͰ͸ɼ·ͣࢢൢ CD Ի‫͔ݯ‬ΒԻ‫ݯ‬෼཭ख๏Λ༻͍ͯՎ੠ͱ൐૗Λ
෼཭͢Δɽ࣍ʹɼ෼཭͞ΕͨՎ੠Λ༻͍ͯɼ൐૗ΛϢʔβՎএʹࣗಈͰ௥ैͤͯ͞࠶ੜ͢Δɽ͜ͷΑ͏ͳΧϥΦέγεςϜΛ༻͍Δ͜ͱͰɼϢʔβ͸ CD Ի‫ݯ‬ͷΈΛ༻ҙ͢Ε͹ɼࣗ෼ͷ޷͖ͳ‫ۂ‬ΛՎ͏͜ͱ͕Ͱ͖Δɽ·ͨɼࣄલͷઃఆͳ͠ʹɼՎএͷςϯϙΛࣗ༝ʹΞϨϯδͯ͠Վ͏͜ͱ͕Ͱ͖Δɽ

2.

٢Ҫ ࿨Ղ ‡ϢʔβΠϯλʔϑΣʔεຊγεςϜͷ GUI Λਤ 1 ʹࣔ͢ɽCD Ի‫ݯ‬ͷԻ‫ݯ‬෼཭ͷਐ௙ঢ়‫֬گ‬ೝ΍ɼ൐૗Իͷ࠶ੜɾఀࢭɼԻྔௐ੔͕ՄೳͰ͋Δɽ

2.1 ԻָϑΝΠϧͷબ୒ਤ 1 ͷᒵ࿮Ͱғ·ΕͨϘλϯΛԡ͢ͱɼΧϥΦέͰՎָ͍͍ͨ‫ۂ‬ͷԻ‫ݯ‬ϑΝΠϧΛࢦఆͰ͖Δɽ‫Ͱ఺࣌ݱ‬͸ɼ
A Smart Karaoke System Based on Automatic Accompaniment for Singing
Voices of Users : Yusuke Wada, Eita Nakamura, Katsutoshi Itoyama, andKazuyoshi Yoshii (Kyoto Univ.)2-97ਤ 1: ϢʔβΠϯλʔϑΣʔεਤ 2: γεςϜͷશମ૾Ϟϊϥϧ WAV ϑΝΠϧͷΈΛαϙʔτ͍ͯ͠ΔɽԻ‫ݯ‬ϑΝΠϧ͕ࢦఆ͞ΕΔͱɼ͙͢ʹԻ‫ݯ‬෼཭Λ։࢝͢Δɽ෼཭ͷਐ௙ঢ়‫گ‬͸ɼϑΝΠϧબ୒෦෼ͷԼ෦ʹ͋ΔϓϩάϨεόʔʹදࣔ͞ΕΔɽ

2.2 Իָͷ࠶ੜɾఀࢭ
ਤ 1 ͷ੺࿮Ͱғ·ΕͨϘλϯΛԡ͢ͱɼ൐૗Իͷ࠶ੜ͕։࢝͢ΔɽϚΠΫ͔Βऔಘ͞ΕͨՎএͱ෼཭͞ΕͨՎ੠৴߸Λ༻͍ͯ൐૗ͷ৳ॖ৘ใΛ‫͠ࢉܭ‬ɼͦΕʹैͬͯϢʔβՎএʹ௥ै͢ΔΑ͏ʹ৳ॖ͞Εͨ൐૗Ի͕࠶ੜ͞ΕΔɽ·ͨɼਤ 1 ͷ੨࿮Ͱғ·ΕͨϘλϯΛԡ͢ͱɼ൐૗Իͷ࠶ੜ͕ఀࢭ͢Δɽ࠶ੜΛఀࢭ͔ͯ͠Β΋͏Ұ౓࠶ੜϘλϯΛԡ͢ͱɼ൐૗Ի͕࠷ॳ͔Β࠶ੜ͞ΕΔɽ
2.3 ൐૗ԻͷԻྔௐઅਤ 1 ͷ྘࿮Ͱғ·ΕͨεϥΠμʔʹΑΓɼ൐૗ԻͷԻྔΛௐ੔͢ΔɽϢʔβ͸ɼ͜ͷεϥΠμʔΛ༻͍͍ͯͭͰ΋൐૗ԻͷԻྔΛઃఆͰ͖Δɽ

3. γεςϜ࣮૷ຊ‫͢ݱ࣮Ͱڀݚ‬ΔγεςϜͷશମ૾Λਤ 2 ʹࣔ͢ɽҎԼͰ֤෦෼ͷಈ࡞ʹ͍ͭͯઆ໌͢Δɽ

3.1 Ի‫ݯ‬෼཭·ͣɼϢʔβ͕ೖྗͨ͠ CD Ի‫ݯ‬ΛɼՎ੠ͱ൐૗ʹ෼
཭͢Δඞཁ͕͋ΔɽຊγεςϜͰ͸ɼϢʔβͷ଴ͪ࣌ؒΛ௿‫ͤ͞ݮ‬ΔͨΊʹɼॲཧ࣌ؒΛӅณ͢Δ͜ͱ͕ॏཁͰ
͋Δɽͦ͜ͰɼຊγεςϜͰ͸ɼࡔ౦ΒʹΑΔϩόετ

Copyright 2017 Information Processing Society of Japan.
All Rights Reserved.

情報処理学会第 79 回全国大会

ඇෛ஋ߦྻ෼ղ [3] ΛΦϯϥΠϯԽͨ͠΋ͷΛ༻͍ͯɼΦϯϥΠϯͰͷԻ‫ݯ‬෼཭Λ࠶ੜͱಠཱͨ͠εϨουͰߦ͍ɼ෼཭݁ՌΛอଘ͢Δ͜ͱͰ͜ͷ՝୊Λղܾ͢Δɽ

3.2 ಛ௃ྔநग़ɾΞϥΠϯϝϯτԻ‫ݯ‬෼཭ʹΑͬͯಘͨ൐૗ΛϢʔβՎএʹ௥ैͤ͞ΔͨΊɼ൐૗ΛͲͷΑ͏ʹ৳ॖ͢Ε͹Α͍͔Λ‫͢ࢉܭ‬ΔɽຊγεςϜͰ͸ɼϢʔβՎ੠ͱ෼཭ͨ͠Վ੠ͦΕͧΕͷԻ৭৘ใΛɼಈత࣌ؒ৳ॖ๏ (DTW) ʹΑͬͯରԠ͚ͮΔ͜ͱͰ৳ॖ཰Λ‫ٻ‬ΊΔɽԻ৭৘ใͱͯ͠ɼਓؒͷ੠ಓಛੑΛද͢ಛ௃ྔͰ͋Γɼਓؒͷ฼Ի஌֮ͷಛ௃Λߟྀͨ͠ྔͰ͋Δϝϧप೾਺έϓετϥϜ܎਺ (MFCC) Λ༻͍Δɽ௨ৗͷ DTW ͸όονͰಈ࡞͢Δ͕ɼϢʔβͷ଴ͪ࣌ؒ௿‫ݮ‬ͷͨΊɼDTW ΛΦϯϥΠϯͰಈ࡞͢ΔΑ͏ʹվมͨ͠΋ͷΛ༻͍ΔɽҎԼʹɼΦϯϥΠϯ DTW ͷॲཧͷྲྀΕΛ‫ه‬ड़͢Δɽ
1. ϢʔβՎএͱɼԻ‫ݯ‬ͷ͋ΔҰ෦෼͔Β෼཭͞ΕͨՎ੠ͦΕͧΕͷ MFCC Λ‫͢ࢉܭ‬Δɽೖྗͷ௕͞͸ͲͪΒ΋ 4096 αϯϓϧͰ͋ΔɽͦΕͧΕͷ MFCC Λ
X = {x1 , x2 , · · · , xm }, Y = {y1 , y2 , · · · , yn } ͱॻ͘ɽ2. X, Y Λೖྗͱͯ͠ɼԼࣜʹैͬͯ DTW ߦྻΛ‫ܭ‬ࢉ͢Δɽ
d0,0 = 0, ds,0 = d0,t = ∞(1)(s = 1, 2, · · · , m; t = 1, 2, · · · , n)⎧⎪⎨di,j−1
di,j = ||xi − yj || + min di−1,j⎪⎩di−1,j−1(2)ͨͩ͠ɼ||xi − yj || ͸ɼxi ͱ yj ͷ‫཭ڑ‬Λද͠ɼຊ‫Ͱڀݚ‬͸ฏ‫ۉ‬ೋ৐‫ࠩޡ‬Λ༻͍Δɽ

3. ௨ৗͷ DTW ͱಉ༷ʹ DTW ߦྻΛόοΫτϥοΫ͠ɼରԠ͢Δ఺ରͷ‫ ྻܥ‬L = {o0 , o1 , · · · , ol }, oi =(oxi , oyi )(i = 0, 1, · · · , l; 0 ≤ oxi ≤ oxi+1 ≤ m; 0 ≤oyi ≤ oyi+1 ≤ n) Λ‫͢ࢉܭ‬ΔɽL Λϫʔϐϯάύεͱ‫Ϳݺ‬ɽ͜͜ͰɼLX = {ox0 , ox1 , · · · , oxl }, LY ={oy0 , oy1 , · · · , oyl } ͱ͢Δɽ
4. ϫ ʔ ϐ ϯ ά ύ ε L ͔ Β ৳ ॖ ཰ ͷ ‫ ྻ ܥ‬R =r0 , r1 , · · · , rn Λ‫͢ࢉܭ‬Δɽri ͸ɼ෼཭͞Εͨ൐૗ͷ i ൪໨ͷϑϨʔϜΛԿഒʹ৳ॖ͢Δ͔Λද͠ɼԼࣜʹैͬͯ‫͞ࢉܭ‬ΕΔɽLY தͷ i ͷ‫਺ݸ‬ri =(3)
LX தͷ i ͷ‫਺ݸ‬
3.3 ൐૗৳ॖ
2.3 અͰ‫ٻ‬Ίͨ৳ॖ཰ʹैͬͯ൐૗৴߸ΛɼϑΣʔζϘίʔμ [4] Λ༻͍ͯ৳ॖ͢ΔɽϑΣʔζϘίʔμΛ༻͍Δ͜ͱͰɼԻ੠ͷԻߴΛอͪͭͭ௕͞Λ৳ॖ͢Δ͜ͱ
͕Ͱ͖ΔɽͦͷࡍɼҐ૬͸ྡ઀͢ΔϑϨʔϜؒͷ੔߹ੑ͕ͱΕΔΑ͏ઢ‫ʹؒิܗ‬Αͬͯ༩͑Δɽ

4.

ਤ 3: ϫʔϐϯάύεͷൺֱͱ DTW ߦྻMFCC ͷ࣍‫ݩ‬͸ 12 ࣍‫ͨ͠ͱݩ‬ɽDTW ߦྻΛೱ୶Ͱදͨ͠΋ͷͱɼ௨ৗͷ DTW ͱΦϯϥΠϯ DTW ͷͦΕͧΕʹΑͬͯಘΒΕΔϫʔϐϯάύεΛɼਤ 3 ʹࣔ͢ɽ੺ઢ͕௨ৗͷ DTW ʹΑͬͯಘΒΕΔϫʔϐϯάύεΛɼࠇઢ͕ΦϯϥΠϯ DTW ʹΑͬͯಘΒΕΔϫʔϐϯάύεΛද͢ɽΦϯϥΠϯ DTW ͷϫʔϐϯάύε͸ɼ௨ৗͷ DTW ʹൺ΂ͯ͋·Γҳ୤͓ͯ͠Βͣɼଥ౰ͳ৳ॖ཰͕ಘΒΕΔͱߟ͑ΒΕΔɽ

5. ͓ΘΓʹຊߘͰ͸ɼೖྗ͞Εͨࢢൢ CD Ի‫͔ݯ‬Β൐૗ԻΛੜ੒͠ɼ൐૗ͷςϯϙΛϢʔβՎএʹࣗಈͰ௥ैͤͯ͞࠶ੜ͢ΔΧϥΦέγεςϜΛఏҊͨ͠ɽ࣮‫ݧ‬ͷ݁ՌɼΦϯϥΠϯ DTW ͰϢʔβՎএͱ‫ݩ‬ͷָ‫ۂ‬தͷՎএ͕֓Ͷਖ਼͘͠ΞϥΠϯϝϯτ͞Ε͍ͯΔ͜ͱ͕֬ೝͰ͖ͨɽҰํɼΦϯϥΠϯ DTW ͷఆྔධՁ΍γεςϜʹର͢ΔධՁ͕ෆे෼ͳͨΊɼϫʔϐϯάύεͷҰக཰ʹΑΔΦϯϥΠ
ϯ DTW ͷੑೳධՁͱɼඃ‫ʹݧ࣮ऀݧ‬ΑΔγεςϜͷධՁΛߦ͏༧ఆͰ͋Δɽ
ΠϯλϑΣʔε໘Ͱ͸ɼϢʔβʹର͢ΔϑΟʔυόοΫ͕ଘࡏ͠ͳ͍ͷͰɼϢʔβՎএͱ෼཭͞ΕͨՎ੠ͦΕͧΕͷ F0 ‫੻ي‬Λදࣔͤ͞Δ‫ػ‬ೳΛ௥Ճ͍ͨ͠ɽ·ͨɼϢʔβͷՎএΛิॿ͢ΔͨΊɼԋ૗Ґஔʹಉ‫ͯ͠ظ‬Վࢺ͕දࣔ͞ΕΔΑ͏ͳ‫ػ‬ೳͷ֦ுΛߟ͍͑ͯΔɽҰํɼΞϥΠϯϝϯτʹ΋ਫ਼౓޲্ͷ༨஍͕͋Δͱߟ͑ΒΕΔɽྫ͑͹ɼϐονʹؔ͢Δ৘ใΛಉ࣌ʹਪఆɾར༻͢Δ͜ͱͰਫ਼౓޲্͕‫ظ‬଴Ͱ͖Δɽ·ͨɼDTW ͱ͸ผͷύʔςΟΫϧϑΟϧλΛ༻͍ͯΞϥΠϯϝϯτΛ
ߦ͏ख๏ [5] ΋ఏҊ͞Ε͍ͯΔɽ͜ΕΒͷख๏Λ‫ࡏݱ‬ͷγεςϜͰར༻Ͱ͖Δ͔Ͳ͏͔Λ‫ݕ‬౼͢Δ༧ఆͰ͋Δɽँࣙ ຊ‫ڀݚ‬ͷҰ෦͸ɼJSPS Պ‫ݚ‬අ 24220006, 26700020, 26280089ɼ

16H01744, 16J05486, 15K16054ɼ JST CRESTɼJST ACCEL ͷࢧԉΛड͚ͨɽࢀߟจ‫ݙ‬[1] Wataru Inoue, Shunji Hashimoto, and Sadamu Ohteru. Adaptive karaoke system:
Human singing accompaniment based on speech recognition. ICMA, 1994.
[2] Hideyuki Tachibana, Yu Mizuno, Nobutaka Ono, and Shigeki Sagayama. A realtime audio-to-audio karaoke generation system for monaural recordings based onsinging voice suppression and key conversion techniques. IPSJ, 24(3):470–482,2016.
[3] ࡔ౦ ٓতΒ. ม෼ϕΠζଟνϟωϧ RNMF ʹ‫ͮ͘ج‬ॊೈࡧঢ়ϨεΩϡʔϩϘοτͷͨΊͷԻ੠‫ڧ‬ௐ. ೔ຊϩϘοτֶձ, 2016.

ධՁΦϯϥΠϯ DTW ͷੑೳΛධՁ͢ΔͨΊɼόον DTWʹΑͬͯಘΒΕΔϫʔϐϯάύεͱͷൺֱΛߦ͏ɽධՁʹ͸ɼҪ্ཅਫʮগ೥࣌୅ʯͷαϏ෦෼ͷ๯಄ 2 খઅ෼ (4.8 ඵ) ͱɼͦͷ෦෼ΛՎͬͨԻ‫ݯ‬Λ༻͍ͨɽ·ͨɼ

2-98[4] J.L. Flanagan and R.M. Golden. Phase vocoder. Bell System Technical Journal,
45:1493–1509, 1966.
[5] Nicola Montecchio and Arshia Cont. A unified approach to real time audio-toscore and audio-to-audio alignment using sequential montecarlo inference techniques. ICASSP, 2011.

Copyright 2017 Information Processing Society of Japan.
All Rights Reserved.