Proceedings SMC 2016 | 31.8. - 3.9.2016, Hamburg, Germany/<5,&/,673/$<(5 $ &216(&87,9(48(5<%<3/$<%$&.
,17(5)$&( )25 5(75,(9,1* 6,0,/$5 :25' 6(48(1&(6 )520',))(5(17 621* /<5,&6
7RPR\DVX 1DNDQR
0DVDWDND *RWR
1DWLRQDO ,QVWLWXWH RI $GYDQFHG ,QGXVWULDO 6FLHQFH DQG 7HFKQRORJ\ $,67  -DSDQ{t.nakano, m.goto}[at]aist.go.jp
Artist Name$%675$&7
7KLV SDSHU SUHVHQWV LyricListPlayer D PXVLF SOD\EDFN LQWHUIDFH IRU DQ LQWHUVRQJ QDYLJDWLRQ DQG EURZVLQJ WKDW HQ
DEOHV D VHW RI PXVLFDO SLHFHV WR EH SOD\HG EDFN E\ PXVLF]DSSLQJ EDVHG RQ O\ULFV ZRUGV ,Q RWKHU ZRUGV WKLV SDSHUSURSRVHV D QRYHO FRQFHSW ZH FDOO consecutive-query-byplayback ZKLFK LV IRU UHWULHYLQJ VLPLODU ZRUG VHTXHQFHVGXULQJ PXVLF SOD\EDFN E\ XVLQJ O\ULFV ZRUGV DV FDQGLGDWH
TXHULHV /\ULFV FDQ EH XVHG WR UHWULHYH PXVLFDO SLHFHV IURPWKH SHUVSHFWLYHV RI WKH PHDQLQJ DQG WKH YLVXDO VFHQH RI WKH
VRQJ $ XVHU RI /\ULF/LVW3OD\HU FDQ VHH WLPHV\QFKURQL]HGO\ULFV ZKLOH OLVWHQLQJ FDQ VHH ZRUG VHTXHQFHV RI RWKHU
VRQJV VLPLODU WR WKH VHTXHQFH FXUUHQWO\ EHLQJ VXQJ DQG
FDQ MXPS WR DQG OLVWHQ WR RQH RI WKH VLPLODU VHTXHQFHV $O
WKRXJK WKHUH DUH VRPH V\VWHPV IRU PXVLF SOD\EDFN DQG UH
WULHYDO WKDW XVH O\ULFV WH[W RU WLPHV\QFKURQL]HG O\ULFV DQG
WKHUH LV DQ LQWHUIDFH JHQHUDWLQJ O\ULFV DQLPDWLRQ E\ XVLQJNLQHWLF W\SRJUDSK\ /\ULF/LVW3OD\HU SURYLGHV D QHZ VW\OHRI PXVLF SOD\EDFN ZLWK O\ULFV QDYLJDWLRQ EDVHG RQ WKH OR
FDO VLPLODULW\ RI O\ULFV

ﬁ

F


2016

Tomoyasu

Nakanoetopen-accessarticledistributed

under

the

Creative Commons Attribution 3.0 Unported License,

al.

which

This

is

of

the

permits

unre-

terms

lyricstime

Retrieved results

Distance

I (Jeff Manning / Doing That Thing)
I (Betty / Angel Baby)
I (Donna Burke / Don't Lie To Me)

0.33
0.35
0.36

only you (Betty / Angel Baby)
3.77
forever You (Betty / I'll be there for you) 4.13
hurts you (Betty / Life)
5.93)LJXUH  &RQVHFXWLYHTXHU\E\SOD\EDFN /\ULF/LVW
3OD\HU XVHV O\ULFV ZRUG VHTXHQFHV FXUUHQWO\ EHLQJ VXQJDV FDQGLGDWH TXHULHV DQG VLPLODU ZRUG VHTXHQFHV IURP GLIIHUHQW VRQJ O\ULFV DUH LPPHGLDWHO\ XSGDWHG GXULQJ PXVLF
SOD\EDFNRU PHWDGDWD VXFK DV VRQJ WLWOHV DUH DYDLODEOH DV DUHUHWULHYHV EDVHG RQ D UHOHDVHG \HDU RU D GHFDGH PXVLF
JHQUH VFHQH VXSSRUWLYH ORYH VSULQJ RU VXPPHU 
UDQNLQJ DQG FRPPHQWV IURP OLVWHQHUV 6\QF3OD\HU>@ D TXHU\E\O\ULFV UHWULHYDO V\VWHP FDQ QDYLJDWHIURP D OLVW RI UHWULHYHG UHVXOWV WR WKH FRUUHVSRQGLQJPDWFKLQJ SRVLWLRQV ZLWKLQ WKH DXGLR UHFRUGLQJV•  FRQWHQWEDVHG UHWULHYDO VRQJOHYHO O\ULFV VLPLODULW\FODVVL¿FDWLRQ ± 5HWULHYLQJEURZVLQJ O\ULFV E\ ID
YRULWH O\ULFV YLD TXHU\E\H[DPSOH V\VWHPV /\ULFV
FDQ EH XVHG WR UHWULHYH VRQJV E\ YLVXDOL]LQJ PXVLF
DUFKLYHV >  @ DQG UHFRPPHQGHG VRQJV >@ $XWRPDWLF WRSLF GHWHFWLRQ >@ DQG VHPDQWLF DQDO\VLV >@ RI VRQJ O\ULFV KDYH DOVR EHHQ SURSRVHG 6HYHUDO DSSURDFKHV DQDO\]HG WKH WH[W RI O\ULFV E\ XVLQJQDWXUDO ODQJXDJH SURFHVVLQJ WR FODVVLI\ O\ULFV DFFRUG
LQJ WR HPRWLRQV PRRGV DQG JHQUHV >±@•  K\SHUOLQNLQJ O\ULFV >@ ± &UHDWLQJ D K\SHUOLQNIURP D ZRUG VHTXHQFH LQ WKH O\ULFV RI D VRQJ WR WKH
VDPH VHTXHQFH LQ WKH O\ULFV RI DQRWKHU VRQJ DQG XV
LQJ WKH K\SHUOLQN IRU QDYLJDWLQJGLVFRYHULQJ O\ULFV:H SURSRVH D PXVLF SOD\EDFN LQWHUIDFH LyricListPlayer
WKDW LV EDVHG RQ DQ H[WHQVLRQ RI D K\SHUOLQNLQJ O\ULFV V\V
WHP >@ 7KH SDSHU GHVFULELQJ WKDW WKH SUHYLRXV V\VWHP IRFXVHG RQ FUHDWLQJ NH\ZRUGEDVHG K\SHUOLQNV ZLWKRXW LQWHUDFWLRQ DQG MXVW PHQWLRQHG XVLQJ WKH K\SHUOLQNLQJ VWUXFWXUH
DV D EDVLV IRU LPDJLQJ DSSOLFDWLRQV ,Q FRQWUDVW ZH IRFXVHG
RQ FUHDWLQJ VLPLODULW\EDVHG K\SHUOLQNV ZLWK LQWHUDFWLRQ WR

6LQFH D VRQJ¶V O\ULFV FDQ EH XVHG WR FRQYH\ HPRWLRQVSDVVLRQVIHHOLQJVWKRXJKWV DQG WR IDFLOLWDWH LPDJLQH
YLVXDO VFHQHV WKH\ DUH DQ LPSRUWDQW HOHPHQW KHOSLQJ OLVWHQHUV KDYH HPRWLRQDO LQYROYHPHQW WR WKH VRQJ ,Q IDFW VRPH
OLVWHQHUV DUH DZDUH RI O\ULFV ZKLOH OLVWHQLQJ WR PXVLF DQG
XVH WKHP DV D FULWHULRQ IRU VHOHFWLQJ PXVLFDO SLHFHV >@/\ULFV DUH WH[WEDVHG LQIRUPDWLRQ DQG FDQ EH XVHG DV DUHWULHYDO TXHU\ E\ PXVLF SURIHVVLRQDOV DQG FDVXDO OLVWHQ
HUV ,QGHHG WKHUH DUH PDQ\ ZRUNV IRFXVLQJ RQ KRZ WR UH
WULHYHEURZVH PXVLF E\ XVLQJ O\ULFV >±@
3UHYLRXV ZRUNV LQYHVWLJDWLQJ WKH XVH RI O\ULFV LQ PXVLF
LQIRUPDWLRQ UHWULHYDO KDYH IRFXVHG RQ WKH IROORZLQJ WKUHHDSSURDFKHV•  NH\ZRUGEDVHG UHWULHYDO ± 5HWULHYLQJ O\ULFV E\ XV
LQJ WH[WEDVHG NH\ZRUGV RI PXVLF VHDUFK ZHE VLWHV 
5HWULHYHV EDVHG RQ D IXOOWH[W VHDUFK XVLQJ O\ULFV WH[Wan

I wanna kiss you

wanna (Betty / Weekend)
0.01
wanna (Donna Burke / Don't Lie To Me) 0.18
top (Jeff Manning / Doing That Thing) 11.78

 ,1752'8&7,21

Copyright:

Song title

Donna Burke / How Deep Is Your Love?

stricted use, distribution, and reproduction in any medium, provided the original
author and source are credited.
 ,Q WKHLU TXHVWLRQQDLUH LQYHVWLJDWLRQ  RI  VXEMHFWV VDLG WKH\ DUHXVXDOO\ FRQVFLRXV RI O\ULFV ZKLOH OLVWHQLQJ WR PXVLF DQG  RI  VXEMHFWVVDLG WKH\ RIWHQ FKRRVH VRQJV EDVHG RQ O\ULFV >@
 e.g. 0XVL;PDWFK https://www.musixmatch.com/

344

Proceedings SMC 2016 | 31.8. - 3.9.2016, Hamburg, Germany

Playlist controlls:
backward button, pause button,
playback button, forward button,
and music timeline slider

Drop-down menu to change
the number of words N
for computing similarity

Drop-down menu to change
the consideration about odering
N words (consider or not)for computing similarity

playlist
the lyrics currently being sungthe lyrics currently being sunghighlocal similarity
low

Lyric list: a list of lyrics ordered based on local similarity

Clicked history for zapping
Can be clicked to jump
to the position before zapping)LJXUH  $Q H[DPSOH /\ULF/LVW3OD\HU VFUHHQ :KHQ WKH TXHU\ D ZRUG FXUUHQWO\ EHLQJ VXQJ LV ³PRRQ´ WKH LQWHUIDFH FDQUHWULHYH ³VKLQHV´ ³UDLQ´ ³OLJKW´ DQG ³VXQ´
OLQNHG UHODWLRQVKLSV EHWZHHQ VRQJV FDQ SURYLGH D QHZ SHUVSHFWLYH DV D FRPELQDWLRQ RI D SDVVLYH PXVLF UHWULHYLQJ LQWHUIDFH DQG DQ DFWLYH PXVLF OLVWHQLQJ LQWHUIDFH >@ D FRPELQDWLRQ ZLWK ZKLFK D XVHU FDQ EURZVH DQG GLVFRYHU VRQJV
E\ MXVW OLVWHQLQJ WR PXVLF DQG FOLFNLQJ D VLPLODU ZRUG VH
TXHQFH WR MXPS WR OLVWHQ IURP WKHUH
)LJXUH  VKRZV WKH /\ULF/LVW3OD\HU VFUHHQ $ PXVLF
SOD\OLVW LV VKRZQ DW WRS RI WKH ¿JXUH 7KH LQWHUIDFH GLVSOD\V QRW RQO\ WKH O\ULFV RI WKH VRQJ FXUUHQWO\ SOD\HG EDFNVRQJ )LJ  WRS EXW DOVR LWV VLPLODU O\ULFV OLVW )LJ 
ERWWRP  7KH WRS RI WKH OLVW VKRZV WKH O\ULFV RI WKH VRQJFXUUHQWO\ SOD\HG EDFN DQG WKH RWKHU OLVWHG O\ULFV DUH RU
GHUHG EDVHG RQ ORFDO VLPLODULW\ RI ODWHQW WRSLFV 7KH OLVWLV FDOOHG D ³O\ULF OLVW´ LQ WKLV SDSHU +HUHDIWHU DOO O\ULFVLQ VFUHHQVKRWV LOOXVWUDWHG LQ WKLV SDSHU DUH WDNHQ IURP WKH
5:& 0XVLF 'DWDEDVH 3RSXODU 0XVLF >@ 7ZHQW\ VRQJV
5:&0'%3 1RV± DUH XVHG DV D SOD\OLVW DQG WKHO\ULF OLVW LV DOVR HVWLPDWHG IURP WKH VRQJV/\ULF/LVW3OD\HU SURYLGHV WKH IROORZLQJ WKUHH IXQFWLRQV GLVSOD\ PXVLFV\QFKURQL]HG O\ULFV GLVSOD\ PXVLFV\QFKURQL]HG O\ULF OLVW O\ULFV ]DSSLQJ LQWHUDFWLRQLQFUHDVH D SRWHQWLDO RI WKH V\VWHP /\ULF/LVW3OD\HU FRPSXWHV ZRUGVHTXHQFHOHYHO VLPLODULW\ WR FRYHU OLQNLQJ QRWRQO\ LGHQWLFDO ZRUG VHTXHQFHV EXW DOVR VLPLODU VHTXHQFHV,W DOVR LQFUHDVHV WKH ÀH[LELOLW\ RI UHWULHYDO E\ OHWWLQJ XVHUVFKDQJH WKH OHQJWK QXPEHU RI ZRUGV DQG RUGHU RI WKH VH
TXHQFH XVHG IRU FRPSXWLQJ VLPLODULW\
7KXV /\ULF/LVW3OD\HU KDV D SRWHQWLDO WR SURYLGH D QHZ
LPPHUVLYH VW\OH RI PXVLF SOD\EDFN RQ WKH Music Web
ZKHUH VRQJV DUH K\SHUOLQNHG WR HDFK RWKHU RQ WKH EDVLVRI WKHLU O\ULFV >@ /\ULFV ZRUG VHTXHQFHV FXUUHQWO\ EH
LQJ VXQJ FDQ EH LVVXHG DV FDQGLGDWH TXHULHV DXWRPDWLFDOO\DQG UHWULHYHG UHVXOWV DUH LPPHGLDWHO\ XSGDWHG GXULQJ PXVLF
SOD\EDFN :H FDOO WKLV QRYHO FRQFHSW RI PXVLF LQIRUPDWLRQUHWULHYDO FRQVHFXWLYHTXHU\E\SOD\EDFN )LJ  
7KH LQWHUIDFH GLVSOD\V WLPHV\QFKURQL]HG O\ULFV DQG XVHVO\ULFV ZRUGV RI D VRQJ FXUUHQWO\ EHLQJ SOD\HG EDFN DV
D TXHU\ /\ULF/LVW3OD\HU FDQ DOVR UHWULHYH ORFDO VLPLODUO\ULFV DQG WKH\ FDQ EH SOD\HG EDFN WR FKHFN VXQJ VW\OH YR
FDO WLPEUH DQG PHORG\ DQGRU VXQJ FRQWH[W VWRU\ RI WKHO\ULFV  6LPLODU O\ULFV ZKLFK OLNH WKH FXUUHQWO\ VXQJ O\ULFVDUH FKDQJHG IURP PRPHQW WR PRPHQW DUH DOVR GLVSOD\HG
DQG WKH\ FDQ EH FOLFNHG WR OLVWHQ WR WKHP LPPHGLDWHO\ 7R
FRPSXWH O\ULFV VLPLODULW\ ODWHQW PHDQLQJV WRSLFV EHKLQG
WKH ZRUGV DUH HVWLPDWHG 7KH LQWHUIDFH FDQ UHWULHYH ZRUGVWKDW DUH LQ VRPH ZD\ VLPLODU WR D TXHU\ ZRUG :KHQ WKH
TXHU\ LV ³DQJHO´ IRU H[DPSOH WKH LQWHUIDFH FDQ UHWULHYH³VQXJJOH´ DQG ³ORYH´ 'LVSOD\ PXVLFV\QFKURQL]HG O\ULFV DQG O\ULF OLVWVLPLODU ZRUG VHTXHQFHV
7KH ZRUG FXUUHQWO\ EHLQJ VXQJ LV KLJKOLJKWHG E\ EOXH FRORULQJ VR WKDW DV LQ NDUDRNH D XVHU FDQ HDVLO\ IROORZ WKH
FXUUHQW SOD\EDFN SRVLWLRQ $V LWV UHWULHYHG UHVXOWV WKH VLPLODU ZRUG VHTXHQFHV DUH FRORUHG PDJHQWD )LJ  
7KH UDQJH RI FRORULQJ LV GHWHUPLQHG E\ WKH OHQJWK RI WKHZRUG VHTXHQFH N WKH QXPEHU RI PRUSKHPHV RU ZRUGVFRQVLGHUHG IRU FRPSXWLQJ ORFDO VLPLODULW\ 7KH ORFDO VLPLODULW\ RI WKH O\ULFV RI WKH O\ULF OLVW LV FKDQJHG EDVHG RQ N
DQG ZKHWKHU RU QRW WKH RUGHULQJ LV FRQVLGHUHG )RU H[DP /<5,&/,673/$<(5 $1 ,17(5)$&( )25
48(5< &$1','$7(6 *(1(5$7,21 %< 086,&
3/$<%$&.
/\ULF/LVW3OD\HU LV D PXVLF SOD\EDFN LQWHUIDFH IRU D VHW RIVRQJV DQG VLPLODU ZRUG VHTXHQFHV IURP WKH VRQJ FXUUHQWO\
EHLQJ SOD\HG EDFN DUH GLVSOD\HG ,QWHUDFWLRQ DQG K\SHU

345

Proceedings SMC 2016 | 31.8. - 3.9.2016, Hamburg, Germany

Word coloring of the playback lyrics and their similar word sequences
are changed from moment to moment
local lyrics N = 2

Consecutive-query-by-playback(In this example, two words are selected)

forwardbuttonforwardbutton

backward
buttonbackward
buttonlocal similar lyricstime User can check by clicking and the forward button or using the music timeline slider User can check by clicking the backward button or using the music timeline sllider)LJXUH  $Q H[DPSOH RI FKDQJLQJ SOD\EDFN SRVLWLRQ DQG VLPLODU ZRUG VHTXHQFHV DORQJ ZLWK WKH SOD\EDFN ZRUGWR D VRQJ SOD\HG EDFN EHIRUH ]DSSLQJ ,Q DGGLWLRQ DV D
SRWHQWLDO RI WKH O\ULF OLVW WKH VLPLODU ZRUG VHTXHQFHV FDQ
EH SOD\HG EDFN FRQWLQXRXVO\ WR JHW DQ RYHUYLHZ RI WKH VH
TXHQFHV VXQJ E\ GLIIHUHQW DUWLVWV RU FRQWH[WV

SOH LI WKH RUGHULQJ LV QRW FRQVLGHUHG WKH ZRUG VHTXHQFH³$ % &´ LQ D VRQJ KDV WKH VDPH VLPLODULW\ DV WKH VHTXHQFH³$ & %´ LQ WKH VDPH VRQJ )LJXUH  DQG  VKRZ VLPLODUZRUG VHTXHQFHV ZLWK GLIIHUHQW FRQGLWLRQV GLIIHUHQW N DQGZLWK RU ZLWKRXW FRQVLGHUDWLRQ RI WKH ZRUGV¶ RUGHULQJ
7KH FRORULQJ GHVLJQ LV GLIIHUHQW IURP WKDW XVHG LQ WKH LQWHUIDFH /\ULF6\QFKURQL]HU DQG WKRVH XVHG LQ ZHOONQRZQNDUDRNH V\VWHPV /\ULF/LVW3OD\HU FRORUV WKH ZRUG PRUSKHPH FXUUHQWO\ VXQJ DQG WKH VXEVHTXHQW N − 1 ZRUGV
7KH UHDVRQ IRU WKLV FRORULQJ GHVLJQ LV WR VKRZ LQIRUPDWLRQDERXW ERWK WKH FXUUHQW SOD\EDFN SRVLWLRQ¶ DQG WKH OHQJWKFXUUHQWO\ XVHG WR FRPSXWH ORFDO VLPLODULW\¶ 7R VKRZ WKH
FRQWH[W RI WKH VLPLODU ZRUG VHTXHQFHV LQ WKH O\ULF OLVW WKH
SUHYLRXV DQG QH[W ZRUGV DUH DOVR GLVSOD\HG
7KH OHQJWK RI WKH ZRUG VHTXHQFH WKH QXPEHU RI ZRUGVDQG ZKHWKHU RU QRW RUGHULQJ LV FRQVLGHUHG LQ FRPSXWLQJVLPLODULW\ FDQ EH FKDQJHG E\ XVLQJ WKH WZR GURSGRZQPHQXV DW WKH WRS RI WKH VFUHHQ )LJ  WRS  7KH FXUUHQW
SOD\EDFN SRVLWLRQ FDQ EH FKDQJHG E\ XVLQJ WKH IRUZDUG
DQG EDFNZDUG EXWWRQV WR MXPS WR WKH QH[WSUHYLRXV ZRUG
PRUSKHPH RU E\ XVLQJ WKH PXVLF WLPHOLQH VOLGHU ,03/(0(17$7,21
7KH V\VWHP ¿UVW V\QFKURQL]HV WKH SKRQHPHOHYHO SURQXQFLDWLRQ RI WKH O\ULFV ZLWK WKH PXVLFDO DXGLR VLJQDOV IRU DOO WKH
VRQJV LQ WKH SOD\OLVW 7KH HVWLPDWHG RQVHW WLPH DQG GXUDWLRQV RI DOO SKRQHPHV DUH FRQYHUWHG WR PRUSKHPHOHYHO IRU-DSDQHVH O\ULFV DQG WR ZRUGOHYHO IRU (QJOLVK O\ULFV 7KLVV\QFKURQL]DWLRQ LV FDOOHG lyrics alignment
7KHQ WR FRPSXWH VLPLODULW\ EHWZHHQ ZRUGV WKH V\VWHP
HVWLPDWHV WKH ODWHQW WRSLFV RI O\ULFV )LQDOO\ WKH V\VWHP FDOFXODWHV VLPLODULW\ DPRQJ DOO ZRUG VHTXHQFHV ZLWK GLIIHUHQW
N LQ WKH UDQJH N = 1, 2, ..., 5 7KH LQGH[HV RI  ZRUG
VHTXHQFHV KDYLQJ KLJK VLPLODULW\ IRU HDFK ZRUG VHTXHQFH
DUH VWRUHG IRU GLVSOD\ RQ WKH O\ULF OLVW VFUHHQ 7KLV LQWHUIDFHVXSSRUW -DSDQHVH DQG (QJOLVK O\ULFV DQG -DSDQHVH O\ULFVDUH VSHOOHG LQ D PL[WXUH RI -DSDQHVH SKRQHWLF FKDUDFWHUV
DQG &KLQHVH FKDUDFWHUV /\ULFV ]DSSLQJ LQWHUDFWLRQ /\ULFV DOLJQPHQW

7KH XVHU FDQ VKRZ WKH VXQJ O\ULFV DQG WKHLU VLPLODU ZRUG
VHTXHQFHV ZKLOH OLVWHQLQJ WR PXVLF 7KLV LV D NLQG RI passive PXVLF LQIRUPDWLRQ UHWULHYDO EHFDXVH WKH XVHU GRHV QRWLQSXW D TXHU\ H[SOLFLWO\DFWLYHO\2Q WKH RWKHU KDQG WKH GLVSOD\HG VLPLODU ZRUG VHTXHQFHV
FDQ EH FOLFNHG IRU ]DSSLQJ WR MXPS WR OLVWHQ IURP WKDW SRLQW)LJ   7KH ]DSSLQJ KLVWRU\ LV GLVSOD\HG DW WKH ULJKWVLGH RI WKH VFUHHQ )LJ  DQG FDQ EH FOLFNHG WR EDFN

7KH SKRQHWLFWRDXGLR V\QFKURQL]DWLRQ LV HVWLPDWHG
WKURXJK 9LWHUEL DOLJQPHQW ZLWK D SKRQHPHOHYHO KLGGHQ 0DUNRY PRGHO PRQRSKRQH +00 WKDW LV XVHG DV
DQ DFRXVWLF PRGHO :H WUDLQHG -DSDQHVH DQG (QJOLVKPRQRSKRQH +00V E\ XVLQJ WKH 5:& 0XVLF 'DWDEDVH
3RSXODU 0XVLF >@ ZLWK RXU RZQ SKRQHWLF DQQRWDWLRQV -DSDQHVH VRQJV DUH XVHG WR WUDLQ D -DSDQHVH DFRXVWLFPRGHO DQG  (QJOLVK VRQJV DUH XVHG WR WUDLQ DQ (QJOLVKDFRXVWLF PRGHO +HUH ZH UHIHU WKLV VRQJ VHW DV WKH 5:&

 ,Q WKH FXUUHQW LPSOHPHQWDWLRQ WKH VDPH ZRUG VHTXHQFHV RI GLIIHUHQW
VRQJV KDYH GLIIHUHQW VLPLODULWLHV

346

Proceedings SMC 2016 | 31.8. - 3.9.2016, Hamburg, Germany
Examples of consideration of the order of the words（N = 1 - 4）

Examples of no consideration of the order of the words（N = 2 - 5）

The number of words N = 1

The number of words N = 2 playback lyrics

playback lyrics

N=2

similarword sequences

N=3

playback lyrics

N=3

similarword sequences

N=4

N=4

similarword sequences

playback lyrics

N=5

similarword sequences)LJXUH  ([DPSOHV RI GLIIHUHQW N  WKH OHQJWK RI WKH ZRUG
VHTXHQFH QXPEHU RI PRUSKHPHV RU ZRUGV IRU FRPSXWLQJORFDO VLPLODULW\ ZLWK FRQVLGHUDWLRQ RI WKH RUGHULQJ RI WKHZRUGV

)LJXUH  ([DPSOHV E\ GLIIHUHQW N  WKH OHQJWK RI WKH ZRUG
VHTXHQFH QXPEHU RI PRUSKHPHV RU ZRUGV IRU FRPSXWLQJORFDO VLPLODULW\ ZLWK QR FRQVLGHUDWLRQ RI WKH RUGHULQJ RIWKH ZRUGV

0'%
7R WUDLQ WKH DFRXVWLF PRGHOV WKH SURQXQFLDWLRQ LV HVWL
PDWHG E\ XVLQJ WKH -DSDQHVH ODQJXDJH PRUSKRORJLFDO DQDO\]HU 0H&DE >@ DQG WKH &08 SURQRXQFLQJ GLFWLRQDU\
IRU (QJOLVK O\ULFV 7KH DFRXVWLF IHDWXUHV DQG DOLJQPHQWPHWKRG DUH EDVHG RQ WKRVH XVHG LQ /\ULF6\QFKURQL]HU >@:LWK UHJDUG WR WKH DFRXVWLF IHDWXUHV ZH WDUJHW PRQDXUDO
N+] GLJLWDO UHFRUGLQJV DQG H[WUDFW ΔSRZHU WKRUGHU0)&&V DQG WKRUGHU Δ0)&&V HYHU\  PV 7R HVWLPDWH WKH IHDWXUHV ZH SHUIRUPHG VHSDUDWLRQ RI YRFDOV IURPSRO\SKRQLF PXVLFDO DXGLR VLJQDOV >@

VXQJ E\  DUWLVWV IURP 0XVLF /\ULFV 'DWDEDVH Y 
 (QJOLVK VRQJV IURP FRPPHUFLDO PXVLF &'V DQG  (Q
JOLVK O\ULFV RI WKH 5:& 0XVLF 'DWDEDVH  IURP 3RSXODU
0XVLF  IURP 5R\DOW\)UHH 0XVLF DQG  IURP 0XVLF*HQUH > @ DUH XVHG
)RU WKH WRSLF PRGHOLQJ DOO PRUSKHPHV RI -DSDQHVH DUH
FRQYHUWHG WR WKH RULJLQDO IRUP E\ XVLQJ WKH 0H&DE IRU-DSDQHVH O\ULFV 6\PEROV VXFK DV SXQFWXDWLRQ PDUNV DQG
H[FODPDWLRQ PDUNV DUH XVHG IRU PRGHO WUDLQLQJ EHFDXVH
WKH\ FDQ EH XVHG WR H[SUHVV HPRWLRQV RU IHHOLQJV )LQDOO\WKH YRFDEXODU\ VL]H LQ WKH  -DSDQHVH O\ULFV LV ZRUGV PRUSKHPHV  DQG WKH YRFDEXODU\ VL]H LQ WKH (QJOLVK O\ULFV LV  ZRUGV

 7RSLF PRGHOLQJ:H XVH ODWHQW 'LULFKOHW DOORFDWLRQ /'$ >@ IRU O\ULFVWRSLF PRGHOLQJ 6LQFH WKH /'$ ZDV RULJLQDOO\ SURSRVHG
IRU WH[W DQDO\VLV LW FDQ EH XVHG IRU O\ULFV PRGHOLQJ ,Q IDFWWKHUH DUH WKUHH SDSHUV RQ ZRUN WKDW XVHG O\ULFV IRU /'$
EDVHG PXVLF UHWULHYDO >  @ 7KH QXPEHU RI WRSLFV K
LV VHW WR 100 DQG WKH PRGHO SDUDPHWHUV RI /'$ DUH WUDLQHG
XVLQJ WKH FROODSVHG *LEEV VDPSOHU >@ 7KH FRQGLWLRQV DUH
EDVHG RQ SUHYLRXV ZRUN > @
7KH VRQJ VHW XVHG IRU -DSDQHVH PRGHO WUDLQLQJ LV -DSDQHVH SRSXODU VRQJV DQG  O\ULFV RI WKH 5:& 0'%7KH -DSDQHVH SRSXODU VRQJV DSSHDUHG RQ D SRSXODU PXVLF FKDUW LQ -DSDQ DQG ZHUH SODFHG LQ WKH WRS WZHQW\ RQ
ZHHNO\ FKDUWV DSSHDULQJ EHWZHHQ  DQG  7KH VRQJ
VHW XVHG IRU (QJOLVK PRGHO WUDLQLQJ LV  (QJOLVK VRQJV

 6LPLODULW\ FRPSXWLQJ%\ XVLQJ D YDULDWLRQDO %D\HVLDQ LQIHUHQFH RI WKH /'$PRGHO WUDLQLQJ WKH responsibility PL[LQJ ZHLJKWV RIPXOWLSOH WRSLFV IRU HDFK ZRUG FDQ EH HVWLPDWHG 7KHQ WKHUHVSRQVLELOLWLHV RI D ZRUG FDQ EH LQWHUSUHWHG DV WKH QXPEHU RI REVHUYDWLRQV RI WKH FRUUHVSRQGLQJ WRSLF 7R REWDLQUHVSRQVLELOLWLHV XQLJUDP SUREDELOLWLHV IRU D VHW RI ZRUGVZLWK WKH OHQJWK N RI  RU PRUH ZLWKRXW FRQVLGHUDWLRQ RI
WKH RUGHULQJ WKH ZRUG¶V UHVSRQVLELOLWLHV DUH VXPPHG )LJ  6LQFH WKLV VXPPLQJ DSSURDFK FDQ EH XVHG WR FRPSXWH
VLPLODULW\ EHWZHHQ WZR VHWV RI ZRUGV ZLWK GLIIHUHQW N  LW
FDQ DOVR EH XVHG WR FRPSXWH VLPLODULW\ EHWZHHQ WZR OLQHV
6LQFH HDFK WRSLF FDQ EH UHSUHVHQWHG E\ D XQLJUDP SURE
DELOLW\ RI WKH YRFDEXODU\ WKH GLVWDQFH EHWZHHQ WZR ZRUGV http://www.speech.cs.cmu.edu/cgi-bin/cmudict

 1RWH WKDW VRPH DUH :HVWHUQ SRSXODU VRQJV DQG (QJOLVK LV XVHG LQ
WKHP http://www.oricon.co.jp/

 http://www.odditysoftware.com/page-datasales1.htm
 7KLV WHUP LV IURP DQ DUWLFOH >@347

Proceedings SMC 2016 | 31.8. - 3.9.2016, Hamburg, Germany
next words
current words

Topic distributions of each wordI
1kiss you0
1

Select by clicking

0hurts you

1

wanna

kiss

0
0.4

next words
current words

I wanna kiss

0
topic

An integrated topic distribution for the three words
hurts you

)LJXUH  ([DPSOHV RI WRSLF GLVWULEXWLRQV DQG WKHLU LQWH
JUDWLRQ
Select by clicking

XVHUV WR ZULWH FRPPHQWV DERXW WZR RI WKH WKUHH SULPDU\
IXQFWLRQV RI RXU V\VWHP  O\ULFV GLVSOD\ VLPLODU ZRUG
VHTXHQFHV DQG  O\ULFV ]DSSLQJ LQWHUDFWLRQ
3RVLWLYH FRPPHQWV DERXW WKH FDSDELOLWLHV DQG SRWHQWLDO RI
WKH LQWHUIDFH ZHUH REWDLQHG IURP WKH XVHUV 7KUHH XVHUV8 8 DQG 8 XVHG WKH IXQFWLRQ WR GLVSOD\ DQG OLVWHQ WR
VLPLODU ZRUG VHTXHQFHV ZLWK HQMR\PHQW DQG WZR XVHUV 8
DQG 8 LQGLFDWHG WKDW WKH IXQFWLRQ LV KHOSIXOXVHIXO IRU UHWULHYLQJ O\ULFV 2QH XVHU 8 LQGLFDWHG WKDW WKH IXQFWLRQFKDQJLQJ WKH OHQJWK RI ZRUGV IRU FRPSXWLQJ VLPLODULW\ ZDVHDV\ WR XVH 2QH XVHU 8 IUHTXHQWO\ FKDQJHG WKH OHQJWK
N = {3, 4, 5}  DQG DQRWKHU XVHU 8 XVHG RQO\ N = 1
:LWK UHVSHFW WR WKH ]DSSLQJ LQWHUDFWLRQ WKUHH XVHUV 8
8 DQG 8 IHOW JRRG DERXW MXPSLQJOLVWHQLQJ WR WKH FRUUHVSRQGLQJ PDWFKLQJ SRVLWLRQV ZLWKLQ WKH DXGLR UHFRUGLQJV
7KUHH XVHUV 8 8 DQG 8 LQGLFDWHG WKDW /\ULF/LVW
3OD\HU LV XVHIXO WR EH FRQVFLRXV RI O\ULFV ZKLOH OLVWHQLQJ WRPXVLF )XUWKHUPRUH ¿YH XVHUV 8 8 8 8 DQG 8
LQGLFDWHG WKDW D IXQFWLRQ ]DSSLQJ DXWRPDWLFDOO\ LV D ZD\ WR
H[SDQG SRVVLELOLW\ RI DSSOLFDWLRQ
2Q WKH RWKHU KDQG DOO XVHUV LQGLFDWHG WKDW WKH VSHHG ZLWKZKLFK WKH VLPLODU ZRUG VHTXHQFHV FKDQJH VKRXOG EH FRQWUROOHG RU EH PRUH HIIHFWLYH DQG WKDW HLWKHU FRQWUROOLQJ LWRU PDNLQJ LW PRUH HIIHFWLYH ZRXOG EH D JRRG IXWXUH GLUHF
WLRQ IRU LQWHUIDFH LPSURYHPHQW ,Q DVVRFLDWLRQ ZLWK WKDWIRXU XVHUV 8 8 8 DQG 8 WKRXJKW WKDW XQFKDUDFWHULVWLF ZRUGV e.g. SUHSRVLWLRQV VKRXOG EH RPLWWHG IURP WKHUHWULHYLQJ SURFHVV 7R LPSURYH SUDFWLFDO XWLOLW\ RI WKH V\V
WHP ¿YH XVHUV 8 8 8 8 DQG 8 ZDQWHG WR NQRZ
D VLPLODULW\ EHWZHHQ WZR VRQJV EDVHG RQ O\ULFV RU DFRXVWLFIHDWXUHV e.g. PRRG PHORG\ DQG PXVLFDO VWUXFWXUH 

seen youcurrent words

seen you)LJXUH  7KH ORFDO VLPLODU ZRUG VHTXHQFHV FDQ EH FOLFNHGWR MXPS WR OLVWHQ IURP WKDW SRLQW O\ULFV ]DSSLQJ LQWHUDF
WLRQ 
LV GH¿QHG LQ WKLV SDSHU DV WKH V\PPHWULF .XOOEDFN/HLEOHU
GLVWDQFH ./ EHWZHHQ WZR XQLJUDP SUREDELOLWLHV
7R FDOFXODWH VLPLODULW\ IRU ZRUGV ZLWK WKH OHQJWK N RI  RU
PRUH ZLWK FRQVLGHUDWLRQ RI WKH RUGHULQJ ZH ¿UVW FRPSXWHHDFK ZRUGSDLU VLPLODULW\ ,Q WKH FXUUHQW LPSOHPHQWDWLRQWKHLU PHGLDQ YDOXH LV XVHG DV WKH VLPLODULW\ )RU H[DPSOH
IRU WZR VHW RI ZRUGV $%& DQG '() VLPLODULWLHV $' %(DQG &) DUH FDOFXODWHG ¿UVW 86(5 )(('%$&.
7R LQYHVWLJDWH WKH FDSDELOLWLHV OLPLWDWLRQV DQG SRWHQWLDO RI
RXU LQWHUDFWLRQ GHVLJQ ZH DVNHG HLJKW XVHUV WR XVH WKH V\V
WHP IRU  PLQXWHV DQG FROOHFWHG SUHOLPLQDU\ XVHU IHHG
EDFN :H FKRVH XVHUV VHYHQ PDOHV DQG RQH IHPDOH 8±
8  ZKR KDG GLIIHUHQW W\SHV RI DSSUHFLDWLRQ RI PXVLF ZLWKO\ULFV )LYH XVHUV KDG EHHQ FRQVFLRXV RI O\ULFV ZKLOH OLVWHQLQJ WR PXVLF 8 8 8 8 DQG 8  $GGLWLRQDOO\ WZR
XVHU KDG RFFDVLRQDOO\ FKRVHQ VRQJV EDVHG RQ O\ULFV 8
DQG 8 
7KH SOD\OLVW FRQVLVWHG RI WKH  -DSDQHVH VRQJV DQG ZH
XVHG WKH -DSDQHVH O\ULFV WRSLF PRGHO $OO XVHUV NQHZ PRUH
WKDQ  VRQJ DQG VL[ XVHUV NQHZ  VRQJV RU PRUH 8 8
8 8 8 DQG 8  $IWHU WKH WULDO XVDJH ZH DVNHG WKH

 &21&/86,21
7KLV SDSHU SUHVHQWV /\ULF/LVW3OD\HU D O\ULFVV\QFKURQL]HGPXVLF SOD\EDFN LQWHUIDFH IRU UHWULHYLQJ O\ULFV SDVVLYHO\/\ULF/LVW3OD\HU LV DOVR DQ DFWLYH PXVLF OLVWHQLQJ LQWHUIDFHEDVHG RQ O\ULFV DQG DQ DFWLYH OLVWHQLQJ VW\OH FRXOG KHOSSHRSOH EH FRQVFLRXV RI O\ULFV ZKLOH OLVWHQLQJ WR PXVLF %\WDNLQJ LQWR DFFRXQW WKH PHDQLQJ RI O\ULFV ZKLOH OLVWHQLQJOLVWHQHUV FDQ HQULFK WKHLU OLVWHQLQJ H[SHULHQFH DQG EHFRPH
PRUH HPRWLRQDOO\ LQYROYHG ZLWK VRQJV

348

Proceedings SMC 2016 | 31.8. - 3.9.2016, Hamburg, Germany/\ULF/LVW3OD\HU KDV DQ LQWHUDFWLYH IXQFWLRQ FKDQJH WKHZRUG OHQJWK XVHG IRU FRPSXWLQJ ORFDO VLPLODULW\ $OWKRXJKWKHUH DUH ZRUNV IRFXVLQJ RQ WKH VLPLODULW\ RI PXVLF IUDJPHQWV RU HQWLUH PXVLFDO SLHFHV >@ DQG WKH XVH RI VLPLODULW\ E\ '-V FRQQHFWLQJ WZR SLHFHV VPRRWKO\ DQG IRU PXVLFDOEURZVLQJ > @ WR RXU NQRZOHGJH WKHUH LV QR UHVHDUFKRQ KRZ DQ LQWHUDFWLRQ FRXOG EH XVHG WR FKDQJH WKH ORFDO
UDQJH 6LQFH PXVLF LV D WLPHVHULHV PHGLD FRQWHQW ORFDO
VLPLODULW\ LV DQ LPSRUWDQW DVSHFW WR GHDO ZLWK,Q IXWXUH ZRUN ZH SODQ WR FRQVLGHU YDULRXV ZRUG OHQJWKVIRU FRPSXWLQJ ORFDO VLPLODULW\ :H DUH DOVR JRLQJ WR H[SORUH LQWHUDFWLYH GHVLJQV IRU WKH GLVSOD\ RI VLPLODU ZRUG VH
TXHQFHV WKDW LV WR LPSURYH WKH LQWHUDFWLRQ LQ ZD\V EDVHG
RQ XVHU IHHGEDFN $OWKRXJK WKLV LQWHUIDFH IRFXVHG RQO\ RQ
O\ULFVEDVHG LQIRUPDWLRQ LQIRUPDWLRQ DERXW RWKHU PXVLFDO
HOHPHQWV VXFK DV YRFDO WLPEUH DQG PHORG\ VKRXOG EH LQ
WHJUDWHG WR HQULFK XVHU H[SHULHQFH 0RUHRYHU D IUDPHZRUNWKDW FDQ GHDO ZLWK D ODUJH DPRXQW RI VRQJV LV DOVR LPSRUWDQWWR PXVLF OLVWHQHUV/\ULF/LVW3OD\HU IRFXVHG RQ DQ LQWHUDFWLRQ GHVLJQ WR H[SORUH ³KRZ WR OLVWHQ WR D VHW RI VRQJV E\ XVLQJ O\ULFV´
7KH GLJLWL]DWLRQ RI PXVLF DQG WKH GLVWULEXWLRQ RI FRQWHQW
RYHU WKH ZHE KDYH JUHDWO\ LQFUHDVHG WKH QXPEHU RI PXVLFDO
SLHFHV DYDLODEOH $OWKRXJK PXVLF UHFRPPHQGHU V\VWHPVDQG PXVLF LQIRUPDWLRQ UHWULHYDO PHWKRGV IDFLOLWDWH UHWULHYLQJ DQG OLVWHQLQJ WR D ODUJH VHW RI PXVLF D UHFRPPHQGHG
VHW RI VRQJV KDYH WR EH OLVWHQHG WR GHWHUPLQH ZKLFK VRQJ
LV RQH¶V IDYRULWH 6LQFH WKH WLPH RQH FDQ VSHQG OLVWHQLQJ WRPXVLF LV OLPLWHG PRUH LQYHVWLJDWLRQV RI LQWHUDFWLRQV IRU OLVWHQLQJ WR D PXVLFDO SLHFH DQGRU D VHW RI SLHFHV DUH QHHGHG
$FNQRZOHGJPHQWV
7KLV SDSHU XWLOL]HG WKH 5:& 0XVLF 'DWDEDVH 3RSXODU
0XVLF 5R\DOW\)UHH 0XVLF DQG 0XVLF *HQUH  7KLV ZRUNZDV VXSSRUWHG LQ SDUW E\ &5(67 -67 5()(5(1&(6>@ : 0DFKLGD DQG 7 ,WRK ³/\ULFRQ $ YLVXDO PXVLF VH
OHFWLRQ LQWHUIDFH IHDWXULQJ PXOWLSOH LFRQV´ LQ Proc. IV
2011  SS ±>@ ( %URFKX DQG 1 GH )UHLWDV ³³1DPH 7KDW 6RQJ´ $SUREDELOLVWLF DSSURDFK WR TXHU\LQJ RQ PXVLF DQG WH[W´
LQ Proc. of NIPS2002  SS ±
>@ 0 0XOOHU et al. ³/\ULFVEDVHG DXGLR UHWULHYDO DQGPXOWLPRGDO QDYLJDWLRQ LQ PXVLF FROOHFWLRQV´ LQ Proc.
ECDL’07  SS ±>@ 5 1HXPD\HU DQG $ 5DXEHU ³0XOWLPRGDO PXVLF LQ
IRUPDWLRQ UHWULHYDO ± YLVXDOLVDWLRQ DQG HYDOXDWLRQ RI
FOXVWHULQJV E\ ERWK DXGLR DQG O\ULFV´ LQ Proc. ISMIR
2007 
>@ + )XMLKDUD et al. ³+\SHUOLQNLQJ /\ULFV $ PHWKRG IRU
FUHDWLQJ K\SHUOLQNV EHWZHHQ SKUDVHV LQ VRQJ O\ULFV´ LQ
Proc. ISMIR 2008  SS ±>@ ' %DXU et al. ³6RQJ:RUGV ([SORULQJ PXVLF FROOHF
WLRQV WKURXJK O\ULFV´ LQ Proc. ISMIR 2010 
>@ 6 6DVDNL et al. ³/\ULFV5DGDU $ O\ULFV UHWULHYDO V\VWHP
EDVHG RQ ODWHQW WRSLFV RI O\ULFV´ LQ Proc. ISMIR 2014 SS ±>@ 5 7DNDKDVKL et al. ³%XLOGLQJ DQG FRPELQLQJ GRFXPHQW DQG PXVLF VSDFHV IRU PXVLF TXHU\E\ZHESDJH
V\VWHP´ LQ Proc. of Interspeech 2008  SS ±>@ ) .OHHGRUIHU ³2K 2K 2K :KRDK WRZDUGV DXWRPDWLF
WRSLF GHWHFWLRQ LQ VRQJ O\ULFV´ LQ Proc. ISMIR 2008>@ / 6WHUFN[ et al. ³$VVHVVLQJ TXDOLW\ RI XQVXSHUYLVHGWRSLFV LQ VRQJ O\ULFV´ LQ Advances in Information Retrieval, ECIR 2014  SS ±>@ % /RJDQ ³6HPDQWLF DQDO\VLV RI VRQJ O\ULFV´ LQ Proc.
ICME 2004 
>@ & /DXULHU ³0XOWLPRGDO PXVLF PRRG FODVVL¿FDWLRQ XVLQJ DXGLR DQG O\ULFV´ LQ Proc. ICMLA 2008 
>@ & 0F.D\ et al. ³(YDOXDWLQJ WKH JHQUH FODVVL¿FDWLRQ SHUIRUPDQFH RI O\ULFDO IHDWXUHV UHODWLYH WR DXGLRV\PEROLF DQG FXOWXUDO IHDWXUHV´ LQ Proc. ISMIR 2008 SS ±>@ ' - +X DQG / . 6DXO ³$ SUREDELOLVWLF WRSLF PRGHOIRU XQVXSHUYLVHG OHDUQLQJ RI PXVLFDO NH\SUR¿OHV´ LQ
Proc. of ISMIR2009  SS ±>@ 0 9 =DDQHQ DQG 3 .DQWHUV ³$XWRPDWLF PRRG FODVVL¿FDWLRQ XVLQJ 7) ,') EDVHG RQ O\ULFV´ LQ Proc. ISMIR
2010  SS ±>@ 0 *RWR ³$FWLYH PXVLF OLVWHQLQJ LQWHUIDFHV´ LQ Proc.
ICASSP 2007 
>@ 0 *RWR et al. ³5:& 0XVLF 'DWDEDVH 3RSXODU FODVVLFDO DQG MD]] PXVLF GDWDEDVHV´ LQ Proc. ISMIR 2002 SS ±>@ 7 .XGR ³0H&DE <HW DQRWKHU SDUWRIVSHHFK DQG PRUSKRORJLFDO DQDO\]HU´ KWWSPHFDEVRXUFHIRUJHQHW>@ + )XMLKDUD et al. ³/\ULF6\QFKURQL]HU $XWRPDWLF V\QFKURQL]DWLRQ V\VWHP EHWZHHQ PXVLFDO DXGLR VLJQDOV DQG
O\ULFV´ IEEE Journal of Selected Topics in Signal Processing YRO  QR  SS ± 
>@ ' 0 %OHL et al. ³/DWHQW 'LULFKOHW DOORFDWLRQ´ Journalof Machine Learning Research YRO  SS ±
>@ 7 / *ULI¿WKV DQG 0 6WH\YHUV ³)LQGLQJ VFLHQWL¿F WRSLFV´ LQ Proc. Natl. Acad. Sci. USA (PNAS) YRO  SS ±
>@ 7 1DNDQR et al. ³0XVLFDO VLPLODULW\ DQG FRPPRQQHVV
HVWLPDWLRQ EDVHG RQ SUREDELOLVWLF JHQHUDWLYH PRGHOV´
LQ Proc. IEEE ISM 2015 
>@ 0 *RWR et al. ³5:& 0XVLF 'DWDEDVH 0XVLF JHQUH
GDWDEDVH DQG PXVLFDO LQVWUXPHQW VRXQG GDWDEDVH´ LQ
Proc. of ISMIR 2003  SS ±>@ & 0 %LVKRS Pattern recognition and machine learning 6SULQJHU9HUODJ 1HZ <RUN ,QF 
>@ 0 *RWR DQG . +LUDWD ³5HFHQW VWXGLHV RQ PXVLF LQIRUPDWLRQ SURFHVVLQJ´ Acoustical Science and Technology (edited by the Acoustical Society of Japan) YRO 
QR  SS ± 
>@ + ,VKL]DNL et al. ³)XOODXWRPDWLF '- PL[LQJ ZLWK RSWLPDO WHPSR DGMXVWPHQW EDVHG RQ PHDVXUHPHQW IXQFWLRQRI XVHU GLVFRPIRUW´ LQ Proc. ISMIR 2009  SS
±
>@ 7 +LUDL et al. ³0XVLF0L[HU &RPSXWHUDLGHG '- V\V
WHP EDVHG RQ DQ DXWRPDWLF VRQJ PL[LQJ´ LQ Proc. ACE
2015  SS ±349