Combining Musical and Cultural Features for Intelligent Style Detection

<>=@?BA CED F G#FIH J7KLH FMJBHND HN=+?OG5P'Q D CER;GTS*DU?8V SEH)CXW HN=+?BCEY R;GT?BCEZ#='D R(A HNP-H [ G#D H;W-Z#=\D CEP'Q S]?(G#=MHNZ QMD^RNSXG#D D C]Y R;GT?BCEZ = Z#_ G#Q WMC]?BZ#J V G#=.W ?BH `1?BQ G#S WMGT?(G1aLb+?8V SEHcCXWMHN=+?BC]Y.RNGT?BCEZ =dCEDeG'?(G#D fgK5A CER(AhZT_i?BHN=jCE=1k*Z SEk*H D RNQ S]l ?BQ J(G#S G#D FIH R ?BD@= ZT?cFMJBH D HN=+?@Z#JmH;GTD CESEVnH `1? J(GTR ?BH;Wd?BAMJBZ#Q o A0G#Q WMC]l ?BZTJ VpFMJBZ+RNH D D CX=MoMa qLA HrD R(A H P-H K^H FMJBZ#FIZ D H RNZ#P-F SEHNP-HN=+?BDeG#=+V GTQ.W CXZmW1JBCEk*HN= o#HN=MJBH ZTJ^DU?>VMSEH5W H ?BHNR ?BCEZ =-DUV DU?BHNPsK5C]?BAgG%R StGTD D C]Y.H J [ G#D H;W Z#=rKLH [ l3H `1? J(G#R ?BHNW W G2?(GeKLH5R;GTSXSvu R Z P-PrQM= C]?8VcP-H ?(G WMGT?(G aEw qLAMH G WMWMC]?BCEZ = Z#_M?BA HND HLR Q S]?BQMJ(GTS1GT? ? JBC [ Q ?BHND CE='Z#QMJO_iH;GT?BQ JBHLD F.GTRNH GTCXWMD%CE=jF JBZ FIH JeRNSXG#D D C]Y.RNGT?BCEZ =nZ#_)G#R Z Q DU?BCER;GTSESEVnW CED D CXP-CESXGTJ%PrQMD CXR K5C]?BAMCX=-?BAMH DBGTP-H5DU?8V SEH x1G#= W D CEP-CXSXG2JLPrQMD CER [ HNSEZ = o#CE= om?BZmWMC]yvH J l H =1?5DU?>V SXH DNa 1. INTRODUCTION zhQMD CER;G#Sco#HN=MJBH DdG#CXW CE={?BAMHnSECEDU?BHN=MCX=Mo#l>G#= W l|JBH ? JBCEHNk#G#S'}|~ c% F JBZ+RNHND D [ VgG#SESEZ;K5CE= ogG'QMD H J ZTJ5RNZ =MD Q P-H J5GmD HN=MD HcZ#_OJBH!_H JBHN=MRNH a  VZ#JBo*GT= CENCE= oF A+V D CXRNG#S D A H SXk HND-CE=JBHNR Z#J(WDU?BZTJBHND [ V:o H =MJBHNDNx D AMZ FMFIH JBDdR;GT= [ JBZ;K5D HG#= WWMCED RNZ2k*H Jh= H KPrQ D CER [ V{K GTSEf CE=Mo W Z;K5=G#=0G#CED SEH a ^QM?c?BAMH W CXo#C]?BCXNGT?BCEZ =ZT_LP'Q D CER;G#SRNQMS]?BQMJBHrRNGTJ l JBCEHND^G#=-HNP [ G2J J(G#D D CE= o@F JBZ [ SEHNPZT_7AMZ;K?BZ@ZTJBo*G#=MCENHeR Z SESEHNR ?BCEZ =MDN _iZ SXWMH!JBD _iQ SES1Z#_IP'Q D CER)JBHNR Z#J(WMCE=Mo DNx+FIHNH!J l3?BZTl3FIHNH J k1C]J ?BQ.GTS1?BH!J(G [ V1?BH SEZ+R(f*H JBD G#= WA.GT=.W A HNSXW{W HNk1CERNHNDgG#SESe= HNH;W?BA HdDBGTP-HpGT? ?BHN=+?BCEZ = ?BZZTJBo*G#=MCE;GT?BCEZ =G#DgJBZ+Z#_t?BZ F PrQMD CXRjDU?BZTJBHNDNaeD GJBHND Q S]?;x JBH l R HN=+?@KLZ#JBfpA G#D G#FMFMJBZ*GTR!AMH;Wn?BAMHrF JBZ [ SEHNPZT_ GTQM?BZ PgG2?BCER o HN= JBH JBH RNZ o#= C]?BCEZ =h 27 ;3x R JBH;G2?BCX=Mo ?BZ#FMl3SEHNk*HNS+R SXQMDU?BH JBD Z#_MD CEP-CEStG2JPrQMD CXR }JBZ+R(fIx FIZ#F7xMRNSXG#D D CER;GTS|xvH!?BR a  _iJBZ#P?BAMH@G#R Z Q DU?BCERmRNZ#=1?BH =1?;a  A CESEH^?BA H)A CEo A'SXH k*HNS1D HNF.G2J(GT?BCEZ ='Z#_Io#HN=MJBH D CXD QMD H _QMS x KLH ?BHN=.W ?BZrSXZ+Z#fhP-ZTJBH%?BZ;K GTJ(WdDU?>V SXH D5_iZ#JeWMCED RNZ2k*H!JBCX=Mo-= H K P'Q D CERcZ#J5_iZ#J GTRNRNQ J(GT?BH JBHNRNZ#P-P-HN=.WMGT?BCEZ = agb+?8V SEHND@Q D Q G#SES]VW H Y.=MHrD Q [ RNSXG#D D HND ZT_ o HN= JBHND} CE= ?BA Hjo#HN=MJBH^Z QM=+? J VK^H0R;GT=R!AMZ+Z D Hp_iJBZ#Pu %Z %HNFMJBHND D CEZ#=7xEw u]^Z =+?BHNP-FIZTJ(GTJ Vh^Z QM=+? J V+xXw1ZTJcu  J [ GT=j^Z;K [ Z;V w !x [ QM?gD Z#P-H ?BCEP-HND@UZ CE={?BZ#o H ?BAMH JhGTJ ?BCEDU?BD\G#R JBZ#D Dho H =MJBHNDNa b1?BZTJBHND }JBHNG#S Z#Jgk1C]J ?BQ.G#Str=MZ#JBPgG#SES]VWMZ0= Z#?gF GTJ ?BC]?BCEZ =?BA HNC]JgD F.GTRNH [ V DU?>V SXH\?BZG;k*Z#CXWR Z = D QMP-H J R Z =M_iQ D CEZ =};¡!¢£ ¤ ¥N¦#§B ̈n¢i©a «Xa ¬ ­ § ¦T© ¢|¬ ® ¦ ® ¦#§  ̄;a!°-± «Xa%2T¦;¬B± «>33 ́* [ Q ?L?BA H VgRNG#=hF JBZ2k CXW H%R JBZ#D DUl3JBH!_H JBHN=MRNH WMGT?(G}|GTD'CE=n?BA H-R;GTD H-Z#_ ?BA H eSESLzhQMD CERhμ%QMCXWMHd}¶+· ·  ̧ 1Uo*o2»*»*» 1⁄4 1⁄2 3⁄4*3⁄4N¿ ÀMÁ Â*Ã 1⁄4 Ã Ä ¿ !Å1G#= W%JBHNRNZ#P-P-HN=.WMGT?BCEZ =cH = o CE=MHND R;GT=@QM?BCESECENH)DU?>V SXH D _iZ#JeA CEo A l3RNZ = YIWMH = RNH%JBH D Q S]?BDNa b+?8V SEHgCXDrG#=CEP-FIH J(GT?BCEk*HgRNSXGTD D Z#_%WMHND R!JBCXF ?BCEZ =:_ZTJ-P-Z DU?'PrQ l D CER@JBH ? JBCEHNk#G#S ?(G#D f1DNx [ QM?5CEDeQMD Q.GTSXS]VhRNZ =MD CtW H JBH;WdG\u A1Q PgGT=7w RNZ#=Ml Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notices and the full citation on the first page. R Æ 2002 IRCAM Centre Pompidou RNHNF ?'G#=.WnR;G#= [ H-A.GTJ(Wn?BZdP-Z1WMHNS ahb Z#P-H DU?8V SEHNDmHNk*Z#SEk*H;WnK5C]?BA = ZG#RNZ#Q DU?BCERpQ = WMH JBFMCX=M= CE= o#DNjG0_G;k*Z#JBC]?BHjCEDgCX=+?BHNSESECEo HN=+? l>W GT= RNH!l PrQMD CERdZ#Jhu <8@z0xXw)CE=K5AMCXR(A{?BAMHdCE= RNSEQ.W H;W{G2J ?BCEDU?BDgJ(GT= o#Hd_iJBZ P ?BA H G [ DU? J(G#R ? D CX=MH l|K G;k*H = Z CED H Z#_@Ç GT=b Z =MCER ?BZp?BA H\R;G#SEPÈY S]l ?BH JBH;WnP-HNSEZ1WMCEHNDmZ#_ ^Z*G2J(WMD Z#_ LGT=.G WMG a L?@Y JBDU?mo#StGT= RNH#x <8mz KLZ#Q SXW [ H\G#=:CE=+? J(G#R ?(G [ SEH D H!?r?BZjP-Z1WMH SLWMQMH-?BZnC]?BD D CEP-CXSXG2JBCE?>V [ HNCE= opGTSEP-Z DU?'F QMJBH SEV0RNQMSE?BQ J(G#S ap D'D QMR!A xOKLHgQ D Q G#SES]VJBHNS]VZ = PgGTJBf H ?BCE= oMx F JBCX=+?rF Q [ SECXRNGT?BCEZ =MDNx)JBHNR Z P-P-HN= W GT?BCEZ#= DrZT_e_tJBCEHN=.W D };¡!­iÉMa!Ê Ë § a « ¢t ̈*a Ì#Í ¦T©.« Ê-ÎT¢ Ï%a!§ a!© ­E ́*)?BZ'QM=.WMH!JBDU?(G#=.W-DU?>VMSEHND^Z =\Z QMJ Z;K5=7a <8='?BA CED)F G#FIH J KLH FMJBH D HN=+?LGT=gG#QM?BZ#PgGT?BCER5DU?8V SEH WMH ?BHNR!?BCXZ#=-DUV DUl ?BHNP?BA.G2?LZ FIH!J(GT?BHNDLZ#= [ ZT?BA-?BA H G#RNZ#Q DU?BCERcRNZ#=+?BHN=+?^ZT_7?BAMH%GTQ.WMCEZ G#= W?BA Hgk*H J V0FIZ;KLH J _iQ S u RNQMS]?BQMJ(G#S)JBHNFMJBHND H =1?(G2?BCEZ =7wOZ#_ RNZ P-P'QMl = C]?>VjP-H ?(G WMGT?(G1x7QMD CE= odW HND R JBCEFM?BCEk*H ?BH `1?BQ.GTSO_H;G2?BQMJBHND@H `1? J(GTR ?BH;W _iJBZ#PÐG#Q ?BZ PgGT?BHNWnR J(GNK5SEDmZ#_)?BA H'K^H [ a qLA H R Z P-PrQM= C]?8VhP-H ?(GTl W G2?(Gh_H;G2?BQMJBH\D F.GTRNH A G#D FMJBHNk1CEZ QMD S]VD A Z;K5=?BZ [ HgH yvHNR ?BCEk*HgCE= GpPrQ D CER\D CEP-CXSXG2JBCE?>V:?(G#D f:Z#=C]?BD Z;K5= EÑNÒT|x5GT=.WA H JBHgKLHjGTQ oTl P-HN=+? C]?^K5C]?BA\G#=gG#Q WMCEZ@JBHNFMJBH D HN=+?(GT?BCEZ = a qLA CEDLRNZ#P [ CE=MH;WrP-Z1WMH S FIH J _iZ#JBP-D-H `1? JBHNP-HNS]V:K^HNSES%CE={CXWMH =1?BC]_tVMCE=MoGD H ?\ZT_@FMJBHNk1CEZ QMD S]V H;W CE?BHNWpDU?>V SXH'RNSEQ DU?BH JBDNx7GT=.WpR;G#= [ HrQMD H;Wd?BZ R SXQMDU?BH JmG2J [ C]? J(GTJBCES]V SXGTJBo#H =MH K D H ?BD5Z#_ G2J ?BCXDU?BDNa 2. PRIOR WORK 2.1 Genre Classification eQ ?BZ PgG2?BCXR-o#HN=MJBH\RNSXG#D D C]Y R;GT?BCEZ =?BHNR(A =MCtÓ+QMHND ?BA GT? H ` F SECERNC]?BS]V RNZ#P-F QM?BH^RNSEQ DU?BH JBD _iJBZ#PÔ?BA H D RNZTJBH Z#J^G#Q.W CEZcSEHNk*HNS A.G;k*HLJBHNFIZTJ ?BH;W A CEo#A JBHND QMS]?BDdCE=P'Q D CER;G#SES]VZ#JjG#RNZ#Q DU?BCER;G#SES]VD HNF.G2J(G [ SEHo#HN=MJBH D D Q R(AG#DhRNSXG#D D CER;G#Smk1DNaÕJBZ+R!fIx [ QM?\?BA HnA CEH J(G2JBR!AMCER;G#S@DU? JBQMR ?BQMJBH Z#_cFIZ F QMSXGTJ\PrQMD CXRhSXH =.WMD-C]?BD HNS]_@?BZ:G0P-Z#JBHhY = HNoTJ(G#CE= H;WD H ?\Z#_ WMCEk1CED CEZ = DNa %D CE=Mo ?BA H@D RNZTJBH'SEHNk*H S Z =MS]V+xO}3zh<8%<^Y.SEHNDNxM? J(G#= D R!JBC [ HNWdPrQ D CER Z#J@ b Z#Q =.W D RNZ#JBHND(5DUV DU?BHNP-DeRNG#=jH `1? J(G#R!?%DU?>VMSEHmZ#J%o HN= JBHmQ D CE= o H;GTD CXS]V1l3H `1? J(G#R ?(G [ SEHr_iH;GT?BQ JBHND-} Z =MRNHr?BA H PrQMD CERrCED@CE=GgRNZ P-P-Z#= _ZTJBPgGT?;x1K5A CER(A PgGNV'JBH;Ó+Q C]JBH%R(A.G2J(G#R ?BH J^JBHNRNZ o#= C]?BCEZ = Z = G D RNZTJBH x Z#J^F.G2JBD CX=MorG'zh<8%<OY.SEH2 D QMR!A\GTD^f*H V G#= W-_tJBH;Ó+Q HN=+?BS]V QMD H;W-FMJBZTl o#JBH D D CXZ#= DNaLb1V DU?BHNP-DL=MZ#JBPgGTSXS]VgFIH J _iZ#JBPÖo#HN=MJBHcR StGTD D C]Y.R;G2?BCXZ#= [ V RNSEQ DU?BH!JBCX=Mo-D CEP-CXSXG2JeP'Q D CERcD HNo#P-HN=+?BDNx ZTJ FIH J _ZTJBP-CX=Mo-G Z =MH l3CE=Ml3= }K5A H!JBH'=dCED ?BA Hm=1Q P [ H!J5Z#_ o HN= JBHND( R StGTD D C]Y.R;G2?BCXZ#=0QMD CE= ogD Z P-H PgG#R(A CE=MH^SEH;GTJB=MCE= o%?BHNR(A =MCXÓ1QMH aO<>=  ×;3x k G2JBCEZ Q DPgGTR!AMCX=MH^SEH;G2JB= CE= o RNSXG#D D C]Y H JBDmGTJBH ? J(G#CE= H;WjZ#=nFIH!J _Z#JBPgGT= RNH'R!A GTJ(GTR ?BH JBCEDU?BCERND@Z#_ ?BA H D RNZTJBH%?BZ'SEH;G2JB=hG F CEHNRNH!l>o#SEZ [ GTS w DU?>V SXH#xXwMGT=.WgCX=n 2v?BAMJBH H ?>VMFIH DLZ#_ _Z#SEf P'Q D CER%KLH!JBH D H F.GTJ(G2?BH;WhQMD CX=Mo-GrØeCtWMWMHN=hzdGTJBf ZTkhzhZ1WMH S|a eFMFMJBZ G#R(A HND ?BA.GT?LFIH J _ZTJBP o HN= JBH%RNSXGTD D CEY R;GT?BCEZ#=dCE=\?BAMH%GTQ.WMCEZ WMZ#PgG#CE=@Q D H G RNZ#P [ CE= GT?BCEZ =@ZT_MD FIH R ? J(G#S*_iH;GT?BQ JBHNDOGT=.WcPrQMD CER;G#SES]V1l CE=M_iZ#JBP-H;WCX= _H J JBHNW_H;G2?BQMJBHNDNa μ%HN= JBHjCXWMHN=+?BC]Y.R;G2?BCEZ ={K^Z#JBfQ =Ml WMH!J ?(G#f*HN= CE= TOG#CEP-DL?BZ Q = WMH JBDU?(GT=.W\G#RNZ#Q DU?BCERmRNZ =+?BHN=+?5HN=MZ QMo A ?BZnRNSXG#D D C]_iVCE=+?BZGjD PgGTSXS D H!? Z#_ JBHNSXGT?BHNWRNSEQMDU?BH JBD [ VDU?BQ W V CE= o ?BA HrD FIHNR ? J(GjG#SEZ#= ohK5C]?BA?BHNP-FIZTl3D HN= D C]?BCEk*H\u ?BCEP [ JBHNo#J(GTP-DNw K5C]?BA GeD CEP-FMSXH [ H;GT? W H ?BHNR ?BZTJCE='FMStGTRNH a b1CEP-CXSXG2J KLZ#JBfc? JBHNGT?BCE= o@G2J ?BCEDU?BD ! "# %$'& ( )"*&+ -,. "0/1 2& 3 & -45 (67 8&:9 & ;&+ ( GTDmRNZ P-FMSXH!?BH-o HN= JBHNDg}K5A H JBH D CEP-CESXGTJ'RNSEQ DU?BH JBDmZT_5GTJ ?BCEDU?m_ZTJBPÐG u o#HN=MJBH w @CED'DU?BQ WMCEH;WCE=  TLG#= W0?BA HN=0CEP-FMJBZ2k*H;WnZ =CE= ]Ñ ^K5CE?BA P-ZTJBH@PrQMD CXRNG#Svf1= Z;K5SEH;WMo#H a 2.2 Cultural Feature Extraction ^QMS]?BQMJ(G#S5_HNGT?BQMJBH DgGTJBHj= ZT?gG#D-K^HNSESEl>W H Y.=MH;WGT=.Wk G2J V:K5CE?BA ?BCEP-H-GT=.WnCX=+?BH JBF JBH ?(GT?BCEZ#=7ap]Ñ;Ò2 WMH!Y.= H D@RNZ P-P'Q = C]?>VdP-H ?(G#W GT?(G }K5AMCER!A-KLHeQ D H CE=g?BAMCED^F.GTFIH J!)GTD G@k*HNR ?BZTJLD F G#RNHeZ#_ WMHND R JBCEF ?BCXk H ?BH!` ?BQ G#Sv?BH JBP-DNa ^QMSE?BQ J(G#S _H;G2?BQMJBHND _ZTJ%P'Q D CEReJBH!? JBCXH k GTS G2JBHmG#SED Z H!`MFMSEZ#JBH;WCE= #|xLK5AMH JBHhK^H [ R!J(G;K5SED-_ZTJhu P'V_G;k*Z#JBC]?BHjG2J ?BCXDU?BDNw SECEDU?BD GTJBHcR Z SESXGT?BH;WdGT=.W\Q D H;WgCE=dG JBH RNZ P-P-HN= W G2?BCXZ#=\G#o H =1?;a)qLAMH D FIH RNC]Y.RNDcZT_?BA HmRNZ P-P'Q =MCE?>V\P-H ?(G WMGT?(Gr_HNGT?BQMJBH'k*HNR ?BZTJcG2JBHrW H l D R!JBC [ HNWhCE=do#JBH;G2?BH J%WMH ?(GTCXS [ HNSEZ;K@a 3. STYLE CLASSIFICATION q7Ze?BHNDU? Z Q J _H;G2?BQMJBHLD F G#RNH5GT=.W A1V FIZT?BA HND HND RNZ =MRNH JB= CE=Mo@G#Q ?BZ#l PgG2?BCER)DU?>VMSEH WMH!?BHNR ?BCEZ = xTK^H)R(A Z#D HLG D PgG#SES*D H!?OZ#_MG2J ?BCXDU?BD D F.G#=M= CE= o Y k*H D HNF GTJ(G2?BH\DU?>V SXH D'GTDmRNSXG#D D C]Y.H;W [ VnPrQMD CER H;WMC]?BZTJBDNa <>=0?BQ JB=7x K^HcY JBDU?5PgGTf*H%RNSXGTD D CEY R;GT?BCEZ#= D [ G#D H;W D Z SEHNS]VhZ#=dGT=dG#Q WMCEZrJBHNF JBH l D H =1?(G2?BCEZ =7xI?BAMHN=pGgRNZ P-P'Q = C]?>V P-H!?(G W G2?(GrJBHNFMJBH D HN=+?(GT?BCEZ = x G#=.W SXGTDU?BSEVD AMZ;K ?BA.G2?r?BA H\RNZ#P [ CE=MH;W_H;G2?BQMJBHhD F G#RNH D FIH J