㻾'-+,)/#*0. .&  , ,  $! % ("256419378 HIP  2020/05/14
Kana Miyamoto, AHC lab, IS, NAIST

1



Kana Miyamoto, AHC lab, IS, NAIST

2


*.#2"$0!*arousal
 1

,

[J.A. Russell. (1980)]

angryhappy-2)) 0*/1(0• valence: 3valence• arousal: 3

sad

0

neutral0.5

1 

relaxed0-'*&%,,+[O. Sourina,et al. (2019)]
J.A. Russell, “A circumplex model of affect.,” Journal of personality and social psychology, vol.39, no.6, p.1161, 1980.
O. Sourina, Y. Liu, and M.K. Nguyen, “Real-time EEG-based emotion recognition for music therapy,” vol.5, no.1-2,pp.27–35, 2012.
Kana Miyamoto, AHC lab, IS, NAIST

3

+:&+> [I. Wallis, et al. (2008)]+>JOKB+>

02<;?F&25E)=.-8!F+#D1E<;>'9=CE&>,• >& ?B=C78<E• +# A? 4E6@+>(/*3-FMGNIHL9%3PBF"36+/$I. Wallis, T. Ingalls, and E. Campana, “Computer-generating emotional music: The design of an affective music algorithm,”
DAFx-08, Espoo, Finland, vol.712, pp.7–12, 2008.
Kana Miyamoto, AHC lab, IS, NAIST

4

"G08
%(=AD*(,:(7D3;?-" (Electroencephalogram)"1B6D.<G'+58@>• KPTNS:4EDLUJ
• "1B
 >2!
• MQI .>"&=AC<&@!

CGX $Quick-30"=ADRHSJIO<G5V/G09G) 7D2#FE90D
Kana Miyamoto, AHC lab, IS, NAIST5Kana Miyamoto, AHC lab, IS, NAIST

6

+-#8'/82,7

[S.K. Ehrlich, et al. (2019)]$ )68,7%  +8,75(1#8 ,7& 4#8'/38+<!08,7&#
+-'
arousal



&

3"

valence?

$!

 arousal

#%
+-

sad→happy<happy→sad32.3;:9851*valence

S.K. Ehrlich, K.R. Agres, C. Guan, and G. Cheng, “A closed-loop, music-based brain-computer interface for emotion
mediation,” PloS one, vol.14, no.3, pp.1–24, 2019.
Kana Miyamoto, AHC lab, IS, NAIST

7

7&?*3?6#0<[O. Sourina,et al. (2019)]' 

7HNEDFI+;%@2&?0<( +;?

:+60<)  .1 4# .1* ?$.O
,O .5,=95<&?%0<)

.1

AMJLNE#.1* )

happy&%


0=9'4/&?.

'(&

7$

sad-7BCGK7"8!>=3*5*
O. Sourina, Y. Liu, and M.K. Nguyen, “Real-time eeg-based emotion recognition for music therapy,” Journal on MultimodalUser Interfaces, vol.5, no.1-2, pp.27–35, 2012.
Kana Miyamoto, AHC lab, IS, NAIST

8%<&<-%,<.

<'[Ehrlich, S. K.,et al. (2019)],ILKOH;AC!2,E"/7#;E'!;(211D[Sourina, O.,et al. (2012)]

<,1B*!=,E"3<?8;E'!;)56,E*>492+5/-<

!<EMFNHGJ;56,<$E/6
 E%0

Kana Miyamoto, AHC lab, IS, NAIST

9:'<6@<9Kana Miyamoto, AHC lab, IS, NAIST

10+'.+>3B;<9467:?
!/$'2(  2#&1'.+ !/2 %122 >3B;<9467:?
%1

$'*$'2%120%"*)-$,%1"*2$'
arousal valence%

$'

5A=@B8















+

Kana Miyamoto, AHC lab, IS, NAIST 
arousalvalence11458>+
1. 

+$'("2.

+valence*arousal0")0.

0&.

+

#-+valence*arousal0&.?9A0&.

3. =1C:;72458>+*0,/'(=1C:;72458>0&.
!%(3B<@C6arousal !
valence arousal



+



Kana Miyamoto, AHC lab, IS, NAIST

valence12



arousal valence
















Kana Miyamoto, AHC lab, IS, NAIST arousal

valence13/.
1. tempo
2. rhythm
3. loudness
4. pitch
5. mode0 [S.K. Ehrlich, et al. (2019)]

68795: 0(: 0"
: 0 '(: 0#(: arousal(0~1)

valence/ !4%301)+$valence-arousal&2
*3valence(0~1)

arousal/ !4%3687950(MATLAB)tempo
rhythmloudness
pitchmode687954):

rhythmpitch
mode

4$, 4

LoopBe1
MIDI
piano

tempo
loudness

MIDI
MIDI0 cello(MATLAB)
MIDI
bass

Kana Miyamoto, AHC lab, IS, NAIST(Cakewalk)14  (happy)arousal
1

valence : 0.875
arousal : 0.875

angry
valencehappy
0

neutral0.5

sad1

relaxed0valence(0~1)

arousal(0~1)


(MATLAB)tempo
rhythmloudness
pitchmodeLoopBe1
MIDI
piano

tempo
rhythmloudness
pitchmode

MIDIMIDI  cello(MATLAB)
MIDI
bass

Kana Miyamoto, AHC lab, IS, NAIST(Cakewalk)15

!$!$)+-*

**(#-
2403561108 )+%&,.$81/!$/& "$valence(arousal/SAM (Self-Assessment Manikin)/$9'!$valence

arousalSelf-Assessment Manikin
Kana Miyamoto, AHC lab, IS, NAIST

16!%

&%#+0)-12*!

%

(*02/,." '&!valence '#($)

arousal%#&!arousal '#($)

&%
(arousal)

&%
(arousal)valence%# &%
(valence) &%
(valence)

valence%

arousal%

valence

Kana Miyamoto, AHC lab, IS, NAIST

arousal17!%
$(-4+067,%%%,472.1

&%
(arousal)&%
(arousal)$!

&%
(valence)&! valence
arousal% valence%

&%
(valence)

arousalarousal%! "#( * ()!!'
!&%* (3/5 
Kana Miyamoto, AHC lab, IS, NAIST

18+!17)"-6+7!-6.31+!1 
1( (valence, arousal),5+!21• OEQ@MTFK>CT (SVR)7

-6OEQ1%• HPNTC
9QI81LD>B $U<TGQB?TQHPNTCU:JARS*11
MATLAB1/=;A9S<TGQ• 3
'046RMSE1'SVR (valence): 0.0231, SVR (arousal): 0.0240

valence(0~1)

arousal(0~1)

SVROEQ(valence)

SVROEQ(arousal)

HPNTC1&#(MATLAB)tempo
rhythmloudness
pitchmode

LoopBe1
MIDI
piano

tempo
rhythmloudness
pitchmode

MIDI
MIDI1! cello(MATLAB)
MIDIbass

Kana Miyamoto, AHC lab, IS, NAIST+!
(Cakewalk)+19arousal valence

Kana Miyamoto, AHC lab, IS, NAIST arousal

valence20H=E>DB,! 69
92

9CM-*(/7B&)#B5H
20 ($10 M10 ):9A <>,!@B;?.GF>

69

IKJL@CGX '1Quick-30H0%<M41B,!@B34H

6<>

valencearousalSelf-Assessment Manikin"8 (5s)

8+,!

(20s)

valence@arousalB46 (25s)Kana Miyamoto, AHC lab, IS, NAIST

212 [S.K. Ehrlich, et al. (2019)](1) AF3, AF4, F7, F8, F3, F4, FC5, FC6, T7, T8,P7, P8, O1, O22?J=64+,(2) $0$2AF3F7 F3

AF4FC6FC561s14),

F8F4T7(3)#2;IDGI: /%51000Hz (3200Hz 1>9I;IDGI:+,

T8P7P8O1O2(4) 2 2IIR AI@B<C7H=6&.5 -2  (theta (4-7Hz)Kalpha (8-13Hz)K
low beta (14-21Hz)Khigh beta (22-29Hz)Kgamma (30-47Hz))1)K?J=*012 /%5! = log('()(**+,(-()) 6"+,(5) $1'&.$22+&, (EJ<F8I!)2

6$22

Kana Miyamoto, AHC lab, IS, NAIST

(322/7L;LFK

034 
 [S.K. Ehrlich, et al. (2019)]1&H@K/*-6%*,• @M=1@M=: @M=170% ?<A@M=: @M=130%

7L;LFK(2+'/)547L;LFK

6%*,• @M=1@M=: @M=170% ?<A@M=: @M=130%•

@M=13

#034EJGM=>IMCL:7L;LFK ;89K1N
MATLAB1! .$NDMB1"1

Kana Miyamoto, AHC lab, IS, NAIST

623


1 416"&(valence &arousal (&(RMSE (1('+ +805.2%)20(&((,#-7/736-7/736

valence arousal valence arousal valence arousal valence arousal
0.2600

0.2608

0.18140.1770&-7/736

0.24060.2312(%*Kana Miyamoto, AHC lab, IS, NAIST

0.22810.2189,%!$

24Kana Miyamoto, AHC lab, IS, NAIST

25

"+9JKGMGJ!
".0J-,
6JSdTe[VcI*<DS8=BD;%J)G,H:JDMJ7(S$'7(>OBDS*<E;%)S8=aUg_`\WYZ]cJ&1;%)JGINP

4#
8.0F$AQD;%)J
5GTfXfbeJF7(>OSF?P@GS/BD

J!
7(J^g[INPJ2J;%)GS3L

RCDaUg_`\WYZ]cJ&1

Kana Miyamoto, AHC lab, IS, NAIST

26