㻾 31/) *7%.45(0-,"$2"6"
&' 89+ #!9' 

2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST



#8'93*

??

[63., 2016] • ;=>-47(5 • ; E?+

63BC, et al. "@ %1/D$2 /D:0<,." &.!")A23.1 (2016): 59-86.

2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST 
9:82,#%$*
Luck, Steven J. An introduction to theevent-related potential technique.
MIT press, 2014.

2019/6/24

??

 • <!>?136 )"4 • <!D@/• A (4;0 ';.&-> C 4 • 7(+B53 -= [Luck, 2014]• 
BCI

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST
/0.)$??

 2(' & --> ! 3 *4+1
"





%*l  /0 2)• # 3 "
2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST,"l 3#B>$=!@?D1>%• E2.
• ),#GAF9
• /& 6:J-> BCIK K'7l  $ERP#C C!""7- ERP4G• P300  5+(<• N400 H;I= C 8 C
• P600 H;
8 C <- *[Luck, 2014]

80[Osterhout, L. et.al, 1992]
L. Osterhout and P.J. Holcomb, “Event-related brain potentials elicited by syntactic anomaly,” Journalof Memory and Language, vol.31, no.6, pp.785–806, 1992.

2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAISTl P6007/!, #!. (9 4Kazuyuki, et al. "A topographical studye.g. • 06   L.of Nakagome,
ERP correlates of semantic and syntactic violationsin the Japanese language using the multichannel EEG• * 06  
system." Psychophysiology 38.2 (2001): 304-315.
1 -&"23%

time717273

747576/*

$8

-&"
3

50~100&"$83)Positive+'6005→ P600

2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST/

l BCI$PMCERP;K' A#51EFKQ• P300;KKQN@=,)  
B. Blankertz , S. Lemm , M. Treder , S. Haufe, and K.-R.Müller, “Single-trial analysis andclassification of erp components ― a tutorial , ” NeuroImage , vol.56 , no.2 , pp.814–825 , 2011 .

•  !NNKQ7L26-J<*N@O0
L. Vařeka and P. Mautner, “Stacked autoencoders for the p300 component detection,” Frontiersin neuroscience, vol.11, p.302, 2017.

l ./"H' ERP;KN400P600P300I&
G+EF> ;K934%ISNIB• ,)8
• O0:(?  !P,)D8
2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

[H. Tanaka., et.al, 2019] l '?SGJ1$O#V$O D&53MN
R[• LHY- 7*Z%)7*.*I!T-E
 200-300, 300-500, 500-800Q- :N<Z%):N<BT-E
δBθBαBβB• /(- J1$O57.7%MLP54.7%SVM
l ERP>R+ , R[;X7*:N<P"@C • NN9U6AF8, R[W2=0K4 H. Tanaka, H. Watanabe, H. Maki, S. Sakriani, and S. Nakamura, “Electroencephalogram-based singletrial detection of language expectation violations in listening to speech,” Frontiers in Computational
Neuroscience, vol.13, p.15, 2019.

2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST
120,&??
6;

.

37l)7, . 3 :9-#" 126;l 
ERP(6 /:"%2'4 *+! $85
2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST





l C."GE87'/I• e.g. (a: C.< Ib: C."GI)a. (=-,A%-9(=,A%9
b. *(=- ,A%-9• $@94B6513+D) • !K< I!K"GI I&40I
B6-> J-*C."GNLHP0• ?M:;FQ#>2O

2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST





l '" C(19@ 6>#=#E( 6>+1.
3,16@*,3@<!7D24.2$
l '" B(1) )&4%19(2)  02/: ;
49-: or8:
2019/6/24

correct
orincorrect(3) 8 A?
 529

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

l fgPv• fgHActiCap (Brain ProductsZ)32*58.7Pv
l \Ss
1. K?RaDh`TP9TP10mEa:
2. 0.3HzFIR/0&17(68$3. c@!8'+-eio_JTM-10046j
90046jG=fg 3+"8$
4. ^ Xka:350μV> 3+#U<5. Fa:*1#-UA ;C^ 3+#oLU<6. 250Hz)8%8268$
7. dtYll[Q qr*1#-UA
8. KbXka:120μV 3+#U<9W\Ssl[]V 1nNIBuOU<18n,(p6%U<2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST - SAEl Stacked Autoencoders (SAE)• Autoencoder (AE)2 NN %( ( &$#• SAE AE  AE" &->    ! ' [L., Vareka, et.al, 2017]2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST - LSTM

l Long Short-term Memory (LSTM)• %Recurrent Neural Network$'   !

Le, Phong & Zuidema, Willem. (2015). Compositional
Distributional Semantics with Long Short Term Memory.
10.18653/v1/S15-1002.

• "#&* )LSTM(+  [Alhagry, S., et.al, 2017]
S. Alhagry, A.A. Fahmy, and R.A. El-Khoribi, “Emotion recognition based on eeg using lstm recurrent
neural network,” Emotion, vol.8, no.10, pp.355–358, 2017.

2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

l Windowed means paradigm -)0(& [Blankertz, B., 2011]• % "-)0$1
% "
*

Ch1x1,150ms
x31,1x1,1x1,14 • +!
100/ 800/#
50/ %"  *
x31,1 ... x31,14

...

...

Ch31

...

t=0ms

x1,14x31,14t=100ms•

t=800ms[H., Tanaka., et.al, 2019] .  

2019/6/24 -) ,!'

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST - SAE

l SAE&$+#•   &$- -> 434• &$+) 0(*1',x1,14...

%! x31,14

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

...

...

...

-

"1"2

x31,1...

2019/6/24

x1,14...

...
x31,1 ... x31,14%!

...

...

x1,1
...

x1,1',

, - LSTM

x1,1...

...

2019/6/24...

x1,14x31,14x1,14...

• 0* 1. :#73G
$5E3G7=
AH-

3G7...

• "><F B&90
@4C/1 6%!

...

...

...

l LSTM ><F;3 ,8:#7• SAE "1#'# D+I( ?G?G x1,1  x31,1-> 3114 2)

x31,1

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST...

x31,141/2

l "% #• 4+%SVM
:7ASAE 9@l *C14?/-)B0• 8.3= 8.&;=2D-> !%$#50% (1, 520l >64?/-)B0• 8.3= 8.&;=2D-> !%$#50% (1, 157• >6/-)B0 5 <'2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST2/2

l   #!4A&• -JC 10G)03.7 $
• 4A   #!  =9DE'
• SVM
C = {0.001, 0.01, 0.1, 1, 10, 100}
• SAE>+<6/8 = {10, 50, 100, 200, 300}
>+<8 = {1, 2, 3}*9&,8 = {sigmoid, ReLU}• LSTM>+<6/8 = {5, 10, 15, 25, 30}*9&,8 = {sigmoid, ReLU}
l @(G;4:B2"%   #!
H F851 =GI:B?
2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

l -$!&QWCG
$!&

QWCG

SVM

58.4%

SAE

58.3%

LSTM

61.3%

(SVM: 54.7% [H., Tanaka, et.al, 2019])

l -;30V<CG

QWCG%"!J;3:*<O8l • LSTM=R 9CG 7 %('#&S)@,UDK61Fp<0.01
l • H4?T.MNQW   
S5+LA• P600BQSNPE -> P3001>2/7
QWCG I
2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

?A5<%

l LSTM".@'$3?A5<6-10;@':
l • ".@'$3 7"?A5< 2
".@'$3l • ERP4? >3$/,".@' %8 P300)1*& [K., Matthias, et.al, 2004] ".
@'/,! 100%?A5< 0 9=(#+
Kaper, Matthias, et al. "BCI competition 2003-data set IIb: support vector machines for the P300
speller paradigm." IEEE Transactions on biomedical Engineering 51.6 (2004): 1073-1076.

2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAISTl• &=QC G,#NA%0- LM7.UPYl• 18S 2+*X3 LMU  4RO'l • LSTMU4R 61.3% PY<F• JEVD6  ERP:PJT 1(W$ >@- 5M8W$ JEVU l • I)  1("H/ PY9KO'• LSTM 6X? !B PY9KO'• JEV; LM PY-2019/6/24

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST