*%#"+$ &0.!

2019/12/6

,)(-/
12' 2


2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

1



e.g.

![Takazawa et.al, 2002] l••-# "  ->  " -> "   [Bakarov, 2018]

Takazawa, S et al. (2002). Early components of event-related potentials related to semantic andsyntactic processes in the Japanese language. Brain Topography, 14,169–177.
Bakarov, A. (2018). A survey of word embeddings evaluation methods. arXiv preprint2019/12/6

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

2 l••)&0DA#17;,> -> .!< /* A+ -> A! [Bakarov, 2018] -> E< ?3-% @:6< "$->  =;< 5C [Luck, 2014] B9'()•-l ••l2D)84

Luck, S.J. (2014). An Introduction to the Event-Related Potential Technique, MIT Press.

2019/12/6

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

3l EEG?05XJ.I*K••lR>:PB( 37+V&O@TD"-> WN8!!;Z$WC

S%•H<•-')9D$62PQV[- Recurrent neural network (RNN)7/\=4VAD$62
V[[Sakthi et al, 2019]-URNN7/\F#!Y

[Phan et al, 2018]•-

"NE;Z,]PQV[G#-1 LM 

Sakthi, M. et al, (2019, May). Native Language and Stimuli Signal Prediction from EEG. In ICASSP
2019 (pp. 3902-3906). IEEE.
- Phan, H. et al, (2018, July). Automatic sleep stage classification using single-channel eeg: Learning
sequential features with attention-based recurrent neural networks. In (EMBC) (pp. 1452-1455).
2019@Shunnosuke Motomura AHC-Lab, IS, NAIST
2019/12/64



[Tanaka et.al, 2019][Motomura et.al, 2019]l &W,( A
?!41FGKV" "> FGR<3Se.g.   ";
FG•)$ SemO H9*, SynB. H9*- Sem: 59.5% (MLP), Syn: 61.3% (LSTM) -> -.l FGR<US•••-KV8M+CIT72LA@/' JP";LA X%D6YN=?.D65FGKVQ0#E:Tanaka, H. et al. (2019). EEG-based Single Trial Detection of Language Expectation Violations inListening to Speech. Frontiers in computational neuroscience, 13, 15.
- Motomura, S. et al (2019, October). Detecting Syntactic Violations from Single-trial EEG using
Recurrent Neural Networks. In Adjunct of the 2019 ICMI (no. 4). ACM.
2019@Shunnosuke Motomura AHC-Lab, IS, NAIST
2019/12/6
5 "l "l !
2019/12/6RNN  RNN2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

6l

F@2$•e.g. aF4a. 8K-b. #8K-•••C bF&CJ'-,0-//-#F:+3  &A?G80F@2$(IF4 C40F&C407H13l 19>E%D%L-9"5l(1) .*;)
1B#

(2)

(3) 

6C<!
4B#6C

=

2B#
correct
orincorrect

2019/12/6

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

7l •'RNN [ ->] )$.%!

*(-+e1-eT

α1w••ααTh1

hTx1

xTvsoftmax[Febro et.al, 2017]yht  t  # ",w & ! Felbo, B. et al, (2017). Using millions of emoji occurrences to learn any-domain representations
for detecting sentiment, emotion and sarcasm. arXiv preprint arXiv:1708.00524.
2019@Shunnosuke Motomura AHC-Lab, IS, NAIST
2019/12/6
8l 
20Hz -> !
31'( e1eT

α131 Chsw

2019/12/6

"&%ααTh1

hTx1xTvsoftmax•yxt: ! t $y : one-hot# 

2019@Shunnosuke Motomura AHC-Lab, IS, NAIST

9l Train11856E•••lDevelop2156ETest4310EI 6E*E 4 <-> DM   50%
Train F' B1G. >LTrain -> ?@ 2  K5


•l18


•7H,GRU:

%-CJ

10D#+.(3train develop=- 9$8 /)4= {5, 10, 20}- "; A = {5, 10, 20}- L26&! 0= {0, 0.0001, 0.001, 0.1}

2019/12/62019@Shunnosuke Motomura AHC-Lab, IS, NAIST

10l /-3$*

#.

3 -3(GRU

63.5*

71.6

61.6

0.6

GRU

55.4*

47.0

56.5

0.5

*: p < 0.01
4'/,59.5% [Tanaka et al, 2018]l (!2)2%'&

•$" 0%-> 0#.

%+"•1#)•

0.7

2019/12/6

3,1 .& +2(! (2019@Shunnosuke Motomura AHC-Lab, IS, NAIST*11l >?G RNNC3 (A@H+l••...

...

••/$I@HE) =2F6 ;#*08-> F6(A-> F63A.
A-%,G Cloze  [Kutas et.al, 1984] F64+ AD7:'&B!9->:'"<1/5"<1-

Kutas, M. et al, (1984). Brain potentials during reading reflect word expectancy and semanticassociation. Nature, 307(5947), 161.
2019@Shunnosuke Motomura AHC-Lab, IS, NAIST
2019/12/612