AI20183231• •  •  

• Convolutional Neural Network (CNN)• Deep Q Network Q
• Q
• Deep Q Network• 2018323

2


• Go#/1I• ?<=S2+23Mq• ($6q(D]_)• Go#/2I
AIM
E:
Csjh (`UAI'")($PfZYTt*
5&![dNlAIUe>8 WJ
a q

AI*bA• gO79r^@Bv• ;\nu,3KX 32iQ• %1&)-&)LockF • '.
• ?<=SZY
2018323

0(4mRpVHq3•  )-LRI;• AI0A 5.H :4@P2 63• &(#!'#!"$"%@P2 63• :4(1*)@P+S• Adversarial examples• AID M?/FH EKQ*OGM? @P• C17/F* 
• >K,J=N?<9  8M? 63B

2018323

4

• AI7- TG H96 D
84ZSPM< B@•  

• '$( >K Deep LearningCUYZNY.
• 96CU /!'$(>KA, 1 RXB=0W :HRXOQ  •  V#&)* B@• Deep LearningCU J/NY.
• 5+/ECU3Deep LearningL; DQN
?LY.
• H2B="% F/ECUY.
I

2018323

5

Convolutional Neural Network (CNN)• Deep Neural Network %
• ?6D7&73.;• (9>(@4+,@4"$ 'B• Deep Learning) :1 CNN/B• #2Deep Learning――Python )  $
582018323

CE• 0= -* < !$ 6A
• GitHub
https://github.com/oreilly-japan/deep-learning-fromscratch
6CNN

https://qiita.com/eijian/items/06b1ba1276d1bfd77b93

Convolu'onal Layer•••

Pooling Layer•••
2018323+7CNN

• &($89=:;+%* "6+%*54• 2
02/ <=• !1 #0#0  #0ReLU• )7 -=
SGDMomentumAdaGradAdam• 3,#0
2.>&('( &(2018323

8

Deep Q Network Q
• Q1F

• 8/1F-E• 8/1F• Wikipedia• 27R !$ +% <?HK3I D =P;NVL,501F-E• 8/1F-Z=PMTG >J QU@(policy)1F• YAlphaGoBP.O
• BP.OY
8/1F

9AW
C46Xm&*"

2018323#'(*#)+
:S B
C46X1F

9Deep Q Network Q
• Q3B

• 603B9L2H4E&3B#5!%• %DG

9L2H&O%• Q3B8=DG $?DG-<?DG
I;"9L2H4EH :DG7%#3B%
• 1 2H : NC&O %3B&%• @L/JP'+)
8=DG

?DG
*,(?DG>%.F
DG9L"2H :3B%Q(λ)2F3F
KM 2018323*,(*,(&%FA $2H :
2H :  NC3B%

10

Deep Q Network Q
• MountainCar ! &• $   ! &
•  "• # 

1%
2018323

181%
11

Deep Q Network Q• &8• 36F.%<E• 36)C;H59H59
 F.% +/#"

• @2DA-=• @2DA• 

<E

(10

#!$*?

• MountainCar>:Q(1,2018323

+/GB7
<E<E
500'4,Q(λ)200'4

12Q
• !$*()

• *'
X:10.5 Y:37.8→ *
X:2 Y:42018323

 !$&%
& "#13

Deep Q Network



(Q

10
20183232)





10
2←

→10214

Deep Q Network• Experience Replay• # 2@ =3S:I45  0K*+-,. ).'-.

• Fixed Target Q-Network• ($%"!2@M?Q-NetworkB;E• RA-"&.
• G9 +1>P -1RA7N• 8<4F-"&.
• OD8<HJL1/1//C2018323

4F6Q

15


• =A.9:4<7@1BDKIGH(+$0M .%)# '# !,;E• Adversarial Examples?8>.97@ 32  7@L- C6
5&*"FJ/

2018323

16
• Deep Learning+(*    AI4&3 !1 .$2
• " ) DQN  560 )' #% / ',0.$2

2018323

17()• Deep Learning)!&)*
#"A9   %)("5<8=1E :7- D.• 6 Deep Learning42;B/0C 7?, '!+$>3@

2018323

18
• Deep Learning!*+)#(adversarial examples2&• "1- , /• Deep LearningGPU$. 0%' 2018323

19