 

1

63
n

 5<PQ• ~2013.3, PhD@;., :
• 2013.4~2016.3, .0@IBM! /.
• 2016.4~2017.8, .0 @&"ERATO, NII• 2017.9~, @;., :n.0• *9

 DLHBCMJGM>$84 PECML’11Q
 ,>  PAISTATS’15,17Q• %#4JGM>7

 ANENIM >1+ PAISTATS’18Q
 JGM=?@KOF>2  PAAAI’17,18Q
 (4JGM>'-)> PongoingQ2/2;HE – 1n

$:@ *AI+ = *I%AF)

QMT+ I;49• 

QMTZ KVNRWL?OUJSP:(>?
MWLIB;>,F ?Xe.g. !" Y>8-9&3G7B?)• 

QMT? ;?5G6G1000D('&3G7')n*AI+ =<@1>=FC.>

#)3

/3;FD – 2nn

#:? +AI0MPKHNKHI8;E, G"=G$AE*+AI, B +AI> , B)-2@:B!(>7A>
LSQR*&&0 *• AI0MPKHNKHI:BC<.=@:)

GAE

?<.*
• + :1<.MPKHNKHI<AI?9JO, ;5E
?<.*% = G'6E>?@42<.*AI
AI 

4

WQYnn('9;AI_5!I] #<T,-U S?]D9+*SkmcTT4$VU/DLO@R@:,-DTTgmdQdlO@]1D?]:• abfjaT,-0T;F`R5!?LK\Q@A5SNE5!#T,-D@:n(C\T;gmdT)

H[R@n<<D:• %&QGO_9*R8S2QG7XFQP93*

S4"1CZG^R@:• TWWB7`PZ96ZheimSR\R@:nWJU9=5!#T D.LK*R > _MLO9TS) GK@:
5nAI nAI nAI 6)AI*#n(%'• !n&)-(%'• -))

#&$(!+)  ),")!

…

 72AI3*n1,0• !'n/29

1,0• 922*/+7& $%42 2 #"2XX ,816.(7)5 XX 
8=](2n-']6\AIgI\^7!K3^EKQFb]D• AIYX6

KBH:VUcr

 AI]#KfJc[HYCTbTb]%5bXL[HD #!CYAIg*4Qd[cCTbTbAI ]noklK[HDn<1ipmj/^EA_]7!].FKGdD• 8g>NUa\^$["K?DAI]
• EG[U\^19XL`RhFE[SrF;D +,g7!PWMe[Hipmj&/^@Oe[HDnT]q)C0C[Z[Z9]AIn?"^qn30l:An-0m]QUn?"^aG:<dvj_u\• !# QU),%61LKOMNP E"n• QUz p,7o[QUoQU
nn&>8p5$n?"8m.fu\ x}{y?"Cn• AIz p,7o[*D70,7pI
,7wr~ mex}{yw$gft`su\• SY 9B;TRVW mic(mh_j[n'wBeFw>fuCw7m@f\l• YX ?"8QUZQULKRQWVQ|~ ]Ia+=eJkbuQU^n24H/\10 11 EUGDPRGDPR-22
1. The data subject shall have the right not to be subject to a decision based
solely on automated processing, including profiling, which produces legaleffects concerning him or her or similarly significantly affects him or her.
2. Paragraph 1 shall not apply if the decision: is necessary for entering into, orperformance of, a contract between the data subject and a data controller; isauthorised by Union or Member State law to which the controller is subject
and which also lays down suitable measures to safeguard the data subject’s
rights and freedoms and legitimate interests; or is based on the data subject’s
explicit consent.
3. In the cases referred to in points (a) and (c) of paragraph 2, the data controller
shall implement suitable measures to safeguard the data subject’s rights andfreedoms and legitimate interests, at least the right to obtain humanintervention on the part of the controller, to express his or her point of viewand to contest the decision.
4. Decisions referred to in paragraph 2 shall not be based on special categories ofpersonal data referred to in Article 9(2)1), unless point (a) or (g) of Article 9(2)applies and suitable measures to safeguard the data subject’s rights andfreedoms and legitimate interests are in place.
n12
nAI n

AI nAI 

13

3n2016 #% "2"-5* 

3$/'AI3(• ICML, NIPS103

3;:</4'AI3(2"-5>?89=:<*!,6.)5&n

2016 /%GDPR2 -53 7+*,6.)5&

https://arxiv.org/abs/1606.08813

14n

AI Peeking inside the black-box: A survey on Explainable Artificial Intelligence (XAI)
https://ieeexplore.ieee.org/document/8466590/
7 SCOPUS,

IEEExplore, ACM Digital Library, Google
Scholar, Citeseer Library, ScienceDirect,
arXiv"% & “intelligible”,“interpretable”, “transparency”, “black box”,“understandable”, “comprehensible”,“explainable”
 AI& “Artificial Intelligence”, “Intelligentsystem”, “Machine learning”, “deep learning”,“classifier” , “decision tree”
#'$!

15()5n55"$:1/9%3&n*2;3.

n

3

-+ 6=><7

63,'

480139'• 1. #3

5 • 2. #3=><5• 3. AI5!
• 4. 489
• …



16

(nn

–1

.0-*'* /)#$" ,& % !+ 1**AI * #"
 $ ! 

Why Should I Trust You?: Explaining the Predictions of
Any Classifier, KDD’16.
17*n–25+%&$ 2),463 ("'#/ • /463("′, %′)&$("$.463",

-)0!.1/8n

7,

 • b 
Understanding Black-box Predictions via Influence
Functions, ICML’17.
18

, – 3nn9-58321 #,*)0$ (+*AI-+)0
:!

-

-AI" -• ,AI1&/0,647.' when
Relationship ≠ Not-in-family, Wife
Capital Gain < 7370

 when
Relationship ≠ Not-in-family
Capital Gain >= 7370

 when
Relationship ≠ Not-in-family, Unmarried
Capital Gain < 5095
Capital Loss < 2114

 when
Relationship = Not-in-familyCountry ≠ China, Peru
Capital Gain < 5095

 when
Relationship ≠ Not-in-familyCountry ≠ China
Capital Gain < 5095

 whenRelationship ≠ Not-in-family
Capital Gain < 7370%0

Making Tree Ensembles Interpretable: A BayesianModel Selection Approach, AISTATS’18.
19

(nn–4

.0-*'*  /)"#! , %  &$ + 1*

Generating Visual Explanations, ECCV’16.
20nAI nAI nAI 21

AI978->0)Dnnn2016

!#5$AI@/=%*->0".).! AI97*B0<'68(5&"5+4;

68C->:.?!B7 38C$AI@/=%61&2
7 A@,=*(0" 
22

AI96
nnn74-*<1$4$%C A 6&,<1;"27
5 %01$;"

 B :.6&'/>3 :01$4$"#37+1$<8! &+1(<;"
 C 6
366@B?&?A1$;")6?A=+4$3! 7*<4$"B, C9
23



B; 

+(n3

&4./$2$

• 203!2 "& )8/$7
• 13 9:-63&0'7%<n8, &58/*4./$7 5#7!
$ #"
   24nCQ 155GNC'CL0$<55(6?@EI?&;• WHI’18Q ICML’185MNABJDH  14/17 '?@EI?&; &;6Google Brain, IBM Research, Microsoft• XAI’18Q ICML’185MNABJDH  26/30 '?@EI?&; &;6Samsung Research, Spotify, OTTO , ORPn

55(6?@EI?'KNF• '!)>3#.,;+93$R"1$%4/$05=70$<)1' $• ,-*Google Brain:IBM328 
    25    $% '!#AI"&%
'!# 26" /#2,$&076 59 :4
%2,-  .1!2,)'38 +(07  *07 38
27

:`e\O!; QOfOn

"Mg

.O8b[_adZ]X[49 @JATKE<7• 8CVM9NP68CVM.9U=K*<7• 8CVM9O

6n

B@,7

WY^cW"EDh $%OHB• +@1SIM<OPLVM?i• +KEIU(DGTRA?inO"EDh -QO&2O• )3@>I<T/5P?i• #O O/5NEI6LVM'U0FTRA?i28

7nn

#K$8 QCNYF:?KV1KJM!L3_a]M"
GS1!N.A:24Y/A

QCN15*M>%ED#KF EG1ML" AD:26Y• AIPM

IADY #K0L&IA,R @IH1
'#L(H?Wb=SAXK:c@IY1ML)+A
GSU;2•  IADMQQ<@ZH:GS1MNL-Q
K:2
n5%ED 6>9XO1[\^`[S!S?TB:NC229n!

"AI • %#&$&Sun-In Lee https://www.biorxiv.org/content/early/2017/10/21/206540

we developed and tested a machine learning
based system called Prescience that predicts
real-time hypoxemia risk and presents anexplanation of factors contributing to that risk
Prescience improved anesthesiologists'
performance when providing interpretable
hypoxemia risks with contributing factors.
The results suggest that if anesthesiologists
currently anticipate 15% of events, then withPrescience assistance they could anticipate
30% of events

30
nAI • DeepMind https://www.nature.com/articles/s41591-018-0107-6   "  AI! 31

WQYnn('9;AI_5!I] #<T,-U S?]D9+*SkmcTT4$VU/DLO@R@:,-DTTgmdQdlO@]1D?]:• abfjaT,-0T;F`R5!?LK\Q@A5SNE5!#T,-D@:n(C\T;gmdT)

H[R@n<<D:• %&QGO_9*R8S2QG7XFQP93*S4"1CZG^R@:• TWWB7`PZ96ZheimSR\R@:nWJU9=5!#T D.LK*R > _MLO9TS) GK@:32

# – 1d 8AIQ29 R,P5Z[_nn3NEL'-DXL;W* R68<SA;KI9JB?DXL;W +?:W72"PR6GQAI/^c]M!0?.7• %$Q2"REP=WTQMRO;7n2PR/)b\c[T.7• HXOVP/)Z[_?>>W"?;7• 

PUKLR64QAIP.T:W7=L6Q2&AIYWn“12”T:VW7• 2Y(Pa[bc`FWU<P^c]YM@WCN? DXL;W733

! – 2X (DC*D9OQ<DIF3/nnn+ R-?C1AII?C5O2ETUWV?C
L.1FSEF:2 E34)I6AN:@;GI#5F3/
G?3HI1+2DIF:.1'2M12/AI80F ,D"%>P.AH 8 G&>
PO=ED.1FSEF:2 H I$BC3:7L?
PF3/
2 → 12/• 1AIH+2HI.1JSF8BC3O7N2HH
RKO=E/• 1JSF8BC3O7N34