    **Augmented Human Communication Laboratory

JSPSJP17H06101






•





 

Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

2

•  (2016.10.4)

Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

3• .@)
AE+-(+-(

7>
02



• AE+ 9G;3$• + 9G;3$

• NAIST5D!$I*6• +"-!F• :$ 7%<? !F +"-AC 4/&H,'1B8#



=8Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

4

NAIST• 200451
200851
+@3#&#&:

• <>(=*2%.
4;"$! "(= 9?
• 201651&• /7(=,-8) 6• 201851'%%.

0

Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

5

• 02 3 %1(
• $ • "5 !
-

5,)

*'6&• "5  # 4.
• /+ *!

5

Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

6
$'G/%)
4
%:

73

&



4
50 




=,






A
8G

 A

2*F

A(+
4

*F
@C
-

1B6;E
/<#

1B6;E
@CA"9
>H!?D.;

Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

7
• 2016;971

35(

G46.5,

• 0A?F 5ED 6D• :B&3.
• ,*0A >IG=2
• Disfluency$'• &CHDisfluency+/%

•  <K6"8#4
• CH- ?@)!J

Augmented Human Communication Laboratory

SIG-NL 240 (2019/06/14)

8



 

 

1922
4

2762
4

(F )(F )KD(F )9W
: (P)(F )KD)N` I

2957
4

3782
4

(F )XY_<  (F )(F ){||*
*}9W?%'*(F ){|| "}FVAM
Q;) 

3858
7

6672
3

(F )(F )(F )9WS-342,.56
{||}8T)^%H LbJ[(P)(F)(F )(F )0+/1(F ){||}8T)^
% $  0+/17=(F )>R & #(F )(F )(F )(F )C]
& #\UPU (F )(F )''(F )9W@&%(F )XYRaZ(F)&)Oc(F )!{||}^(G )(F )EB%(P) Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

9 

2BAJ (9=L(
9=L1.!0 

Today's content is speech dialogue, I
am giving a lecture about speech
dialogue.

2BAJ

This is today's content.

 6 (9=L#$% First of all, I will explain simply what& the speech dialogue system is like.
! ,>:H (9=L#$%&"K<
-53 ;F!:H  E)C" 

Since various underlining
technologies are used for speech
dialogue, it is quite impossible toexplain everything.

2* ? 'D+FG =L8/
FG @I1.!7
 4 So, this time in this lecture I will
focus on the core part, on dialogue
control.

Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

10-.!9"• Kaldi [Povey+ 2011]

• $*DNN-HMM [Moriya+ 2015]• :>.A-@240/(• -.8. 3-gram'3• :>.A-@ 20?=
• ATR 57?=
• Web24 10#=• &)3< 1+ $5;0,%  67 52?=

• .B 26.4?
Augmented Human Communication Laboratory

SIG-NL 240 (2019/06/14)

11


• .%# 24[Luong+ 2015]• LSTM,*1 63-
• ASPEC[Nakazawa+ 2016]&+)• ("  /)• SentencePiece[Kudo+ 2018] 
• $70!516,000• 24'1: 10
Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

12  •  3%
• *%  •    •  ,1
• #$closed"&+• BLEU• '( /0•  )!500*2.
Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

13

 
• 3();
10%2• Disfluency%9,
• '(61






(%) ↓ (%) ↓( closed)



12.48

8.25

12.56

6.65

17.76

13.31

/8.:




*#

5"+$1!704-&

3()

;

Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

14

 



• 3(

10%6

>? BLEU• ?8*-•  719:BLEU-4
BLEU (%) ↑Brevity Penalty (%)!

15.9

90.8

"5=2@

21.1

89.7

.&

12.8

87.2

<%/)

 '$>?,#BLEU0+500;AAugmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

15

• 4+>@2 3C
• '

…



 !=-5

• (A9&0?C) :1
• *" 6F 3:,;• Disfluency #• /4+ E. • @7:8D $ %<B6
Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

16

•• #

• 
•



"$

•  % • !Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

17


• 6<$-!3=@)'• & ./ ?46.5*;• Kaldi37+• 5("NMT =@• >A8,#9

• 41



2B:0;• 37+% • Disfluency
Augmented Human Communication Laboratory
SIG-NL 240 (2019/06/14)

18