Summary

Study 2. Aggregation of Multiple Paths! Standard	  phrase-­‐based	  SMT	  systems	  +	  paraphrases	   Phrase	  table	  augmenta1on	  (transla1on	  pair	  fabrica1on)	  ! Source-­‐side	  augmenta1on	  ! Beder	  performance	  over	  a	  vanilla	  phrase-­‐based	  SMT	  zoom	  ac1on	  0.002/0.005	

ズーム動作

zooming	  0.021/0.003	

ズーミング動作0.650	! Target-­‐side	  augmenta1on	  Transla1on	  table	
health	  issue	  |||	  problème	  de	  santé	  health	  problem	  |||	  problème	  de	  santé	  look	  like	  |||	  ressemble	  regional	  issue	  |||	  problème	  régional	  regional	  problem	  |||	  problème	  régional	  resemble	  |||	  ressemble	  [Bannard+,	  05]	PSeed:	  Seed	  paraphrases	
health	  issue	  ⇔	  health	  problem	  regional	  issue	  ⇔	  regional	  problem	  look	  like	  ⇔	  resemble	  Monolingual	  Non-­‐parallel	  Corpus

0.709	

zooming	  opera1on	  0.228/0.136	

zoom	  opera1on	  0.352	

Study 1. Paraphrase Collections

Bilingual	  Parallel	  Corpus	

0.735	

0.317/0.195	

ズーム動作
0.606	

Study 3. Features for Decoding! Scores	  of	  individual	  transla1on	  pair	   Kneser-­‐Ney	  es1mates	  (original	  pairs)	  [Chen+,	  11]	  X	  issue	  ⇔	  X	  problem	  	  X	  ∋	  {“health”,	  “regional”}	  backlog	  issue	  ⇔	  backlog	  problem	  communal	  issue	  ⇔	  communal	  problem	  phishing	  issue	  ⇔	  phishing	  problem	  spa1al	  issue	  ⇔	  spa1al	  problem	  0.463	

ズーム操作
変倍動作

0.046/0.008	

Paraphrase	  paderns	

[Fujita+,12]	
PHvst:	  Harvested	  paraphrases	

0.146/0.108	

zooming	  opera1on	  Transla1on	  score	  (fabricated	  pairs)	   e.g.,	  Backward	  score	  of	  source-­‐side	  augmenta1on	  ⌘P ⇣0p(s|t)Para(s)s)
s2S
Pp(s0 |t) =0Para(s)s)
s2S
Zens-­‐Ney	  lexical	  es1mates	  (all	  pairs)	  [Zens+,	  04]	  ! Transla1on	  pair	  indicators	   Alignment	  indicators	  (IBM2,	  HMM,	  IBM4)	  Paraphrase	  collec1on	  indicators	  (PSeed,	  PHvst/POOPH)	   OOPH	  indicators	  (at	  phrase-­‐table	  level,	  at	  corpus-­‐level)	  ! Paraphrase	  score:	  an	  avg.	  score	  of	  each	  pair	  involved	  POOPH:	  Unseen	  phrases	  	  Seen	  phrases	 PivProb	  [Bannard+,	  05]	  vs.	  Cosine	  similarity	  [Marton+,	  09]	  Development

Oﬃcial Results#	  of	  trans.	  pairs	
IBM2	
HMM	
IBM4	
Union	

#	  of	  paraphrase	  pairs	

Ja	  	  En	 En	   Ja	
extrac1on	
9.4M	
9.1M	
ﬁltering	
230.6M	 234.4M	
expansion	
80.6M	 81.8M	
ﬁltering	
260.4M	 264.8M	

PSeed	

thp	 ths	0	 0	En	Ja	
7.2M	 5.1M	

PSeed	 0.01	 0.1	 1.1M	 0.8M	
PHvst	 0.01	 0	 272M	 143M	
PHvst	 0.01	 0.1	 ?????	 ?????	

dev&test data driven

Model	  selec1on	  using	  held-­‐out	  data	  (ntc7	  &	  ntc8)	  (Minimal	  phrase	  table	  is	  created)	
System	Base	  system	
Saug-­‐PSeed	
Saug-­‐PSeed	
Saug-­‐PHvst	
Saug-­‐POOPH	Ja	  	  En	En	   Ja	
Para	  #	  of	  trans.	  
#	  of	  trans.	  
score	BLEU	BLEU	pairs	
pairs	-­‐	18.0M	 33.30	
15.5M	 37.64	
PivProb	 27.3M	 33.65	 +0.35	 24.6M	 37.98	 +0.34	
Cosine	 27.3M	 33.27	 -­‐0.03	 24.6M	 37.73	 +0.09	
Cosine	 23.6M	 33.22	 -­‐0.08	 22.0M	 37.89	 +0.25	

Cosine	Saug-­‐PSeed+PHvst	 Cosine	
Taug-­‐PSeed	
PivProb	
Cosine	Taug-­‐PSeed	
Cosine	Taug-­‐PHvst	

18.1M	 33.72	 +0.42	
32.8M	 32.91	 -­‐0.39	
22.9M	 33.34	 +0.04	
22.9M	 33.56	 +0.26	
29.1M	 33.43	 +0.13	

15.6M	 38.16	 +0.52	
30.9M	 37.76	 +0.12	

Cosine	Taug-­‐POOPH	
Taug-­‐PSeed+PHvst	 Cosine	

23.4M	 33.21	 -­‐0.09	
33.9M	 32.99	 -­‐0.31	

21.5M	 38.08	 +0.44	
30.8M	 37.53	 -­‐0.11	

19.6M	 37.64	 +0.00	
19.6M	 38.19	 +0.55	
26.8M	 37.98	 +0.34	

Ja	  	  En	En	   Ja	
BLEU	 NIST	 RIBES	 BLEU	 NIST	 RIBES	

System	
Saug-­‐POOPH	
Taug-­‐PSeed	

31.56	 8.2507	 0.6955	 34.22	 8.2345	 0.7096	
31.65	 8.2198	 0.6929	 34.05	 8.2116	 0.7089	

*Const-­‐Saug-­‐PHvst	 30.58	 8.1114	 0.6911	 32.89	 8.0977	 0.7048	
*Const	  mixLM	
30.65	 8.1400	 0.6906	 22.59	 7.1185	 0.6651	
*Systems	  built	  using	  only	  bilingual	  data.	

33.03	 8.1101	 0.7051	

Results w/ Relaxed Distortion Limit
Ja	  	  En	

35.5En	   Ja	

40.5
403539.5

34.5

BLEU	 3439
38.5
Base system
Saug-OOPH
Taug-Seed

33.5
336

81012141618

Base system
Saug-OOPH
Taug-Seed

3837.5200.7468101214

161820

0.77
0.76

0.73

0.75RIBES	
0.72

0.74

0.71

Base system
Saug-OOPH
Taug-Seed

0.7
681012141618

Base system
Saug-OOPH
Taug-Seed

0.73
0.72
20

68101214161820