File size: 25,908 Bytes
78aa4ee
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
Steps: 1000	Loss: 101679.10156	PPL: 49.33279	bleu: 1.33240	LR: 0.00030000	*
Steps: 2000	Loss: 88058.70312	PPL: 29.26390	bleu: 2.45411	LR: 0.00030000	*
Steps: 3000	Loss: 80679.00000	PPL: 22.05196	bleu: 4.06626	LR: 0.00030000	*
Steps: 4000	Loss: 75131.75000	PPL: 17.82689	bleu: 5.93282	LR: 0.00030000	*
Steps: 5000	Loss: 71755.00000	PPL: 15.66199	bleu: 6.58848	LR: 0.00030000	*
Steps: 6000	Loss: 68735.87500	PPL: 13.94997	bleu: 7.54377	LR: 0.00030000	*
Steps: 7000	Loss: 66262.40625	PPL: 12.68777	bleu: 8.01831	LR: 0.00030000	*
Steps: 8000	Loss: 64169.54688	PPL: 11.70943	bleu: 9.94326	LR: 0.00030000	*
Steps: 9000	Loss: 62004.48828	PPL: 10.77665	bleu: 11.03149	LR: 0.00030000	*
Steps: 10000	Loss: 60213.03906	PPL: 10.06127	bleu: 11.97307	LR: 0.00030000	*
Steps: 11000	Loss: 59205.46484	PPL: 9.67999	bleu: 12.25209	LR: 0.00030000	*
Steps: 12000	Loss: 57379.75000	PPL: 9.02555	bleu: 13.70872	LR: 0.00030000	*
Steps: 13000	Loss: 56491.82812	PPL: 8.72345	bleu: 14.60505	LR: 0.00030000	*
Steps: 14000	Loss: 55644.25781	PPL: 8.44451	bleu: 14.64641	LR: 0.00030000	*
Steps: 15000	Loss: 54724.98047	PPL: 8.15205	bleu: 15.57949	LR: 0.00030000	*
Steps: 16000	Loss: 53939.67969	PPL: 7.91026	bleu: 16.26362	LR: 0.00030000	*
Steps: 17000	Loss: 53433.07812	PPL: 7.75809	bleu: 16.70799	LR: 0.00030000	*
Steps: 18000	Loss: 52861.15234	PPL: 7.58981	bleu: 17.01954	LR: 0.00030000	*
Steps: 19000	Loss: 52035.28125	PPL: 7.35324	bleu: 17.63327	LR: 0.00030000	*
Steps: 20000	Loss: 51777.23438	PPL: 7.28085	bleu: 17.72100	LR: 0.00030000	*
Steps: 21000	Loss: 51327.28125	PPL: 7.15631	bleu: 17.33761	LR: 0.00030000	*
Steps: 22000	Loss: 50891.76562	PPL: 7.03781	bleu: 18.16474	LR: 0.00030000	*
Steps: 23000	Loss: 50144.26172	PPL: 6.83896	bleu: 18.18213	LR: 0.00030000	*
Steps: 24000	Loss: 49846.03516	PPL: 6.76121	bleu: 18.82128	LR: 0.00030000	*
Steps: 25000	Loss: 49549.55078	PPL: 6.68478	bleu: 18.57156	LR: 0.00030000	*
Steps: 26000	Loss: 49035.42578	PPL: 6.55430	bleu: 19.03277	LR: 0.00030000	*
Steps: 27000	Loss: 48913.80078	PPL: 6.52380	bleu: 19.10633	LR: 0.00030000	*
Steps: 28000	Loss: 48533.06641	PPL: 6.42926	bleu: 19.39287	LR: 0.00030000	*
Steps: 29000	Loss: 48354.89453	PPL: 6.38549	bleu: 19.43792	LR: 0.00030000	*
Steps: 30000	Loss: 47965.75391	PPL: 6.29092	bleu: 19.62763	LR: 0.00030000	*
Steps: 31000	Loss: 47858.84766	PPL: 6.26518	bleu: 20.14754	LR: 0.00030000	*
Steps: 32000	Loss: 47841.95312	PPL: 6.26113	bleu: 20.04378	LR: 0.00030000	*
Steps: 33000	Loss: 47557.24609	PPL: 6.19315	bleu: 19.63941	LR: 0.00030000	*
Steps: 34000	Loss: 47185.04297	PPL: 6.10540	bleu: 19.80409	LR: 0.00030000	*
Steps: 35000	Loss: 46868.43359	PPL: 6.03173	bleu: 20.57481	LR: 0.00030000	*
Steps: 36000	Loss: 46619.85938	PPL: 5.97451	bleu: 20.45801	LR: 0.00030000	*
Steps: 37000	Loss: 46506.66406	PPL: 5.94864	bleu: 20.56136	LR: 0.00030000	*
Steps: 38000	Loss: 46380.87891	PPL: 5.92002	bleu: 20.62308	LR: 0.00030000	*
Steps: 39000	Loss: 46074.70703	PPL: 5.85093	bleu: 20.51120	LR: 0.00030000	*
Steps: 40000	Loss: 46016.93750	PPL: 5.83798	bleu: 20.72798	LR: 0.00030000	*
Steps: 41000	Loss: 45913.75781	PPL: 5.81493	bleu: 20.76427	LR: 0.00030000	*
Steps: 42000	Loss: 45596.52344	PPL: 5.74463	bleu: 20.97934	LR: 0.00030000	*
Steps: 43000	Loss: 45430.04297	PPL: 5.70808	bleu: 21.19879	LR: 0.00030000	*
Steps: 44000	Loss: 45194.33984	PPL: 5.65673	bleu: 21.41042	LR: 0.00030000	*
Steps: 45000	Loss: 45369.07812	PPL: 5.69475	bleu: 20.80849	LR: 0.00030000	
Steps: 46000	Loss: 45157.38281	PPL: 5.64872	bleu: 21.17630	LR: 0.00030000	*
Steps: 47000	Loss: 44869.47656	PPL: 5.58670	bleu: 21.40846	LR: 0.00030000	*
Steps: 48000	Loss: 44749.16016	PPL: 5.56099	bleu: 21.66075	LR: 0.00030000	*
Steps: 49000	Loss: 44515.61328	PPL: 5.51142	bleu: 21.63240	LR: 0.00030000	*
Steps: 50000	Loss: 44514.06641	PPL: 5.51109	bleu: 21.36828	LR: 0.00030000	*
Steps: 51000	Loss: 44464.16406	PPL: 5.50055	bleu: 21.88695	LR: 0.00030000	*
Steps: 52000	Loss: 44206.90625	PPL: 5.44657	bleu: 21.82749	LR: 0.00030000	*
Steps: 53000	Loss: 44414.19141	PPL: 5.49003	bleu: 21.38103	LR: 0.00030000	
Steps: 54000	Loss: 43957.08203	PPL: 5.39464	bleu: 21.86449	LR: 0.00030000	*
Steps: 55000	Loss: 43946.18750	PPL: 5.39239	bleu: 21.84823	LR: 0.00030000	*
Steps: 56000	Loss: 43917.27344	PPL: 5.38641	bleu: 22.03345	LR: 0.00030000	*
Steps: 57000	Loss: 43951.16016	PPL: 5.39342	bleu: 22.03252	LR: 0.00030000	
Steps: 58000	Loss: 43622.57812	PPL: 5.32589	bleu: 22.28939	LR: 0.00030000	*
Steps: 59000	Loss: 43329.02734	PPL: 5.26629	bleu: 22.05428	LR: 0.00030000	*
Steps: 60000	Loss: 43353.47266	PPL: 5.27122	bleu: 22.43904	LR: 0.00030000	
Steps: 61000	Loss: 43338.01172	PPL: 5.26810	bleu: 22.72373	LR: 0.00030000	
Steps: 62000	Loss: 43176.97656	PPL: 5.23567	bleu: 22.60875	LR: 0.00030000	*
Steps: 63000	Loss: 43042.35156	PPL: 5.20872	bleu: 22.23387	LR: 0.00030000	*
Steps: 64000	Loss: 43078.14844	PPL: 5.21587	bleu: 22.40861	LR: 0.00030000	
Steps: 65000	Loss: 42972.92969	PPL: 5.19487	bleu: 22.62606	LR: 0.00030000	*
Steps: 66000	Loss: 42892.09766	PPL: 5.17880	bleu: 22.74644	LR: 0.00030000	*
Steps: 67000	Loss: 42809.83594	PPL: 5.16249	bleu: 22.39873	LR: 0.00030000	*
Steps: 68000	Loss: 42824.83203	PPL: 5.16546	bleu: 22.52395	LR: 0.00030000	
Steps: 69000	Loss: 42665.92969	PPL: 5.13408	bleu: 22.52202	LR: 0.00030000	*
Steps: 70000	Loss: 42583.83984	PPL: 5.11795	bleu: 22.84108	LR: 0.00030000	*
Steps: 71000	Loss: 42339.40625	PPL: 5.07021	bleu: 23.10021	LR: 0.00030000	*
Steps: 72000	Loss: 42293.76562	PPL: 5.06134	bleu: 22.49275	LR: 0.00030000	*
Steps: 73000	Loss: 42467.15625	PPL: 5.09510	bleu: 23.01485	LR: 0.00030000	
Steps: 74000	Loss: 42306.43359	PPL: 5.06380	bleu: 23.19691	LR: 0.00030000	
Steps: 75000	Loss: 42134.84766	PPL: 5.03059	bleu: 22.88508	LR: 0.00030000	*
Steps: 76000	Loss: 42335.34766	PPL: 5.06942	bleu: 22.88428	LR: 0.00030000	
Steps: 77000	Loss: 42171.86328	PPL: 5.03774	bleu: 22.97889	LR: 0.00030000	
Steps: 78000	Loss: 41915.05859	PPL: 4.98838	bleu: 23.03592	LR: 0.00030000	*
Steps: 79000	Loss: 42061.46875	PPL: 5.01646	bleu: 23.08098	LR: 0.00030000	
Steps: 80000	Loss: 42113.18359	PPL: 5.02642	bleu: 22.98955	LR: 0.00030000	
Steps: 81000	Loss: 41758.39844	PPL: 4.95851	bleu: 22.86890	LR: 0.00030000	*
Steps: 82000	Loss: 41731.75391	PPL: 4.95344	bleu: 23.23269	LR: 0.00030000	*
Steps: 83000	Loss: 41801.21484	PPL: 4.96665	bleu: 23.31127	LR: 0.00030000	
Steps: 84000	Loss: 41782.59375	PPL: 4.96311	bleu: 23.22442	LR: 0.00030000	
Steps: 85000	Loss: 41711.61719	PPL: 4.94962	bleu: 23.37525	LR: 0.00030000	*
Steps: 86000	Loss: 41770.56641	PPL: 4.96082	bleu: 23.11197	LR: 0.00030000	
Steps: 87000	Loss: 41436.55078	PPL: 4.89769	bleu: 23.20010	LR: 0.00030000	*
Steps: 88000	Loss: 41524.67578	PPL: 4.91427	bleu: 23.49476	LR: 0.00030000	
Steps: 89000	Loss: 41540.50391	PPL: 4.91725	bleu: 23.34480	LR: 0.00030000	
Steps: 90000	Loss: 41290.56641	PPL: 4.87035	bleu: 23.12195	LR: 0.00030000	*
Steps: 91000	Loss: 41327.60547	PPL: 4.87728	bleu: 23.44402	LR: 0.00030000	
Steps: 92000	Loss: 41247.03125	PPL: 4.86223	bleu: 23.15953	LR: 0.00030000	*
Steps: 93000	Loss: 41187.75000	PPL: 4.85119	bleu: 23.57970	LR: 0.00030000	*
Steps: 94000	Loss: 41166.05469	PPL: 4.84716	bleu: 23.67379	LR: 0.00030000	*
Steps: 95000	Loss: 41061.65234	PPL: 4.82779	bleu: 23.50138	LR: 0.00030000	*
Steps: 96000	Loss: 41026.46094	PPL: 4.82128	bleu: 23.74046	LR: 0.00030000	*
Steps: 97000	Loss: 40990.12500	PPL: 4.81457	bleu: 23.74295	LR: 0.00030000	*
Steps: 98000	Loss: 40944.87891	PPL: 4.80623	bleu: 23.84000	LR: 0.00030000	*
Steps: 99000	Loss: 41057.69531	PPL: 4.82706	bleu: 23.80839	LR: 0.00030000	
Steps: 100000	Loss: 40912.97656	PPL: 4.80035	bleu: 23.53383	LR: 0.00030000	*
Steps: 101000	Loss: 40766.28516	PPL: 4.77343	bleu: 24.25189	LR: 0.00030000	*
Steps: 102000	Loss: 40830.78125	PPL: 4.78525	bleu: 23.38600	LR: 0.00030000	
Steps: 103000	Loss: 40713.16406	PPL: 4.76371	bleu: 24.02089	LR: 0.00030000	*
Steps: 104000	Loss: 40834.70312	PPL: 4.78597	bleu: 23.53414	LR: 0.00030000	
Steps: 105000	Loss: 40768.17578	PPL: 4.77377	bleu: 23.88244	LR: 0.00030000	
Steps: 106000	Loss: 40597.51172	PPL: 4.74264	bleu: 23.86986	LR: 0.00030000	*
Steps: 107000	Loss: 40599.54297	PPL: 4.74301	bleu: 24.01265	LR: 0.00030000	
Steps: 108000	Loss: 40465.15625	PPL: 4.71863	bleu: 23.77551	LR: 0.00030000	*
Steps: 109000	Loss: 40399.41797	PPL: 4.70675	bleu: 23.87734	LR: 0.00030000	*
Steps: 110000	Loss: 40642.17578	PPL: 4.75077	bleu: 23.86125	LR: 0.00030000	
Steps: 111000	Loss: 40342.22656	PPL: 4.69644	bleu: 24.20626	LR: 0.00030000	*
Steps: 112000	Loss: 40421.64453	PPL: 4.71076	bleu: 23.87079	LR: 0.00030000	
Steps: 113000	Loss: 40385.76172	PPL: 4.70429	bleu: 24.06776	LR: 0.00030000	
Steps: 114000	Loss: 40343.88281	PPL: 4.69674	bleu: 24.07500	LR: 0.00030000	
Steps: 115000	Loss: 40497.32812	PPL: 4.72445	bleu: 24.32898	LR: 0.00030000	
Steps: 116000	Loss: 40240.77734	PPL: 4.67821	bleu: 24.41094	LR: 0.00030000	*
Steps: 117000	Loss: 40269.53516	PPL: 4.68337	bleu: 24.32106	LR: 0.00030000	
Steps: 118000	Loss: 40206.21484	PPL: 4.67201	bleu: 24.24703	LR: 0.00030000	*
Steps: 119000	Loss: 40100.55469	PPL: 4.65312	bleu: 24.40075	LR: 0.00030000	*
Steps: 120000	Loss: 40076.69531	PPL: 4.64887	bleu: 23.82390	LR: 0.00030000	*
Steps: 121000	Loss: 39988.56641	PPL: 4.63319	bleu: 24.45055	LR: 0.00030000	*
Steps: 122000	Loss: 40067.46875	PPL: 4.64723	bleu: 24.01967	LR: 0.00030000	
Steps: 123000	Loss: 40119.18750	PPL: 4.65645	bleu: 24.15491	LR: 0.00030000	
Steps: 124000	Loss: 40116.58203	PPL: 4.65599	bleu: 23.83102	LR: 0.00030000	
Steps: 125000	Loss: 40037.85547	PPL: 4.64195	bleu: 24.24915	LR: 0.00030000	
Steps: 126000	Loss: 39932.27344	PPL: 4.62320	bleu: 23.78899	LR: 0.00030000	*
Steps: 127000	Loss: 40056.46875	PPL: 4.64527	bleu: 23.75064	LR: 0.00030000	
Steps: 128000	Loss: 39960.00391	PPL: 4.62812	bleu: 24.20816	LR: 0.00030000	
Steps: 129000	Loss: 39824.81641	PPL: 4.60419	bleu: 24.08688	LR: 0.00030000	*
Steps: 130000	Loss: 40194.14844	PPL: 4.66985	bleu: 23.89545	LR: 0.00030000	
Steps: 131000	Loss: 39864.52344	PPL: 4.61120	bleu: 24.52751	LR: 0.00030000	
Steps: 132000	Loss: 39867.10547	PPL: 4.61166	bleu: 24.30390	LR: 0.00030000	
Steps: 133000	Loss: 39768.19531	PPL: 4.59420	bleu: 24.12154	LR: 0.00030000	*
Steps: 134000	Loss: 39608.72266	PPL: 4.56620	bleu: 24.05779	LR: 0.00030000	*
Steps: 135000	Loss: 39667.46484	PPL: 4.57649	bleu: 24.45814	LR: 0.00030000	
Steps: 136000	Loss: 39619.28906	PPL: 4.56805	bleu: 24.36177	LR: 0.00030000	
Steps: 137000	Loss: 39684.97656	PPL: 4.57957	bleu: 24.21350	LR: 0.00030000	
Steps: 138000	Loss: 39768.20312	PPL: 4.59421	bleu: 24.20446	LR: 0.00030000	
Steps: 139000	Loss: 39662.10938	PPL: 4.57556	bleu: 24.77856	LR: 0.00030000	
Steps: 140000	Loss: 39570.71484	PPL: 4.55955	bleu: 23.79534	LR: 0.00030000	*
Steps: 141000	Loss: 39411.42969	PPL: 4.53179	bleu: 24.67024	LR: 0.00030000	*
Steps: 142000	Loss: 39430.42188	PPL: 4.53509	bleu: 23.93959	LR: 0.00030000	
Steps: 143000	Loss: 39545.50000	PPL: 4.55514	bleu: 24.50400	LR: 0.00030000	
Steps: 144000	Loss: 39565.53906	PPL: 4.55864	bleu: 24.34218	LR: 0.00030000	
Steps: 145000	Loss: 39404.74219	PPL: 4.53063	bleu: 24.04266	LR: 0.00030000	*
Steps: 146000	Loss: 39470.20312	PPL: 4.54201	bleu: 24.45154	LR: 0.00030000	
Steps: 147000	Loss: 39418.54688	PPL: 4.53302	bleu: 24.41024	LR: 0.00030000	
Steps: 148000	Loss: 39543.28906	PPL: 4.55476	bleu: 24.66010	LR: 0.00030000	
Steps: 149000	Loss: 39386.12500	PPL: 4.52739	bleu: 24.63091	LR: 0.00030000	*
Steps: 150000	Loss: 39426.64844	PPL: 4.53443	bleu: 24.64088	LR: 0.00030000	
Steps: 151000	Loss: 39362.42969	PPL: 4.52328	bleu: 24.27962	LR: 0.00030000	*
Steps: 152000	Loss: 39311.46484	PPL: 4.51445	bleu: 24.50753	LR: 0.00030000	*
Steps: 153000	Loss: 39197.44141	PPL: 4.49476	bleu: 24.58805	LR: 0.00030000	*
Steps: 154000	Loss: 39326.75000	PPL: 4.51710	bleu: 24.69803	LR: 0.00030000	
Steps: 155000	Loss: 39259.05078	PPL: 4.50539	bleu: 24.81798	LR: 0.00030000	
Steps: 156000	Loss: 39199.46875	PPL: 4.49511	bleu: 24.57370	LR: 0.00030000	
Steps: 157000	Loss: 39282.15625	PPL: 4.50938	bleu: 24.73571	LR: 0.00030000	
Steps: 158000	Loss: 39249.12891	PPL: 4.50367	bleu: 24.72239	LR: 0.00030000	
Steps: 159000	Loss: 39104.40234	PPL: 4.47875	bleu: 24.96477	LR: 0.00030000	*
Steps: 160000	Loss: 39214.86719	PPL: 4.49776	bleu: 24.05002	LR: 0.00030000	
Steps: 161000	Loss: 39105.10156	PPL: 4.47887	bleu: 24.28783	LR: 0.00030000	
Steps: 162000	Loss: 39018.82422	PPL: 4.46408	bleu: 24.73780	LR: 0.00030000	*
Steps: 163000	Loss: 38984.87500	PPL: 4.45827	bleu: 24.86656	LR: 0.00030000	*
Steps: 164000	Loss: 39074.98047	PPL: 4.47370	bleu: 24.85352	LR: 0.00030000	
Steps: 165000	Loss: 39015.23047	PPL: 4.46347	bleu: 24.23604	LR: 0.00030000	
Steps: 166000	Loss: 39068.39453	PPL: 4.47257	bleu: 24.49343	LR: 0.00030000	
Steps: 167000	Loss: 39021.19531	PPL: 4.46449	bleu: 24.49139	LR: 0.00030000	
Steps: 168000	Loss: 38896.71875	PPL: 4.44323	bleu: 24.89473	LR: 0.00030000	*
Steps: 169000	Loss: 38997.51562	PPL: 4.46043	bleu: 24.82493	LR: 0.00030000	
Steps: 170000	Loss: 38739.85547	PPL: 4.41659	bleu: 24.71142	LR: 0.00030000	*
Steps: 171000	Loss: 38971.53906	PPL: 4.45599	bleu: 24.65804	LR: 0.00030000	
Steps: 172000	Loss: 38906.62500	PPL: 4.44492	bleu: 24.59160	LR: 0.00030000	
Steps: 173000	Loss: 38903.49219	PPL: 4.44438	bleu: 24.52246	LR: 0.00030000	
Steps: 174000	Loss: 38875.42188	PPL: 4.43960	bleu: 25.01598	LR: 0.00030000	
Steps: 175000	Loss: 38816.67969	PPL: 4.42961	bleu: 25.02861	LR: 0.00030000	
Steps: 176000	Loss: 38755.00391	PPL: 4.41915	bleu: 24.79982	LR: 0.00021000	
Steps: 177000	Loss: 38593.99609	PPL: 4.39195	bleu: 24.91530	LR: 0.00021000	*
Steps: 178000	Loss: 38723.52344	PPL: 4.41382	bleu: 24.98486	LR: 0.00021000	
Steps: 179000	Loss: 38475.04297	PPL: 4.37197	bleu: 25.30374	LR: 0.00021000	*
Steps: 180000	Loss: 38445.12891	PPL: 4.36696	bleu: 25.03510	LR: 0.00021000	*
Steps: 181000	Loss: 38434.19922	PPL: 4.36513	bleu: 25.15144	LR: 0.00021000	*
Steps: 182000	Loss: 38472.80078	PPL: 4.37159	bleu: 25.40420	LR: 0.00021000	
Steps: 183000	Loss: 38301.28516	PPL: 4.34294	bleu: 25.08173	LR: 0.00021000	*
Steps: 184000	Loss: 38346.58594	PPL: 4.35049	bleu: 25.42036	LR: 0.00021000	
Steps: 185000	Loss: 38335.68750	PPL: 4.34867	bleu: 25.23870	LR: 0.00021000	
Steps: 186000	Loss: 38368.85547	PPL: 4.35421	bleu: 25.07541	LR: 0.00021000	
Steps: 187000	Loss: 38303.77344	PPL: 4.34335	bleu: 25.15464	LR: 0.00021000	
Steps: 188000	Loss: 38259.19922	PPL: 4.33594	bleu: 25.08374	LR: 0.00021000	*
Steps: 189000	Loss: 38157.01953	PPL: 4.31898	bleu: 25.18103	LR: 0.00021000	*
Steps: 190000	Loss: 38184.35938	PPL: 4.32351	bleu: 25.07878	LR: 0.00021000	
Steps: 191000	Loss: 38139.82422	PPL: 4.31614	bleu: 25.33993	LR: 0.00021000	*
Steps: 192000	Loss: 38227.16406	PPL: 4.33061	bleu: 25.16416	LR: 0.00021000	
Steps: 193000	Loss: 38130.87500	PPL: 4.31465	bleu: 25.05110	LR: 0.00021000	*
Steps: 194000	Loss: 38223.31250	PPL: 4.32997	bleu: 25.31304	LR: 0.00021000	
Steps: 195000	Loss: 38078.04297	PPL: 4.30592	bleu: 24.60500	LR: 0.00021000	*
Steps: 196000	Loss: 38149.82031	PPL: 4.31779	bleu: 24.95405	LR: 0.00021000	
Steps: 197000	Loss: 38087.96875	PPL: 4.30756	bleu: 25.21499	LR: 0.00021000	
Steps: 198000	Loss: 38160.57031	PPL: 4.31957	bleu: 25.16539	LR: 0.00021000	
Steps: 199000	Loss: 38017.49219	PPL: 4.29594	bleu: 25.43484	LR: 0.00021000	*
Steps: 200000	Loss: 37982.92578	PPL: 4.29025	bleu: 25.19321	LR: 0.00021000	*
Steps: 201000	Loss: 38074.82812	PPL: 4.30539	bleu: 25.09514	LR: 0.00021000	
Steps: 202000	Loss: 38016.60547	PPL: 4.29579	bleu: 25.77261	LR: 0.00021000	
Steps: 203000	Loss: 37956.78516	PPL: 4.28595	bleu: 26.02557	LR: 0.00021000	*
Steps: 204000	Loss: 38033.40625	PPL: 4.29856	bleu: 25.30841	LR: 0.00021000	
Steps: 205000	Loss: 37942.58984	PPL: 4.28362	bleu: 25.34179	LR: 0.00021000	*
Steps: 206000	Loss: 37963.04688	PPL: 4.28698	bleu: 25.23448	LR: 0.00021000	
Steps: 207000	Loss: 38020.93359	PPL: 4.29651	bleu: 25.27771	LR: 0.00021000	
Steps: 208000	Loss: 37940.99219	PPL: 4.28336	bleu: 25.38197	LR: 0.00021000	*
Steps: 209000	Loss: 37889.30078	PPL: 4.27488	bleu: 25.30438	LR: 0.00021000	*
Steps: 210000	Loss: 37865.97266	PPL: 4.27105	bleu: 25.18989	LR: 0.00021000	*
Steps: 211000	Loss: 38023.90625	PPL: 4.29700	bleu: 24.80337	LR: 0.00021000	
Steps: 212000	Loss: 37999.51953	PPL: 4.29298	bleu: 25.52267	LR: 0.00021000	
Steps: 213000	Loss: 37902.60547	PPL: 4.27706	bleu: 25.30063	LR: 0.00021000	
Steps: 214000	Loss: 37843.68359	PPL: 4.26740	bleu: 25.59574	LR: 0.00021000	*
Steps: 215000	Loss: 37817.71484	PPL: 4.26316	bleu: 25.63685	LR: 0.00021000	*
Steps: 216000	Loss: 37821.46094	PPL: 4.26377	bleu: 25.69784	LR: 0.00021000	
Steps: 217000	Loss: 37751.98047	PPL: 4.25243	bleu: 25.52260	LR: 0.00021000	*
Steps: 218000	Loss: 37836.71875	PPL: 4.26627	bleu: 25.10352	LR: 0.00021000	
Steps: 219000	Loss: 37833.86328	PPL: 4.26580	bleu: 25.44552	LR: 0.00021000	
Steps: 220000	Loss: 37812.90625	PPL: 4.26237	bleu: 25.70065	LR: 0.00021000	
Steps: 221000	Loss: 37815.27344	PPL: 4.26276	bleu: 25.50028	LR: 0.00021000	
Steps: 222000	Loss: 37727.88672	PPL: 4.24850	bleu: 25.53643	LR: 0.00021000	*
Steps: 223000	Loss: 37842.30469	PPL: 4.26718	bleu: 25.57224	LR: 0.00021000	
Steps: 224000	Loss: 37722.79688	PPL: 4.24767	bleu: 25.39376	LR: 0.00021000	*
Steps: 225000	Loss: 37871.88672	PPL: 4.27202	bleu: 25.80594	LR: 0.00021000	
Steps: 226000	Loss: 37771.59375	PPL: 4.25563	bleu: 25.94872	LR: 0.00021000	
Steps: 227000	Loss: 37692.67188	PPL: 4.24277	bleu: 25.67657	LR: 0.00021000	*
Steps: 228000	Loss: 37724.60156	PPL: 4.24796	bleu: 25.51654	LR: 0.00021000	
Steps: 229000	Loss: 37770.45312	PPL: 4.25544	bleu: 25.57260	LR: 0.00021000	
Steps: 230000	Loss: 37702.49609	PPL: 4.24437	bleu: 25.59541	LR: 0.00021000	
Steps: 231000	Loss: 37670.80078	PPL: 4.23921	bleu: 25.39550	LR: 0.00021000	*
Steps: 232000	Loss: 37724.08984	PPL: 4.24788	bleu: 25.57189	LR: 0.00021000	
Steps: 233000	Loss: 37814.49609	PPL: 4.26263	bleu: 25.27768	LR: 0.00021000	
Steps: 234000	Loss: 37659.94531	PPL: 4.23745	bleu: 25.37481	LR: 0.00021000	*
Steps: 235000	Loss: 37660.64844	PPL: 4.23756	bleu: 25.60212	LR: 0.00021000	
Steps: 236000	Loss: 37697.83203	PPL: 4.24361	bleu: 25.60651	LR: 0.00021000	
Steps: 237000	Loss: 37634.68750	PPL: 4.23335	bleu: 25.39906	LR: 0.00021000	*
Steps: 238000	Loss: 37526.92188	PPL: 4.21589	bleu: 25.72407	LR: 0.00021000	*
Steps: 239000	Loss: 37695.78125	PPL: 4.24327	bleu: 25.87622	LR: 0.00021000	
Steps: 240000	Loss: 37621.14844	PPL: 4.23115	bleu: 25.73335	LR: 0.00021000	
Steps: 241000	Loss: 37523.16797	PPL: 4.21528	bleu: 25.71153	LR: 0.00021000	*
Steps: 242000	Loss: 37669.21484	PPL: 4.23895	bleu: 25.37726	LR: 0.00021000	
Steps: 243000	Loss: 37675.76953	PPL: 4.24002	bleu: 25.64237	LR: 0.00021000	
Steps: 244000	Loss: 37651.60938	PPL: 4.23609	bleu: 26.00652	LR: 0.00021000	
Steps: 245000	Loss: 37556.82031	PPL: 4.22073	bleu: 25.51997	LR: 0.00021000	
Steps: 246000	Loss: 37499.15234	PPL: 4.21140	bleu: 25.88419	LR: 0.00021000	*
Steps: 247000	Loss: 37545.07812	PPL: 4.21883	bleu: 25.43764	LR: 0.00021000	
Steps: 248000	Loss: 37536.69531	PPL: 4.21747	bleu: 25.46249	LR: 0.00021000	
Steps: 249000	Loss: 37451.72656	PPL: 4.20375	bleu: 25.44855	LR: 0.00021000	*
Steps: 250000	Loss: 37432.56641	PPL: 4.20066	bleu: 25.67750	LR: 0.00021000	*
Steps: 251000	Loss: 37463.46484	PPL: 4.20564	bleu: 25.77836	LR: 0.00021000	
Steps: 252000	Loss: 37413.18359	PPL: 4.19754	bleu: 25.82808	LR: 0.00021000	*
Steps: 253000	Loss: 37449.60938	PPL: 4.20341	bleu: 25.46119	LR: 0.00021000	
Steps: 254000	Loss: 37523.71484	PPL: 4.21537	bleu: 25.47830	LR: 0.00021000	
Steps: 255000	Loss: 37528.75781	PPL: 4.21619	bleu: 25.32843	LR: 0.00021000	
Steps: 256000	Loss: 37413.21875	PPL: 4.19755	bleu: 25.41581	LR: 0.00021000	
Steps: 257000	Loss: 37523.89844	PPL: 4.21540	bleu: 25.54990	LR: 0.00021000	
Steps: 258000	Loss: 37450.37891	PPL: 4.20353	bleu: 25.57636	LR: 0.00014700	
Steps: 259000	Loss: 37343.07422	PPL: 4.18628	bleu: 25.49683	LR: 0.00014700	*
Steps: 260000	Loss: 37324.61328	PPL: 4.18331	bleu: 25.43494	LR: 0.00014700	*
Steps: 261000	Loss: 37309.24219	PPL: 4.18085	bleu: 25.51379	LR: 0.00014700	*
Steps: 262000	Loss: 37312.06641	PPL: 4.18130	bleu: 25.72165	LR: 0.00014700	
Steps: 263000	Loss: 37219.73047	PPL: 4.16652	bleu: 25.69753	LR: 0.00014700	*
Steps: 264000	Loss: 37193.00781	PPL: 4.16226	bleu: 25.75202	LR: 0.00014700	*
Steps: 265000	Loss: 37162.17578	PPL: 4.15734	bleu: 25.84220	LR: 0.00014700	*
Steps: 266000	Loss: 37253.67969	PPL: 4.17195	bleu: 25.78585	LR: 0.00014700	
Steps: 267000	Loss: 37250.19531	PPL: 4.17139	bleu: 25.94245	LR: 0.00014700	
Steps: 268000	Loss: 37314.25391	PPL: 4.18165	bleu: 25.65317	LR: 0.00014700	
Steps: 269000	Loss: 37204.30859	PPL: 4.16406	bleu: 25.92737	LR: 0.00014700	
Steps: 270000	Loss: 37158.15234	PPL: 4.15670	bleu: 25.48107	LR: 0.00014700	*
Steps: 271000	Loss: 37141.62500	PPL: 4.15407	bleu: 25.45889	LR: 0.00014700	*
Steps: 272000	Loss: 37141.87891	PPL: 4.15411	bleu: 25.54128	LR: 0.00014700	
Steps: 273000	Loss: 37172.92188	PPL: 4.15905	bleu: 25.41002	LR: 0.00014700	
Steps: 274000	Loss: 37127.59375	PPL: 4.15183	bleu: 25.74373	LR: 0.00014700	*
Steps: 275000	Loss: 37145.99219	PPL: 4.15476	bleu: 25.78832	LR: 0.00014700	
Steps: 276000	Loss: 37175.78516	PPL: 4.15951	bleu: 25.92894	LR: 0.00014700	
Steps: 277000	Loss: 37051.82031	PPL: 4.13979	bleu: 25.85361	LR: 0.00014700	*
Steps: 278000	Loss: 37125.60938	PPL: 4.15152	bleu: 25.67788	LR: 0.00014700	
Steps: 279000	Loss: 37140.47266	PPL: 4.15388	bleu: 25.47202	LR: 0.00014700	
Steps: 280000	Loss: 37050.26953	PPL: 4.13954	bleu: 25.38311	LR: 0.00014700	*
Steps: 281000	Loss: 37091.80859	PPL: 4.14614	bleu: 26.16863	LR: 0.00014700	
Steps: 282000	Loss: 37114.80078	PPL: 4.14980	bleu: 25.72734	LR: 0.00014700	
Steps: 283000	Loss: 37117.13281	PPL: 4.15017	bleu: 25.95258	LR: 0.00014700	
Steps: 284000	Loss: 37022.66797	PPL: 4.13516	bleu: 25.65332	LR: 0.00014700	*
Steps: 285000	Loss: 37009.03125	PPL: 4.13300	bleu: 25.76521	LR: 0.00014700	*
Steps: 286000	Loss: 37025.71094	PPL: 4.13564	bleu: 25.92134	LR: 0.00014700	
Steps: 287000	Loss: 37055.04688	PPL: 4.14030	bleu: 25.79829	LR: 0.00014700	
Steps: 288000	Loss: 37085.97266	PPL: 4.14521	bleu: 25.44130	LR: 0.00014700	
Steps: 289000	Loss: 37097.08594	PPL: 4.14698	bleu: 25.59894	LR: 0.00014700	
Steps: 290000	Loss: 37006.37500	PPL: 4.13258	bleu: 25.28597	LR: 0.00014700	*
Steps: 291000	Loss: 37046.75000	PPL: 4.13898	bleu: 26.16360	LR: 0.00014700	
Steps: 292000	Loss: 36936.73828	PPL: 4.12156	bleu: 25.87446	LR: 0.00014700	*
Steps: 293000	Loss: 36993.19141	PPL: 4.13049	bleu: 25.52042	LR: 0.00014700	
Steps: 294000	Loss: 37010.67188	PPL: 4.13326	bleu: 25.65068	LR: 0.00014700	
Steps: 295000	Loss: 37017.54688	PPL: 4.13435	bleu: 25.50772	LR: 0.00014700	
Steps: 296000	Loss: 37003.75391	PPL: 4.13216	bleu: 25.93151	LR: 0.00014700	
Steps: 297000	Loss: 36973.04297	PPL: 4.12730	bleu: 25.58332	LR: 0.00014700	
Steps: 298000	Loss: 36969.85938	PPL: 4.12680	bleu: 25.59412	LR: 0.00010290	
Steps: 299000	Loss: 36896.74609	PPL: 4.11524	bleu: 25.80043	LR: 0.00010290	*
Steps: 300000	Loss: 36879.19922	PPL: 4.11248	bleu: 25.84867	LR: 0.00010290	*
Steps: 301000	Loss: 36855.51953	PPL: 4.10874	bleu: 25.96104	LR: 0.00010290	*
Steps: 302000	Loss: 36791.17578	PPL: 4.09862	bleu: 26.02235	LR: 0.00010290	*
Steps: 303000	Loss: 36760.48828	PPL: 4.09380	bleu: 25.51072	LR: 0.00010290	*
Steps: 304000	Loss: 36776.59375	PPL: 4.09633	bleu: 25.81774	LR: 0.00010290	
Steps: 305000	Loss: 36797.21094	PPL: 4.09957	bleu: 25.83430	LR: 0.00010290	
Steps: 306000	Loss: 36784.70312	PPL: 4.09760	bleu: 25.68782	LR: 0.00010290	
Steps: 307000	Loss: 36788.43750	PPL: 4.09819	bleu: 25.98448	LR: 0.00010290	
Steps: 308000	Loss: 36842.66797	PPL: 4.10672	bleu: 25.65559	LR: 0.00010290	
Steps: 309000	Loss: 36827.51562	PPL: 4.10434	bleu: 25.91949	LR: 0.00007203	
Steps: 310000	Loss: 36703.05078	PPL: 4.08480	bleu: 26.13411	LR: 0.00007203	*
Steps: 311000	Loss: 36705.45703	PPL: 4.08517	bleu: 26.09818	LR: 0.00007203	
Steps: 312000	Loss: 36699.12500	PPL: 4.08418	bleu: 26.16370	LR: 0.00007203	*
Steps: 313000	Loss: 36686.39062	PPL: 4.08219	bleu: 25.95801	LR: 0.00007203	*
Steps: 314000	Loss: 36661.12109	PPL: 4.07823	bleu: 26.08803	LR: 0.00007203	*
Steps: 315000	Loss: 36654.57422	PPL: 4.07721	bleu: 26.16156	LR: 0.00007203	*
Steps: 316000	Loss: 36689.62109	PPL: 4.08269	bleu: 25.80715	LR: 0.00007203	
Steps: 317000	Loss: 36683.74609	PPL: 4.08177	bleu: 26.14141	LR: 0.00007203	
Steps: 318000	Loss: 36638.37109	PPL: 4.07468	bleu: 26.24987	LR: 0.00007203	*
Steps: 319000	Loss: 36630.06250	PPL: 4.07338	bleu: 26.13314	LR: 0.00007203	*
Steps: 320000	Loss: 36659.22266	PPL: 4.07794	bleu: 26.20105	LR: 0.00007203	
Steps: 321000	Loss: 36680.90234	PPL: 4.08133	bleu: 25.90967	LR: 0.00007203	
Steps: 322000	Loss: 36652.36328	PPL: 4.07686	bleu: 26.06344	LR: 0.00007203	
Steps: 323000	Loss: 36628.85547	PPL: 4.07319	bleu: 26.41735	LR: 0.00007203	*
Steps: 324000	Loss: 36661.19531	PPL: 4.07825	bleu: 26.27573	LR: 0.00007203	
Steps: 325000	Loss: 36650.85156	PPL: 4.07663	bleu: 26.21061	LR: 0.00007203	
Steps: 326000	Loss: 36562.79688	PPL: 4.06289	bleu: 26.05663	LR: 0.00007203	*
Steps: 327000	Loss: 36654.52344	PPL: 4.07720	bleu: 26.33627	LR: 0.00007203	
Steps: 328000	Loss: 36548.41406	PPL: 4.06065	bleu: 26.37135	LR: 0.00007203	*
Steps: 329000	Loss: 36638.36328	PPL: 4.07468	bleu: 26.24693	LR: 0.00007203	
Steps: 330000	Loss: 36661.63281	PPL: 4.07831	bleu: 26.12458	LR: 0.00007203	
Steps: 331000	Loss: 36612.80469	PPL: 4.07068	bleu: 25.93970	LR: 0.00007203	
Steps: 332000	Loss: 36565.21484	PPL: 4.06326	bleu: 26.01312	LR: 0.00007203	
Steps: 333000	Loss: 36556.73047	PPL: 4.06194	bleu: 26.25776	LR: 0.00007203	
Steps: 334000	Loss: 36571.25781	PPL: 4.06421	bleu: 26.12196	LR: 0.00005042	
Steps: 335000	Loss: 36551.07422	PPL: 4.06106	bleu: 26.39055	LR: 0.00005042	
Steps: 336000	Loss: 36534.69531	PPL: 4.05851	bleu: 26.26003	LR: 0.00005042	*
Steps: 337000	Loss: 36545.08203	PPL: 4.06013	bleu: 26.21381	LR: 0.00005042	
Steps: 338000	Loss: 36508.16016	PPL: 4.05439	bleu: 26.36664	LR: 0.00005042	*
Steps: 339000	Loss: 36491.43359	PPL: 4.05179	bleu: 26.00613	LR: 0.00005042	*
Steps: 340000	Loss: 36485.81250	PPL: 4.05091	bleu: 26.01383	LR: 0.00005042	*