Hugging Face's logo

AlexN
/
xls-r-300m-pt

Automatic Speech Recognition
Transformers
PyTorch
Portuguese
wav2vec2
robust-speech-event
mozilla-foundation/common_voice_8_0
generated_from_trainer
hf-asr-leaderboard
Eval Results
Inference Endpoints
Model card Files Community
1
AlexN commited on
Commit
6db3b99
•
1 Parent(s): 1f92738

End of training

Browse files
Files changed (8) hide show
  1. all_results.json +14 -0
  2. eval_results.json +9 -0
  3. train_results.json +8 -0
  4. trainer_state.json +928 -0
  5. wandb/run-20220201_223624-2b1hcyq3/files/output.log +156 -0
  6. wandb/run-20220201_223624-2b1hcyq3/files/wandb-summary.json +0 -0
  7. wandb/run-20220201_223624-2b1hcyq3/logs/debug-internal.log +203 -0
  8. wandb/run-20220201_223624-2b1hcyq3/run-2b1hcyq3.wandb +2 -2
all_results.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 15.0,
3
+ "eval_loss": 0.22902172803878784,
4
+ "eval_runtime": 327.6131,
5
+ "eval_samples": 8301,
6
+ "eval_samples_per_second": 25.338,
7
+ "eval_steps_per_second": 0.794,
8
+ "eval_wer": 0.23818860067667216,
9
+ "train_loss": 1.3307904394651542,
10
+ "train_runtime": 23640.5221,
11
+ "train_samples": 24877,
12
+ "train_samples_per_second": 15.785,
13
+ "train_steps_per_second": 0.494
14
+ }
eval_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 15.0,
3
+ "eval_loss": 0.22902172803878784,
4
+ "eval_runtime": 327.6131,
5
+ "eval_samples": 8301,
6
+ "eval_samples_per_second": 25.338,
7
+ "eval_steps_per_second": 0.794,
8
+ "eval_wer": 0.23818860067667216
9
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 15.0,
3
+ "train_loss": 1.3307904394651542,
4
+ "train_runtime": 23640.5221,
5
+ "train_samples": 24877,
6
+ "train_samples_per_second": 15.785,
7
+ "train_steps_per_second": 0.494
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,928 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 0.22902172803878784,
3
+ "best_model_checkpoint": "./checkpoint-11500",
4
+ "epoch": 15.0,
5
+ "global_step": 11670,
6
+ "is_hyper_param_search": false,
7
+ "is_local_process_zero": true,
8
+ "is_world_process_zero": true,
9
+ "log_history": [
10
+ {
11
+ "epoch": 0.13,
12
+ "learning_rate": 1.2933333333333334e-05,
13
+ "loss": 14.1317,
14
+ "step": 100
15
+ },
16
+ {
17
+ "epoch": 0.26,
18
+ "learning_rate": 2.6266666666666667e-05,
19
+ "loss": 5.2635,
20
+ "step": 200
21
+ },
22
+ {
23
+ "epoch": 0.39,
24
+ "learning_rate": 3.960000000000001e-05,
25
+ "loss": 3.8268,
26
+ "step": 300
27
+ },
28
+ {
29
+ "epoch": 0.51,
30
+ "learning_rate": 5.293333333333334e-05,
31
+ "loss": 3.2266,
32
+ "step": 400
33
+ },
34
+ {
35
+ "epoch": 0.64,
36
+ "learning_rate": 6.626666666666666e-05,
37
+ "loss": 3.0952,
38
+ "step": 500
39
+ },
40
+ {
41
+ "epoch": 0.64,
42
+ "eval_loss": 3.0981762409210205,
43
+ "eval_runtime": 326.629,
44
+ "eval_samples_per_second": 25.414,
45
+ "eval_steps_per_second": 0.796,
46
+ "eval_wer": 1.0,
47
+ "step": 500
48
+ },
49
+ {
50
+ "epoch": 0.77,
51
+ "learning_rate": 7.960000000000001e-05,
52
+ "loss": 3.0583,
53
+ "step": 600
54
+ },
55
+ {
56
+ "epoch": 0.9,
57
+ "learning_rate": 9.293333333333333e-05,
58
+ "loss": 3.0349,
59
+ "step": 700
60
+ },
61
+ {
62
+ "epoch": 1.03,
63
+ "learning_rate": 0.00010626666666666667,
64
+ "loss": 2.9355,
65
+ "step": 800
66
+ },
67
+ {
68
+ "epoch": 1.16,
69
+ "learning_rate": 0.00011960000000000001,
70
+ "loss": 2.3372,
71
+ "step": 900
72
+ },
73
+ {
74
+ "epoch": 1.29,
75
+ "learning_rate": 0.00013293333333333333,
76
+ "loss": 1.7975,
77
+ "step": 1000
78
+ },
79
+ {
80
+ "epoch": 1.29,
81
+ "eval_loss": 0.7887413501739502,
82
+ "eval_runtime": 341.1915,
83
+ "eval_samples_per_second": 24.329,
84
+ "eval_steps_per_second": 0.762,
85
+ "eval_wer": 0.5651080072872386,
86
+ "step": 1000
87
+ },
88
+ {
89
+ "epoch": 1.41,
90
+ "learning_rate": 0.00014626666666666665,
91
+ "loss": 1.6159,
92
+ "step": 1100
93
+ },
94
+ {
95
+ "epoch": 1.54,
96
+ "learning_rate": 0.0001596,
97
+ "loss": 1.5287,
98
+ "step": 1200
99
+ },
100
+ {
101
+ "epoch": 1.67,
102
+ "learning_rate": 0.00017293333333333335,
103
+ "loss": 1.4876,
104
+ "step": 1300
105
+ },
106
+ {
107
+ "epoch": 1.8,
108
+ "learning_rate": 0.00018626666666666668,
109
+ "loss": 1.4606,
110
+ "step": 1400
111
+ },
112
+ {
113
+ "epoch": 1.93,
114
+ "learning_rate": 0.0001996,
115
+ "loss": 1.4138,
116
+ "step": 1500
117
+ },
118
+ {
119
+ "epoch": 1.93,
120
+ "eval_loss": 0.523814857006073,
121
+ "eval_runtime": 341.7084,
122
+ "eval_samples_per_second": 24.293,
123
+ "eval_steps_per_second": 0.761,
124
+ "eval_wer": 0.43889997397414765,
125
+ "step": 1500
126
+ },
127
+ {
128
+ "epoch": 2.06,
129
+ "learning_rate": 0.00019809242871189774,
130
+ "loss": 1.4258,
131
+ "step": 1600
132
+ },
133
+ {
134
+ "epoch": 2.19,
135
+ "learning_rate": 0.000196125860373648,
136
+ "loss": 1.3778,
137
+ "step": 1700
138
+ },
139
+ {
140
+ "epoch": 2.31,
141
+ "learning_rate": 0.00019415929203539823,
142
+ "loss": 1.3518,
143
+ "step": 1800
144
+ },
145
+ {
146
+ "epoch": 2.44,
147
+ "learning_rate": 0.00019219272369714848,
148
+ "loss": 1.3692,
149
+ "step": 1900
150
+ },
151
+ {
152
+ "epoch": 2.57,
153
+ "learning_rate": 0.00019022615535889875,
154
+ "loss": 1.344,
155
+ "step": 2000
156
+ },
157
+ {
158
+ "epoch": 2.57,
159
+ "eval_loss": 0.4774917662143707,
160
+ "eval_runtime": 337.4262,
161
+ "eval_samples_per_second": 24.601,
162
+ "eval_steps_per_second": 0.771,
163
+ "eval_wer": 0.4318209421358549,
164
+ "step": 2000
165
+ },
166
+ {
167
+ "epoch": 2.7,
168
+ "learning_rate": 0.000188259587020649,
169
+ "loss": 1.3167,
170
+ "step": 2100
171
+ },
172
+ {
173
+ "epoch": 2.83,
174
+ "learning_rate": 0.00018629301868239921,
175
+ "loss": 1.3126,
176
+ "step": 2200
177
+ },
178
+ {
179
+ "epoch": 2.96,
180
+ "learning_rate": 0.00018432645034414946,
181
+ "loss": 1.3161,
182
+ "step": 2300
183
+ },
184
+ {
185
+ "epoch": 3.08,
186
+ "learning_rate": 0.0001823598820058997,
187
+ "loss": 1.2738,
188
+ "step": 2400
189
+ },
190
+ {
191
+ "epoch": 3.21,
192
+ "learning_rate": 0.00018039331366764995,
193
+ "loss": 1.2737,
194
+ "step": 2500
195
+ },
196
+ {
197
+ "epoch": 3.21,
198
+ "eval_loss": 0.46475061774253845,
199
+ "eval_runtime": 336.0925,
200
+ "eval_samples_per_second": 24.699,
201
+ "eval_steps_per_second": 0.774,
202
+ "eval_wer": 0.4074954454758393,
203
+ "step": 2500
204
+ },
205
+ {
206
+ "epoch": 3.34,
207
+ "learning_rate": 0.0001784267453294002,
208
+ "loss": 1.262,
209
+ "step": 2600
210
+ },
211
+ {
212
+ "epoch": 3.47,
213
+ "learning_rate": 0.00017646017699115044,
214
+ "loss": 1.2496,
215
+ "step": 2700
216
+ },
217
+ {
218
+ "epoch": 3.6,
219
+ "learning_rate": 0.0001744936086529007,
220
+ "loss": 1.2612,
221
+ "step": 2800
222
+ },
223
+ {
224
+ "epoch": 3.73,
225
+ "learning_rate": 0.00017252704031465093,
226
+ "loss": 1.2197,
227
+ "step": 2900
228
+ },
229
+ {
230
+ "epoch": 3.86,
231
+ "learning_rate": 0.0001705604719764012,
232
+ "loss": 1.2554,
233
+ "step": 3000
234
+ },
235
+ {
236
+ "epoch": 3.86,
237
+ "eval_loss": 0.4068518280982971,
238
+ "eval_runtime": 331.555,
239
+ "eval_samples_per_second": 25.037,
240
+ "eval_steps_per_second": 0.784,
241
+ "eval_wer": 0.36781469593129174,
242
+ "step": 3000
243
+ },
244
+ {
245
+ "epoch": 3.98,
246
+ "learning_rate": 0.00016859390363815145,
247
+ "loss": 1.2204,
248
+ "step": 3100
249
+ },
250
+ {
251
+ "epoch": 4.11,
252
+ "learning_rate": 0.0001666273352999017,
253
+ "loss": 1.2113,
254
+ "step": 3200
255
+ },
256
+ {
257
+ "epoch": 4.24,
258
+ "learning_rate": 0.00016466076696165194,
259
+ "loss": 1.2053,
260
+ "step": 3300
261
+ },
262
+ {
263
+ "epoch": 4.37,
264
+ "learning_rate": 0.00016269419862340216,
265
+ "loss": 1.2019,
266
+ "step": 3400
267
+ },
268
+ {
269
+ "epoch": 4.5,
270
+ "learning_rate": 0.0001607276302851524,
271
+ "loss": 1.1996,
272
+ "step": 3500
273
+ },
274
+ {
275
+ "epoch": 4.5,
276
+ "eval_loss": 0.3914338946342468,
277
+ "eval_runtime": 333.5366,
278
+ "eval_samples_per_second": 24.888,
279
+ "eval_steps_per_second": 0.78,
280
+ "eval_wer": 0.36679101240565626,
281
+ "step": 3500
282
+ },
283
+ {
284
+ "epoch": 4.63,
285
+ "learning_rate": 0.00015876106194690265,
286
+ "loss": 1.1903,
287
+ "step": 3600
288
+ },
289
+ {
290
+ "epoch": 4.76,
291
+ "learning_rate": 0.0001567944936086529,
292
+ "loss": 1.1866,
293
+ "step": 3700
294
+ },
295
+ {
296
+ "epoch": 4.88,
297
+ "learning_rate": 0.00015482792527040314,
298
+ "loss": 1.1678,
299
+ "step": 3800
300
+ },
301
+ {
302
+ "epoch": 5.01,
303
+ "learning_rate": 0.0001528613569321534,
304
+ "loss": 1.1854,
305
+ "step": 3900
306
+ },
307
+ {
308
+ "epoch": 5.14,
309
+ "learning_rate": 0.00015089478859390363,
310
+ "loss": 1.1427,
311
+ "step": 4000
312
+ },
313
+ {
314
+ "epoch": 5.14,
315
+ "eval_loss": 0.36938655376434326,
316
+ "eval_runtime": 326.2453,
317
+ "eval_samples_per_second": 25.444,
318
+ "eval_steps_per_second": 0.797,
319
+ "eval_wer": 0.3571614470373905,
320
+ "step": 4000
321
+ },
322
+ {
323
+ "epoch": 5.27,
324
+ "learning_rate": 0.0001489282202556539,
325
+ "loss": 1.1393,
326
+ "step": 4100
327
+ },
328
+ {
329
+ "epoch": 5.4,
330
+ "learning_rate": 0.00014696165191740415,
331
+ "loss": 1.1182,
332
+ "step": 4200
333
+ },
334
+ {
335
+ "epoch": 5.53,
336
+ "learning_rate": 0.0001449950835791544,
337
+ "loss": 1.127,
338
+ "step": 4300
339
+ },
340
+ {
341
+ "epoch": 5.66,
342
+ "learning_rate": 0.00014302851524090464,
343
+ "loss": 1.1431,
344
+ "step": 4400
345
+ },
346
+ {
347
+ "epoch": 5.78,
348
+ "learning_rate": 0.0001410619469026549,
349
+ "loss": 1.1372,
350
+ "step": 4500
351
+ },
352
+ {
353
+ "epoch": 5.78,
354
+ "eval_loss": 0.3567572236061096,
355
+ "eval_runtime": 325.458,
356
+ "eval_samples_per_second": 25.506,
357
+ "eval_steps_per_second": 0.799,
358
+ "eval_wer": 0.3500824151990978,
359
+ "step": 4500
360
+ },
361
+ {
362
+ "epoch": 5.91,
363
+ "learning_rate": 0.0001390953785644051,
364
+ "loss": 1.1226,
365
+ "step": 4600
366
+ },
367
+ {
368
+ "epoch": 6.04,
369
+ "learning_rate": 0.00013712881022615535,
370
+ "loss": 1.1019,
371
+ "step": 4700
372
+ },
373
+ {
374
+ "epoch": 6.17,
375
+ "learning_rate": 0.0001351622418879056,
376
+ "loss": 1.1031,
377
+ "step": 4800
378
+ },
379
+ {
380
+ "epoch": 6.3,
381
+ "learning_rate": 0.00013321533923303834,
382
+ "loss": 1.0882,
383
+ "step": 4900
384
+ },
385
+ {
386
+ "epoch": 6.43,
387
+ "learning_rate": 0.00013124877089478858,
388
+ "loss": 1.0831,
389
+ "step": 5000
390
+ },
391
+ {
392
+ "epoch": 6.43,
393
+ "eval_loss": 0.3331395387649536,
394
+ "eval_runtime": 327.2346,
395
+ "eval_samples_per_second": 25.367,
396
+ "eval_steps_per_second": 0.795,
397
+ "eval_wer": 0.3253058037650733,
398
+ "step": 5000
399
+ },
400
+ {
401
+ "epoch": 6.56,
402
+ "learning_rate": 0.00012928220255653886,
403
+ "loss": 1.1039,
404
+ "step": 5100
405
+ },
406
+ {
407
+ "epoch": 6.68,
408
+ "learning_rate": 0.0001273156342182891,
409
+ "loss": 1.0683,
410
+ "step": 5200
411
+ },
412
+ {
413
+ "epoch": 6.81,
414
+ "learning_rate": 0.00012534906588003935,
415
+ "loss": 1.0773,
416
+ "step": 5300
417
+ },
418
+ {
419
+ "epoch": 6.94,
420
+ "learning_rate": 0.0001233824975417896,
421
+ "loss": 1.1002,
422
+ "step": 5400
423
+ },
424
+ {
425
+ "epoch": 7.07,
426
+ "learning_rate": 0.00012141592920353984,
427
+ "loss": 1.1074,
428
+ "step": 5500
429
+ },
430
+ {
431
+ "epoch": 7.07,
432
+ "eval_loss": 0.333199679851532,
433
+ "eval_runtime": 329.8287,
434
+ "eval_samples_per_second": 25.168,
435
+ "eval_steps_per_second": 0.788,
436
+ "eval_wer": 0.3352129782250369,
437
+ "step": 5500
438
+ },
439
+ {
440
+ "epoch": 7.2,
441
+ "learning_rate": 0.00011944936086529008,
442
+ "loss": 1.0341,
443
+ "step": 5600
444
+ },
445
+ {
446
+ "epoch": 7.33,
447
+ "learning_rate": 0.00011748279252704033,
448
+ "loss": 1.0812,
449
+ "step": 5700
450
+ },
451
+ {
452
+ "epoch": 7.46,
453
+ "learning_rate": 0.00011551622418879056,
454
+ "loss": 1.0709,
455
+ "step": 5800
456
+ },
457
+ {
458
+ "epoch": 7.58,
459
+ "learning_rate": 0.00011354965585054081,
460
+ "loss": 1.0843,
461
+ "step": 5900
462
+ },
463
+ {
464
+ "epoch": 7.71,
465
+ "learning_rate": 0.00011158308751229105,
466
+ "loss": 1.0536,
467
+ "step": 6000
468
+ },
469
+ {
470
+ "epoch": 7.71,
471
+ "eval_loss": 0.3130946755409241,
472
+ "eval_runtime": 327.9895,
473
+ "eval_samples_per_second": 25.309,
474
+ "eval_steps_per_second": 0.793,
475
+ "eval_wer": 0.3151557213498742,
476
+ "step": 6000
477
+ },
478
+ {
479
+ "epoch": 7.84,
480
+ "learning_rate": 0.0001096165191740413,
481
+ "loss": 1.0239,
482
+ "step": 6100
483
+ },
484
+ {
485
+ "epoch": 7.97,
486
+ "learning_rate": 0.00010764995083579154,
487
+ "loss": 1.0383,
488
+ "step": 6200
489
+ },
490
+ {
491
+ "epoch": 8.1,
492
+ "learning_rate": 0.00010568338249754179,
493
+ "loss": 1.0157,
494
+ "step": 6300
495
+ },
496
+ {
497
+ "epoch": 8.23,
498
+ "learning_rate": 0.00010371681415929205,
499
+ "loss": 1.0128,
500
+ "step": 6400
501
+ },
502
+ {
503
+ "epoch": 8.35,
504
+ "learning_rate": 0.0001017502458210423,
505
+ "loss": 1.0248,
506
+ "step": 6500
507
+ },
508
+ {
509
+ "epoch": 8.35,
510
+ "eval_loss": 0.30239033699035645,
511
+ "eval_runtime": 328.0553,
512
+ "eval_samples_per_second": 25.304,
513
+ "eval_steps_per_second": 0.793,
514
+ "eval_wer": 0.3022642491541598,
515
+ "step": 6500
516
+ },
517
+ {
518
+ "epoch": 8.48,
519
+ "learning_rate": 9.978367748279254e-05,
520
+ "loss": 0.9989,
521
+ "step": 6600
522
+ },
523
+ {
524
+ "epoch": 8.61,
525
+ "learning_rate": 9.781710914454277e-05,
526
+ "loss": 1.0151,
527
+ "step": 6700
528
+ },
529
+ {
530
+ "epoch": 8.74,
531
+ "learning_rate": 9.585054080629302e-05,
532
+ "loss": 0.9914,
533
+ "step": 6800
534
+ },
535
+ {
536
+ "epoch": 8.87,
537
+ "learning_rate": 9.388397246804326e-05,
538
+ "loss": 0.9893,
539
+ "step": 6900
540
+ },
541
+ {
542
+ "epoch": 9.0,
543
+ "learning_rate": 9.193706981317602e-05,
544
+ "loss": 1.0075,
545
+ "step": 7000
546
+ },
547
+ {
548
+ "epoch": 9.0,
549
+ "eval_loss": 0.2947603166103363,
550
+ "eval_runtime": 326.8764,
551
+ "eval_samples_per_second": 25.395,
552
+ "eval_steps_per_second": 0.795,
553
+ "eval_wer": 0.3028368179057864,
554
+ "step": 7000
555
+ },
556
+ {
557
+ "epoch": 9.13,
558
+ "learning_rate": 8.997050147492626e-05,
559
+ "loss": 0.9851,
560
+ "step": 7100
561
+ },
562
+ {
563
+ "epoch": 9.25,
564
+ "learning_rate": 8.800393313667651e-05,
565
+ "loss": 0.973,
566
+ "step": 7200
567
+ },
568
+ {
569
+ "epoch": 9.38,
570
+ "learning_rate": 8.605703048180925e-05,
571
+ "loss": 0.9623,
572
+ "step": 7300
573
+ },
574
+ {
575
+ "epoch": 9.51,
576
+ "learning_rate": 8.40904621435595e-05,
577
+ "loss": 0.9598,
578
+ "step": 7400
579
+ },
580
+ {
581
+ "epoch": 9.64,
582
+ "learning_rate": 8.212389380530974e-05,
583
+ "loss": 0.979,
584
+ "step": 7500
585
+ },
586
+ {
587
+ "epoch": 9.64,
588
+ "eval_loss": 0.27962473034858704,
589
+ "eval_runtime": 329.4084,
590
+ "eval_samples_per_second": 25.2,
591
+ "eval_steps_per_second": 0.789,
592
+ "eval_wer": 0.2852953934241346,
593
+ "step": 7500
594
+ },
595
+ {
596
+ "epoch": 9.77,
597
+ "learning_rate": 8.015732546705999e-05,
598
+ "loss": 0.9582,
599
+ "step": 7600
600
+ },
601
+ {
602
+ "epoch": 9.9,
603
+ "learning_rate": 7.819075712881023e-05,
604
+ "loss": 0.9467,
605
+ "step": 7700
606
+ },
607
+ {
608
+ "epoch": 10.03,
609
+ "learning_rate": 7.622418879056048e-05,
610
+ "loss": 0.907,
611
+ "step": 7800
612
+ },
613
+ {
614
+ "epoch": 10.15,
615
+ "learning_rate": 7.425762045231072e-05,
616
+ "loss": 0.944,
617
+ "step": 7900
618
+ },
619
+ {
620
+ "epoch": 10.28,
621
+ "learning_rate": 7.229105211406097e-05,
622
+ "loss": 0.9594,
623
+ "step": 8000
624
+ },
625
+ {
626
+ "epoch": 10.28,
627
+ "eval_loss": 0.2719425559043884,
628
+ "eval_runtime": 329.4201,
629
+ "eval_samples_per_second": 25.199,
630
+ "eval_steps_per_second": 0.789,
631
+ "eval_wer": 0.2789103843150863,
632
+ "step": 8000
633
+ },
634
+ {
635
+ "epoch": 10.41,
636
+ "learning_rate": 7.032448377581121e-05,
637
+ "loss": 0.9559,
638
+ "step": 8100
639
+ },
640
+ {
641
+ "epoch": 10.54,
642
+ "learning_rate": 6.835791543756146e-05,
643
+ "loss": 0.9368,
644
+ "step": 8200
645
+ },
646
+ {
647
+ "epoch": 10.67,
648
+ "learning_rate": 6.63913470993117e-05,
649
+ "loss": 0.9362,
650
+ "step": 8300
651
+ },
652
+ {
653
+ "epoch": 10.8,
654
+ "learning_rate": 6.442477876106195e-05,
655
+ "loss": 0.9134,
656
+ "step": 8400
657
+ },
658
+ {
659
+ "epoch": 10.93,
660
+ "learning_rate": 6.24582104228122e-05,
661
+ "loss": 0.9172,
662
+ "step": 8500
663
+ },
664
+ {
665
+ "epoch": 10.93,
666
+ "eval_loss": 0.2620205879211426,
667
+ "eval_runtime": 325.6384,
668
+ "eval_samples_per_second": 25.491,
669
+ "eval_steps_per_second": 0.798,
670
+ "eval_wer": 0.26950637633382496,
671
+ "step": 8500
672
+ },
673
+ {
674
+ "epoch": 11.05,
675
+ "learning_rate": 6.049164208456244e-05,
676
+ "loss": 0.9179,
677
+ "step": 8600
678
+ },
679
+ {
680
+ "epoch": 11.18,
681
+ "learning_rate": 5.8525073746312686e-05,
682
+ "loss": 0.9157,
683
+ "step": 8700
684
+ },
685
+ {
686
+ "epoch": 11.31,
687
+ "learning_rate": 5.655850540806293e-05,
688
+ "loss": 0.8974,
689
+ "step": 8800
690
+ },
691
+ {
692
+ "epoch": 11.44,
693
+ "learning_rate": 5.459193706981318e-05,
694
+ "loss": 0.8994,
695
+ "step": 8900
696
+ },
697
+ {
698
+ "epoch": 11.57,
699
+ "learning_rate": 5.262536873156343e-05,
700
+ "loss": 0.9047,
701
+ "step": 9000
702
+ },
703
+ {
704
+ "epoch": 11.57,
705
+ "eval_loss": 0.25371646881103516,
706
+ "eval_runtime": 328.7713,
707
+ "eval_samples_per_second": 25.249,
708
+ "eval_steps_per_second": 0.791,
709
+ "eval_wer": 0.2596165524420925,
710
+ "step": 9000
711
+ },
712
+ {
713
+ "epoch": 11.7,
714
+ "learning_rate": 5.065880039331367e-05,
715
+ "loss": 0.8816,
716
+ "step": 9100
717
+ },
718
+ {
719
+ "epoch": 11.83,
720
+ "learning_rate": 4.869223205506391e-05,
721
+ "loss": 0.9007,
722
+ "step": 9200
723
+ },
724
+ {
725
+ "epoch": 11.95,
726
+ "learning_rate": 4.672566371681416e-05,
727
+ "loss": 0.9035,
728
+ "step": 9300
729
+ },
730
+ {
731
+ "epoch": 12.08,
732
+ "learning_rate": 4.475909537856441e-05,
733
+ "loss": 0.8705,
734
+ "step": 9400
735
+ },
736
+ {
737
+ "epoch": 12.21,
738
+ "learning_rate": 4.279252704031465e-05,
739
+ "loss": 0.8777,
740
+ "step": 9500
741
+ },
742
+ {
743
+ "epoch": 12.21,
744
+ "eval_loss": 0.24379895627498627,
745
+ "eval_runtime": 329.8391,
746
+ "eval_samples_per_second": 25.167,
747
+ "eval_steps_per_second": 0.788,
748
+ "eval_wer": 0.25250281946733755,
749
+ "step": 9500
750
+ },
751
+ {
752
+ "epoch": 12.34,
753
+ "learning_rate": 4.0825958702064895e-05,
754
+ "loss": 0.8734,
755
+ "step": 9600
756
+ },
757
+ {
758
+ "epoch": 12.47,
759
+ "learning_rate": 3.887905604719764e-05,
760
+ "loss": 0.8886,
761
+ "step": 9700
762
+ },
763
+ {
764
+ "epoch": 12.6,
765
+ "learning_rate": 3.691248770894789e-05,
766
+ "loss": 0.8626,
767
+ "step": 9800
768
+ },
769
+ {
770
+ "epoch": 12.72,
771
+ "learning_rate": 3.4945919370698134e-05,
772
+ "loss": 0.8669,
773
+ "step": 9900
774
+ },
775
+ {
776
+ "epoch": 12.85,
777
+ "learning_rate": 3.297935103244838e-05,
778
+ "loss": 0.8629,
779
+ "step": 10000
780
+ },
781
+ {
782
+ "epoch": 12.85,
783
+ "eval_loss": 0.2408979833126068,
784
+ "eval_runtime": 327.8875,
785
+ "eval_samples_per_second": 25.317,
786
+ "eval_steps_per_second": 0.793,
787
+ "eval_wer": 0.24934501604927561,
788
+ "step": 10000
789
+ },
790
+ {
791
+ "epoch": 12.98,
792
+ "learning_rate": 3.1012782694198625e-05,
793
+ "loss": 0.8489,
794
+ "step": 10100
795
+ },
796
+ {
797
+ "epoch": 13.11,
798
+ "learning_rate": 2.904621435594887e-05,
799
+ "loss": 0.8356,
800
+ "step": 10200
801
+ },
802
+ {
803
+ "epoch": 13.24,
804
+ "learning_rate": 2.7079646017699116e-05,
805
+ "loss": 0.8596,
806
+ "step": 10300
807
+ },
808
+ {
809
+ "epoch": 13.37,
810
+ "learning_rate": 2.5113077679449358e-05,
811
+ "loss": 0.8401,
812
+ "step": 10400
813
+ },
814
+ {
815
+ "epoch": 13.5,
816
+ "learning_rate": 2.3146509341199607e-05,
817
+ "loss": 0.8575,
818
+ "step": 10500
819
+ },
820
+ {
821
+ "epoch": 13.5,
822
+ "eval_loss": 0.2366442084312439,
823
+ "eval_runtime": 327.7324,
824
+ "eval_samples_per_second": 25.329,
825
+ "eval_steps_per_second": 0.793,
826
+ "eval_wer": 0.24396633989763164,
827
+ "step": 10500
828
+ },
829
+ {
830
+ "epoch": 13.62,
831
+ "learning_rate": 2.1179941002949856e-05,
832
+ "loss": 0.8343,
833
+ "step": 10600
834
+ },
835
+ {
836
+ "epoch": 13.75,
837
+ "learning_rate": 1.9213372664700098e-05,
838
+ "loss": 0.8308,
839
+ "step": 10700
840
+ },
841
+ {
842
+ "epoch": 13.88,
843
+ "learning_rate": 1.7246804326450343e-05,
844
+ "loss": 0.8431,
845
+ "step": 10800
846
+ },
847
+ {
848
+ "epoch": 14.01,
849
+ "learning_rate": 1.5280235988200592e-05,
850
+ "loss": 0.8468,
851
+ "step": 10900
852
+ },
853
+ {
854
+ "epoch": 14.14,
855
+ "learning_rate": 1.3313667649950836e-05,
856
+ "loss": 0.8361,
857
+ "step": 11000
858
+ },
859
+ {
860
+ "epoch": 14.14,
861
+ "eval_loss": 0.23166431486606598,
862
+ "eval_runtime": 329.2059,
863
+ "eval_samples_per_second": 25.215,
864
+ "eval_steps_per_second": 0.79,
865
+ "eval_wer": 0.23848356033660104,
866
+ "step": 11000
867
+ },
868
+ {
869
+ "epoch": 14.27,
870
+ "learning_rate": 1.1347099311701081e-05,
871
+ "loss": 0.824,
872
+ "step": 11100
873
+ },
874
+ {
875
+ "epoch": 14.4,
876
+ "learning_rate": 9.380530973451327e-06,
877
+ "loss": 0.8252,
878
+ "step": 11200
879
+ },
880
+ {
881
+ "epoch": 14.52,
882
+ "learning_rate": 7.4336283185840714e-06,
883
+ "loss": 0.8286,
884
+ "step": 11300
885
+ },
886
+ {
887
+ "epoch": 14.65,
888
+ "learning_rate": 5.467059980334317e-06,
889
+ "loss": 0.8077,
890
+ "step": 11400
891
+ },
892
+ {
893
+ "epoch": 14.78,
894
+ "learning_rate": 3.500491642084563e-06,
895
+ "loss": 0.8126,
896
+ "step": 11500
897
+ },
898
+ {
899
+ "epoch": 14.78,
900
+ "eval_loss": 0.22902172803878784,
901
+ "eval_runtime": 327.6124,
902
+ "eval_samples_per_second": 25.338,
903
+ "eval_steps_per_second": 0.794,
904
+ "eval_wer": 0.23818860067667216,
905
+ "step": 11500
906
+ },
907
+ {
908
+ "epoch": 14.91,
909
+ "learning_rate": 1.5339233038348083e-06,
910
+ "loss": 0.8118,
911
+ "step": 11600
912
+ },
913
+ {
914
+ "epoch": 15.0,
915
+ "step": 11670,
916
+ "total_flos": 4.014305196020058e+19,
917
+ "train_loss": 1.3307904394651542,
918
+ "train_runtime": 23640.5221,
919
+ "train_samples_per_second": 15.785,
920
+ "train_steps_per_second": 0.494
921
+ }
922
+ ],
923
+ "max_steps": 11670,
924
+ "num_train_epochs": 15,
925
+ "total_flos": 4.014305196020058e+19,
926
+ "trial_name": null,
927
+ "trial_params": null
928
+ }
wandb/run-20220201_223624-2b1hcyq3/files/output.log CHANGED
@@ -10076,3 +10076,159 @@ Deleting older checkpoint [checkpoint-4500] due to args.save_total_limit
10076
  02/02/2022 05:10:57 - WARNING - huggingface_hub.repository - To https://huggingface.co/AlexN/xls-r-300m-pt
10077
  1f31f7e..90fe400 main -> main
10078
  13%|█████████████████████████▎ | 33/260 [00:40<04:42, 1.24s/it]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10076
  02/02/2022 05:10:57 - WARNING - huggingface_hub.repository - To https://huggingface.co/AlexN/xls-r-300m-pt
10077
  1f31f7e..90fe400 main -> main
10078
  13%|█████████████████████████▎ | 33/260 [00:40<04:42, 1.24s/it]
10079
+ 13%|█████████████████████████▎ | 33/260 [00:40<04:42, 1.24s/it]
10080
+ 13%|█████████████████████████▎ | 33/260 [00:40<04:42, 1.24s/it]
10081
+ 02/02/2022 05:11:09 - WARNING - huggingface_hub.repository - To https://huggingface.co/AlexN/xls-r-300m-pt
10082
+ 90fe400..1f92738 main -> main
10083
+ 13%|█████████████████████████▎ | 33/260 [00:40<04:42, 1.24s/it]
10084
+ 13%|█████████████████████████▎ | 33/260 [00:40<04:42, 1.24s/it]
10085
+ ***** train metrics *****
10086
+ epoch = 15.0
10087
+ train_loss = 1.3308
10088
+ train_runtime = 6:34:00.52
10089
+ train_samples = 24877
10090
+ train_samples_per_second = 15.785
10091
+ train_steps_per_second = 0.494
10092
+ 0%| | 0/260 [00:00<?, ?it/s]
10093
+ 0%| | 0/260 [00:00<?, ?it/s]
10094
+ 0%| | 0/260 [00:00<?, ?it/s]
10095
+ 0%| | 0/260 [00:00<?, ?it/s]
10096
+ 0%| | 0/260 [00:00<?, ?it/s]
10097
+ 0%| | 0/260 [00:00<?, ?it/s]
10098
+ 0%| | 0/260 [00:00<?, ?it/s]
10099
+ 0%| | 0/260 [00:00<?, ?it/s]
10100
+ 0%| | 0/260 [00:00<?, ?it/s]
10101
+ 0%| | 0/260 [00:00<?, ?it/s]
10102
+ 0%| | 0/260 [00:00<?, ?it/s]
10103
+ 0%| | 0/260 [00:00<?, ?it/s]
10104
+ 0%| | 0/260 [00:00<?, ?it/s]
10105
+ 0%| | 0/260 [00:00<?, ?it/s]
10106
+ 0%| | 0/260 [00:00<?, ?it/s]
10107
+ 0%| | 0/260 [00:00<?, ?it/s]
10108
+ 0%| | 0/260 [00:00<?, ?it/s]
10109
+ 0%| | 0/260 [00:00<?, ?it/s]
10110
+ 0%| | 0/260 [00:00<?, ?it/s]
10111
+ 0%| | 0/260 [00:00<?, ?it/s]
10112
+ 0%| | 0/260 [00:00<?, ?it/s]
10113
+ 0%| | 0/260 [00:00<?, ?it/s]
10114
+ 0%| | 0/260 [00:00<?, ?it/s]
10115
+ 0%| | 0/260 [00:00<?, ?it/s]
10116
+ 0%| | 0/260 [00:00<?, ?it/s]
10117
+ 0%| | 0/260 [00:00<?, ?it/s]
10118
+ 0%| | 0/260 [00:00<?, ?it/s]
10119
+ 0%| | 0/260 [00:00<?, ?it/s]
10120
+ 0%| | 0/260 [00:00<?, ?it/s]
10121
+ 0%| | 0/260 [00:00<?, ?it/s]
10122
+ 0%| | 0/260 [00:00<?, ?it/s]
10123
+ 0%| | 0/260 [00:00<?, ?it/s]
10124
+ 0%| | 0/260 [00:00<?, ?it/s]
10125
+ 0%| | 0/260 [00:00<?, ?it/s]
10126
+ 0%| | 0/260 [00:00<?, ?it/s]
10127
+ 0%| | 0/260 [00:00<?, ?it/s]
10128
+ 0%| | 0/260 [00:00<?, ?it/s]
10129
+ 0%| | 0/260 [00:00<?, ?it/s]
10130
+ 0%| | 0/260 [00:00<?, ?it/s]
10131
+ 0%| | 0/260 [00:00<?, ?it/s]
10132
+ 0%| | 0/260 [00:00<?, ?it/s]
10133
+ 0%| | 0/260 [00:00<?, ?it/s]
10134
+ 0%| | 0/260 [00:00<?, ?it/s]
10135
+ 0%| | 0/260 [00:00<?, ?it/s]
10136
+ 0%| | 0/260 [00:00<?, ?it/s]
10137
+ 0%| | 0/260 [00:00<?, ?it/s]
10138
+ 0%| | 0/260 [00:00<?, ?it/s]
10139
+ 0%| | 0/260 [00:00<?, ?it/s]
10140
+ 0%| | 0/260 [00:00<?, ?it/s]
10141
+ 0%| | 0/260 [00:00<?, ?it/s]
10142
+ 0%| | 0/260 [00:00<?, ?it/s]
10143
+ 0%| | 0/260 [00:00<?, ?it/s]
10144
+ 0%| | 0/260 [00:00<?, ?it/s]
10145
+ 0%| | 0/260 [00:00<?, ?it/s]
10146
+ 0%| | 0/260 [00:00<?, ?it/s]
10147
+ 0%| | 0/260 [00:00<?, ?it/s]
10148
+ 0%| | 0/260 [00:00<?, ?it/s]
10149
+ 0%| | 0/260 [00:00<?, ?it/s]
10150
+ 0%| | 0/260 [00:00<?, ?it/s]
10151
+ 0%| | 0/260 [00:00<?, ?it/s]
10152
+ 0%| | 0/260 [00:00<?, ?it/s]
10153
+ 0%| | 0/260 [00:00<?, ?it/s]
10154
+ 0%| | 0/260 [00:00<?, ?it/s]
10155
+ 0%| | 0/260 [00:00<?, ?it/s]
10156
+ 0%| | 0/260 [00:00<?, ?it/s]
10157
+ 0%| | 0/260 [00:00<?, ?it/s]
10158
+ 0%| | 0/260 [00:00<?, ?it/s]
10159
+ 0%| | 0/260 [00:00<?, ?it/s]
10160
+ 0%| | 0/260 [00:00<?, ?it/s]
10161
+ 0%| | 0/260 [00:00<?, ?it/s]
10162
+ 0%| | 0/260 [00:00<?, ?it/s]
10163
+ 0%| | 0/260 [00:00<?, ?it/s]
10164
+ 0%| | 0/260 [00:00<?, ?it/s]
10165
+ 0%| | 0/260 [00:00<?, ?it/s]
10166
+ 0%| | 0/260 [00:00<?, ?it/s]
10167
+ 0%| | 0/260 [00:00<?, ?it/s]
10168
+ 0%| | 0/260 [00:00<?, ?it/s]
10169
+ 0%| | 0/260 [00:00<?, ?it/s]
10170
+ 0%| | 0/260 [00:00<?, ?it/s]
10171
+ 0%| | 0/260 [00:00<?, ?it/s]
10172
+ 0%| | 0/260 [00:00<?, ?it/s]
10173
+ 0%| | 0/260 [00:00<?, ?it/s]
10174
+ 0%| | 0/260 [00:00<?, ?it/s]
10175
+ 0%| | 0/260 [00:00<?, ?it/s]
10176
+ 0%| | 0/260 [00:00<?, ?it/s]
10177
+ 0%| | 0/260 [00:00<?, ?it/s]
10178
+ 0%| | 0/260 [00:00<?, ?it/s]
10179
+ 0%| | 0/260 [00:00<?, ?it/s]
10180
+ 0%| | 0/260 [00:00<?, ?it/s]
10181
+ 0%| | 0/260 [00:00<?, ?it/s]
10182
+ 0%| | 0/260 [00:00<?, ?it/s]
10183
+ 0%| | 0/260 [00:00<?, ?it/s]
10184
+ 0%| | 0/260 [00:00<?, ?it/s]
10185
+ 0%| | 0/260 [00:00<?, ?it/s]
10186
+ 0%| | 0/260 [00:00<?, ?it/s]
10187
+ 0%| | 0/260 [00:00<?, ?it/s]
10188
+ 0%| | 0/260 [00:00<?, ?it/s]
10189
+ 0%| | 0/260 [00:00<?, ?it/s]
10190
+ 0%| | 0/260 [00:00<?, ?it/s]
10191
+ 0%| | 0/260 [00:00<?, ?it/s]
10192
+ 0%| | 0/260 [00:00<?, ?it/s]
10193
+ 0%| | 0/260 [00:00<?, ?it/s]
10194
+ 0%| | 0/260 [00:00<?, ?it/s]
10195
+ 0%| | 0/260 [00:00<?, ?it/s]
10196
+ 0%| | 0/260 [00:00<?, ?it/s]
10197
+ 0%| | 0/260 [00:00<?, ?it/s]
10198
+ 0%| | 0/260 [00:00<?, ?it/s]
10199
+ 0%| | 0/260 [00:00<?, ?it/s]
10200
+ 0%| | 0/260 [00:00<?, ?it/s]
10201
+ 0%| | 0/260 [00:00<?, ?it/s]
10202
+ 0%| | 0/260 [00:00<?, ?it/s]
10203
+ 0%| | 0/260 [00:00<?, ?it/s]
10204
+ 0%| | 0/260 [00:00<?, ?it/s]
10205
+ 0%| | 0/260 [00:00<?, ?it/s]
10206
+ 0%| | 0/260 [00:00<?, ?it/s]
10207
+ 0%| | 0/260 [00:00<?, ?it/s]
10208
+ 0%| | 0/260 [00:00<?, ?it/s]
10209
+ 0%| | 0/260 [00:00<?, ?it/s]
10210
+ 0%| | 0/260 [00:00<?, ?it/s]
10211
+ 0%| | 0/260 [00:00<?, ?it/s]
10212
+ 0%| | 0/260 [00:00<?, ?it/s]
10213
+ 0%| | 0/260 [00:00<?, ?it/s]
10214
+ 0%| | 0/260 [00:00<?, ?it/s]
10215
+ 0%| | 0/260 [00:00<?, ?it/s]
10216
+ 0%| | 0/260 [00:00<?, ?it/s]
10217
+ 0%| | 0/260 [00:00<?, ?it/s]
10218
+ 0%| | 0/260 [00:00<?, ?it/s]
10219
+ 0%| | 0/260 [00:00<?, ?it/s]
10220
+ 0%| | 0/260 [00:00<?, ?it/s]
10221
+ 0%| | 0/260 [00:00<?, ?it/s]
10222
+ 0%| | 0/260 [00:00<?, ?it/s]
10223
+ 0%| | 0/260 [00:00<?, ?it/s]
10224
+ 0%| | 0/260 [00:00<?, ?it/s]
10225
+ 0%| | 0/260 [00:00<?, ?it/s]
10226
+ ***** eval metrics *****
10227
+ epoch = 15.0
10228
+ eval_loss = 0.229
10229
+ eval_runtime = 0:05:27.61
10230
+ eval_samples = 8301
10231
+ eval_samples_per_second = 25.338
10232
+ eval_steps_per_second = 0.794
10233
+ eval_wer = 0.2382
10234
+ 0%| | 0/260 [00:00<?, ?it/s]
wandb/run-20220201_223624-2b1hcyq3/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220201_223624-2b1hcyq3/logs/debug-internal.log CHANGED
@@ -15654,3 +15654,206 @@
15654
  2022-02-02 05:10:58,718 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15655
  2022-02-02 05:10:58,928 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15656
  2022-02-02 05:11:00,929 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15654
  2022-02-02 05:10:58,718 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15655
  2022-02-02 05:10:58,928 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15656
  2022-02-02 05:11:00,929 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15657
+ 2022-02-02 05:11:05,995 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15658
+ 2022-02-02 05:11:05,996 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15659
+ 2022-02-02 05:11:08,934 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15660
+ 2022-02-02 05:11:10,936 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15661
+ 2022-02-02 05:11:12,937 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15662
+ 2022-02-02 05:11:14,938 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15663
+ 2022-02-02 05:11:16,939 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15664
+ 2022-02-02 05:11:18,941 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15665
+ 2022-02-02 05:11:20,942 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15666
+ 2022-02-02 05:11:21,177 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15667
+ 2022-02-02 05:11:21,177 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15668
+ 2022-02-02 05:11:22,944 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15669
+ 2022-02-02 05:11:24,946 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15670
+ 2022-02-02 05:11:26,947 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15671
+ 2022-02-02 05:11:28,949 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15672
+ 2022-02-02 05:11:28,980 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15673
+ 2022-02-02 05:11:30,951 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15674
+ 2022-02-02 05:11:32,953 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15675
+ 2022-02-02 05:11:34,955 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15676
+ 2022-02-02 05:11:36,422 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15677
+ 2022-02-02 05:11:36,422 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15678
+ 2022-02-02 05:11:36,957 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15679
+ 2022-02-02 05:11:38,959 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15680
+ 2022-02-02 05:11:40,961 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15681
+ 2022-02-02 05:11:42,962 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15682
+ 2022-02-02 05:11:44,964 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15683
+ 2022-02-02 05:11:46,967 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15684
+ 2022-02-02 05:11:48,968 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15685
+ 2022-02-02 05:11:50,970 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15686
+ 2022-02-02 05:11:51,698 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15687
+ 2022-02-02 05:11:51,699 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15688
+ 2022-02-02 05:11:52,972 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15689
+ 2022-02-02 05:11:54,973 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15690
+ 2022-02-02 05:11:57,976 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15691
+ 2022-02-02 05:11:59,258 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15692
+ 2022-02-02 05:11:59,978 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15693
+ 2022-02-02 05:12:01,980 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15694
+ 2022-02-02 05:12:03,981 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15695
+ 2022-02-02 05:12:05,983 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15696
+ 2022-02-02 05:12:06,928 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15697
+ 2022-02-02 05:12:06,928 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15698
+ 2022-02-02 05:12:07,985 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15699
+ 2022-02-02 05:12:09,987 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15700
+ 2022-02-02 05:12:11,989 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15701
+ 2022-02-02 05:12:13,990 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15702
+ 2022-02-02 05:12:15,992 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15703
+ 2022-02-02 05:12:17,994 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15704
+ 2022-02-02 05:12:19,996 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15705
+ 2022-02-02 05:12:21,998 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15706
+ 2022-02-02 05:12:22,188 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15707
+ 2022-02-02 05:12:22,188 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15708
+ 2022-02-02 05:12:24,000 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15709
+ 2022-02-02 05:12:26,002 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15710
+ 2022-02-02 05:12:28,003 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15711
+ 2022-02-02 05:12:29,595 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15712
+ 2022-02-02 05:12:30,004 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15713
+ 2022-02-02 05:12:32,006 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15714
+ 2022-02-02 05:12:34,007 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15715
+ 2022-02-02 05:12:36,009 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15716
+ 2022-02-02 05:12:37,464 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15717
+ 2022-02-02 05:12:37,465 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15718
+ 2022-02-02 05:12:38,009 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15719
+ 2022-02-02 05:12:40,011 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15720
+ 2022-02-02 05:12:42,012 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15721
+ 2022-02-02 05:12:44,014 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15722
+ 2022-02-02 05:12:46,015 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15723
+ 2022-02-02 05:12:48,016 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15724
+ 2022-02-02 05:12:50,018 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15725
+ 2022-02-02 05:12:52,019 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15726
+ 2022-02-02 05:12:52,678 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15727
+ 2022-02-02 05:12:52,679 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15728
+ 2022-02-02 05:12:54,021 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15729
+ 2022-02-02 05:12:56,023 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15730
+ 2022-02-02 05:12:58,025 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15731
+ 2022-02-02 05:12:59,856 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15732
+ 2022-02-02 05:13:00,027 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15733
+ 2022-02-02 05:13:03,030 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15734
+ 2022-02-02 05:13:05,032 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15735
+ 2022-02-02 05:13:07,034 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15736
+ 2022-02-02 05:13:08,032 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15737
+ 2022-02-02 05:13:08,033 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15738
+ 2022-02-02 05:13:09,039 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15739
+ 2022-02-02 05:13:11,041 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15740
+ 2022-02-02 05:13:13,043 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15741
+ 2022-02-02 05:13:15,044 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15742
+ 2022-02-02 05:13:17,046 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15743
+ 2022-02-02 05:13:19,047 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15744
+ 2022-02-02 05:13:21,048 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15745
+ 2022-02-02 05:13:23,049 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15746
+ 2022-02-02 05:13:23,299 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15747
+ 2022-02-02 05:13:23,299 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15748
+ 2022-02-02 05:13:25,051 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15749
+ 2022-02-02 05:13:27,052 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15750
+ 2022-02-02 05:13:29,053 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15751
+ 2022-02-02 05:13:30,138 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15752
+ 2022-02-02 05:13:31,054 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15753
+ 2022-02-02 05:13:33,055 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15754
+ 2022-02-02 05:13:35,057 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15755
+ 2022-02-02 05:13:37,058 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15756
+ 2022-02-02 05:13:38,513 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15757
+ 2022-02-02 05:13:38,514 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15758
+ 2022-02-02 05:13:39,059 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15759
+ 2022-02-02 05:13:41,060 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15760
+ 2022-02-02 05:13:43,062 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15761
+ 2022-02-02 05:13:45,063 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15762
+ 2022-02-02 05:13:47,065 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15763
+ 2022-02-02 05:13:49,066 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15764
+ 2022-02-02 05:13:51,068 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15765
+ 2022-02-02 05:13:53,070 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15766
+ 2022-02-02 05:13:53,729 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15767
+ 2022-02-02 05:13:53,730 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15768
+ 2022-02-02 05:13:55,072 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15769
+ 2022-02-02 05:13:57,074 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15770
+ 2022-02-02 05:13:59,076 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15771
+ 2022-02-02 05:14:00,408 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15772
+ 2022-02-02 05:14:01,078 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15773
+ 2022-02-02 05:14:03,080 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15774
+ 2022-02-02 05:14:05,082 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15775
+ 2022-02-02 05:14:07,084 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15776
+ 2022-02-02 05:14:09,006 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15777
+ 2022-02-02 05:14:09,007 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15778
+ 2022-02-02 05:14:09,086 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15779
+ 2022-02-02 05:14:12,089 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15780
+ 2022-02-02 05:14:14,091 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15781
+ 2022-02-02 05:14:16,093 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15782
+ 2022-02-02 05:14:18,095 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15783
+ 2022-02-02 05:14:20,096 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15784
+ 2022-02-02 05:14:22,098 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15785
+ 2022-02-02 05:14:24,099 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15786
+ 2022-02-02 05:14:24,248 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15787
+ 2022-02-02 05:14:24,249 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15788
+ 2022-02-02 05:14:26,100 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15789
+ 2022-02-02 05:14:28,102 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15790
+ 2022-02-02 05:14:30,103 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15791
+ 2022-02-02 05:14:30,714 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15792
+ 2022-02-02 05:14:32,105 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15793
+ 2022-02-02 05:14:34,106 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15794
+ 2022-02-02 05:14:36,108 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15795
+ 2022-02-02 05:14:38,110 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15796
+ 2022-02-02 05:14:39,469 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15797
+ 2022-02-02 05:14:39,470 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15798
+ 2022-02-02 05:14:40,112 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15799
+ 2022-02-02 05:14:42,114 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15800
+ 2022-02-02 05:14:44,116 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15801
+ 2022-02-02 05:14:46,118 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15802
+ 2022-02-02 05:14:48,120 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15803
+ 2022-02-02 05:14:50,121 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15804
+ 2022-02-02 05:14:52,122 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15805
+ 2022-02-02 05:14:54,124 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15806
+ 2022-02-02 05:14:54,704 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15807
+ 2022-02-02 05:14:54,705 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15808
+ 2022-02-02 05:14:56,125 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15809
+ 2022-02-02 05:14:58,127 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15810
+ 2022-02-02 05:15:00,127 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15811
+ 2022-02-02 05:15:00,966 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15812
+ 2022-02-02 05:15:02,128 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15813
+ 2022-02-02 05:15:04,129 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15814
+ 2022-02-02 05:15:06,131 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15815
+ 2022-02-02 05:15:08,132 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15816
+ 2022-02-02 05:15:09,927 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15817
+ 2022-02-02 05:15:09,928 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15818
+ 2022-02-02 05:15:10,134 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15819
+ 2022-02-02 05:15:12,135 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15820
+ 2022-02-02 05:15:14,136 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15821
+ 2022-02-02 05:15:16,138 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15822
+ 2022-02-02 05:15:18,139 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15823
+ 2022-02-02 05:15:21,141 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15824
+ 2022-02-02 05:15:23,142 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15825
+ 2022-02-02 05:15:25,143 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15826
+ 2022-02-02 05:15:25,146 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15827
+ 2022-02-02 05:15:25,147 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15828
+ 2022-02-02 05:15:27,144 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15829
+ 2022-02-02 05:15:29,146 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15830
+ 2022-02-02 05:15:31,147 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15831
+ 2022-02-02 05:15:31,197 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15832
+ 2022-02-02 05:15:33,149 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15833
+ 2022-02-02 05:15:35,150 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15834
+ 2022-02-02 05:15:37,151 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15835
+ 2022-02-02 05:15:39,153 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15836
+ 2022-02-02 05:15:40,317 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15837
+ 2022-02-02 05:15:40,318 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15838
+ 2022-02-02 05:15:41,154 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15839
+ 2022-02-02 05:15:43,156 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15840
+ 2022-02-02 05:15:55,525 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15841
+ 2022-02-02 05:15:55,526 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15842
+ 2022-02-02 05:16:01,402 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15843
+ 2022-02-02 05:16:10,740 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15844
+ 2022-02-02 05:16:10,740 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15845
+ 2022-02-02 05:16:25,952 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15846
+ 2022-02-02 05:16:25,953 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15847
+ 2022-02-02 05:16:31,634 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
15848
+ 2022-02-02 05:16:40,636 DEBUG SenderThread:38198 [sender.py:send():234] send: history
15849
+ 2022-02-02 05:16:40,672 DEBUG SenderThread:38198 [sender.py:send():234] send: summary
15850
+ 2022-02-02 05:16:40,718 INFO SenderThread:38198 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
15851
+ 2022-02-02 05:16:41,169 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15852
+ 2022-02-02 05:16:41,170 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15853
+ 2022-02-02 05:16:41,213 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/wandb-summary.json
15854
+ 2022-02-02 05:16:42,215 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15855
+ 2022-02-02 05:16:43,216 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15856
+ 2022-02-02 05:16:45,218 INFO Thread-8 :38198 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-pt/wandb/run-20220201_223624-2b1hcyq3/files/output.log
15857
+ 2022-02-02 05:16:56,339 DEBUG HandlerThread:38198 [handler.py:handle_request():130] handle_request: stop_status
15858
+ 2022-02-02 05:16:56,341 DEBUG SenderThread:38198 [sender.py:send_request():248] send_request: stop_status
15859
+ 2022-02-02 05:17:01,881 DEBUG SenderThread:38198 [sender.py:send():234] send: stats
wandb/run-20220201_223624-2b1hcyq3/run-2b1hcyq3.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b136da7b148d309b90b6ed41c2a300508201c94dc0ac980afd1bf4ef6ba2dfec
3
- size 77234252
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:764eec6e1852e638edc76312dbb37eada116dbdd4009bd8a4c72e8f08615fe6f
3
+ size 77274919