Hugging Face's logo

hf-test
/
xls-r-300m-sv

Automatic Speech Recognition
Transformers
PyTorch
TensorBoard
wav2vec2
generated_from_trainer
hf-asr-leaderboard
hello
model_for_talk
mozilla-foundation/common_voice_7_0
robust-speech-event
sv
Eval Results
Inference Endpoints
Model card Files Metrics Community
2
hf-test commited on
Commit
f7ee644
•
1 Parent(s): bc690ab

End of training

Browse files
Files changed (13) hide show
  1. all_results.json +14 -0
  2. emissions.csv +2 -0
  3. eval_results.json +9 -0
  4. pytorch_model.bin +1 -1
  5. runs/Jan09_22-00-50_brutasse/events.out.tfevents.1641765760.brutasse.31164.0 +2 -2
  6. runs/Jan09_22-00-50_brutasse/events.out.tfevents.1641794162.brutasse.31164.2 +3 -0
  7. train_results.json +8 -0
  8. trainer_state.json +1363 -0
  9. wandb/run-20220109_220240-1g372i3v/files/config.yaml +20 -0
  10. wandb/run-20220109_220240-1g372i3v/files/output.log +0 -0
  11. wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json +0 -0
  12. wandb/run-20220109_220240-1g372i3v/logs/debug-internal.log +295 -0
  13. wandb/run-20220109_220240-1g372i3v/run-1g372i3v.wandb +2 -2
all_results.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 50.0,
3
+ "eval_loss": 0.31710612773895264,
4
+ "eval_runtime": 143.0494,
5
+ "eval_samples": 4620,
6
+ "eval_samples_per_second": 32.297,
7
+ "eval_steps_per_second": 4.041,
8
+ "eval_wer": 0.2729914948295907,
9
+ "train_loss": 1.449138161858847,
10
+ "train_runtime": 28230.9535,
11
+ "train_samples": 11030,
12
+ "train_samples_per_second": 19.535,
13
+ "train_steps_per_second": 0.609
14
+ }
emissions.csv ADDED
@@ -0,0 +1,2 @@
 
 
1
+ timestamp,experiment_id,project_name,duration,emissions,energy_consumed,country_name,country_iso_code,region,on_cloud,cloud_provider,cloud_region
2
+ 2022-01-10T05:53:14,75ea1530-8942-4692-be76-728eb3220256,codecarbon,28228.195752620697,0.07002893863890894,0.332717086132922,United States,USA,new york,N,,
eval_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 50.0,
3
+ "eval_loss": 0.31710612773895264,
4
+ "eval_runtime": 143.0494,
5
+ "eval_samples": 4620,
6
+ "eval_samples_per_second": 32.297,
7
+ "eval_steps_per_second": 4.041,
8
+ "eval_wer": 0.2729914948295907
9
+ }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5438cbd0eba94a1cab2ca35a3b193772613fffe70199870024beaa91696190af
3
  size 1262075377
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb0f7cedddb36a77f8ecec2815c1d87a25de5f8f4fdeea90fe6804629e392e8f
3
  size 1262075377
runs/Jan09_22-00-50_brutasse/events.out.tfevents.1641765760.brutasse.31164.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9ef7ffcd1e4a523144a1d9e2c02733afdecc249ad95a3c6ecc00e29c86a229a1
3
- size 42190
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f41e8c0978e581e9eb3ec9d91449673936330df0e34d2702992ac6cba1e5c4f3
3
+ size 42870
runs/Jan09_22-00-50_brutasse/events.out.tfevents.1641794162.brutasse.31164.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86d7611052e3eab60a770d7c92917947506e767a56a5041be5a4caed26e720f0
3
+ size 364
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 50.0,
3
+ "train_loss": 1.449138161858847,
4
+ "train_runtime": 28230.9535,
5
+ "train_samples": 11030,
6
+ "train_samples_per_second": 19.535,
7
+ "train_steps_per_second": 0.609
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,1363 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 49.99782451051487,
5
+ "global_step": 17200,
6
+ "is_hyper_param_search": false,
7
+ "is_local_process_zero": true,
8
+ "is_world_process_zero": true,
9
+ "log_history": [
10
+ {
11
+ "epoch": 0.29,
12
+ "learning_rate": 3.7125e-06,
13
+ "loss": 12.2893,
14
+ "step": 100
15
+ },
16
+ {
17
+ "epoch": 0.58,
18
+ "learning_rate": 7.4625e-06,
19
+ "loss": 6.2066,
20
+ "step": 200
21
+ },
22
+ {
23
+ "epoch": 0.87,
24
+ "learning_rate": 1.1212499999999998e-05,
25
+ "loss": 4.1421,
26
+ "step": 300
27
+ },
28
+ {
29
+ "epoch": 1.16,
30
+ "learning_rate": 1.49625e-05,
31
+ "loss": 3.6807,
32
+ "step": 400
33
+ },
34
+ {
35
+ "epoch": 1.45,
36
+ "learning_rate": 1.8712499999999997e-05,
37
+ "loss": 3.3349,
38
+ "step": 500
39
+ },
40
+ {
41
+ "epoch": 1.45,
42
+ "eval_loss": 3.2857718467712402,
43
+ "eval_runtime": 141.2158,
44
+ "eval_samples_per_second": 32.716,
45
+ "eval_steps_per_second": 4.093,
46
+ "eval_wer": 1.0,
47
+ "step": 500
48
+ },
49
+ {
50
+ "epoch": 1.74,
51
+ "learning_rate": 2.2462499999999997e-05,
52
+ "loss": 3.1383,
53
+ "step": 600
54
+ },
55
+ {
56
+ "epoch": 2.03,
57
+ "learning_rate": 2.6212499999999997e-05,
58
+ "loss": 3.0909,
59
+ "step": 700
60
+ },
61
+ {
62
+ "epoch": 2.32,
63
+ "learning_rate": 2.99625e-05,
64
+ "loss": 3.0188,
65
+ "step": 800
66
+ },
67
+ {
68
+ "epoch": 2.61,
69
+ "learning_rate": 3.37125e-05,
70
+ "loss": 2.9601,
71
+ "step": 900
72
+ },
73
+ {
74
+ "epoch": 2.91,
75
+ "learning_rate": 3.7462499999999996e-05,
76
+ "loss": 2.9298,
77
+ "step": 1000
78
+ },
79
+ {
80
+ "epoch": 2.91,
81
+ "eval_loss": 2.922468662261963,
82
+ "eval_runtime": 142.3546,
83
+ "eval_samples_per_second": 32.454,
84
+ "eval_steps_per_second": 4.06,
85
+ "eval_wer": 1.000030594138163,
86
+ "step": 1000
87
+ },
88
+ {
89
+ "epoch": 3.2,
90
+ "learning_rate": 4.12125e-05,
91
+ "loss": 2.9181,
92
+ "step": 1100
93
+ },
94
+ {
95
+ "epoch": 3.49,
96
+ "learning_rate": 4.4962499999999995e-05,
97
+ "loss": 2.8449,
98
+ "step": 1200
99
+ },
100
+ {
101
+ "epoch": 3.78,
102
+ "learning_rate": 4.871249999999999e-05,
103
+ "loss": 2.7039,
104
+ "step": 1300
105
+ },
106
+ {
107
+ "epoch": 4.07,
108
+ "learning_rate": 5.2462499999999994e-05,
109
+ "loss": 2.3828,
110
+ "step": 1400
111
+ },
112
+ {
113
+ "epoch": 4.36,
114
+ "learning_rate": 5.62125e-05,
115
+ "loss": 2.0839,
116
+ "step": 1500
117
+ },
118
+ {
119
+ "epoch": 4.36,
120
+ "eval_loss": 1.1546391248703003,
121
+ "eval_runtime": 141.9654,
122
+ "eval_samples_per_second": 32.543,
123
+ "eval_steps_per_second": 4.071,
124
+ "eval_wer": 0.829498868016888,
125
+ "step": 1500
126
+ },
127
+ {
128
+ "epoch": 4.65,
129
+ "learning_rate": 5.9962499999999994e-05,
130
+ "loss": 1.9444,
131
+ "step": 1600
132
+ },
133
+ {
134
+ "epoch": 4.94,
135
+ "learning_rate": 6.37125e-05,
136
+ "loss": 1.8594,
137
+ "step": 1700
138
+ },
139
+ {
140
+ "epoch": 5.23,
141
+ "learning_rate": 6.746249999999999e-05,
142
+ "loss": 1.8026,
143
+ "step": 1800
144
+ },
145
+ {
146
+ "epoch": 5.52,
147
+ "learning_rate": 7.121249999999999e-05,
148
+ "loss": 1.7341,
149
+ "step": 1900
150
+ },
151
+ {
152
+ "epoch": 5.81,
153
+ "learning_rate": 7.49625e-05,
154
+ "loss": 1.7093,
155
+ "step": 2000
156
+ },
157
+ {
158
+ "epoch": 5.81,
159
+ "eval_loss": 0.6826953887939453,
160
+ "eval_runtime": 142.0245,
161
+ "eval_samples_per_second": 32.53,
162
+ "eval_steps_per_second": 4.07,
163
+ "eval_wer": 0.5701217646698893,
164
+ "step": 2000
165
+ },
166
+ {
167
+ "epoch": 6.1,
168
+ "learning_rate": 7.451151315789474e-05,
169
+ "loss": 1.6759,
170
+ "step": 2100
171
+ },
172
+ {
173
+ "epoch": 6.39,
174
+ "learning_rate": 7.402302631578947e-05,
175
+ "loss": 1.6272,
176
+ "step": 2200
177
+ },
178
+ {
179
+ "epoch": 6.68,
180
+ "learning_rate": 7.352960526315788e-05,
181
+ "loss": 1.6174,
182
+ "step": 2300
183
+ },
184
+ {
185
+ "epoch": 6.97,
186
+ "learning_rate": 7.30361842105263e-05,
187
+ "loss": 1.6106,
188
+ "step": 2400
189
+ },
190
+ {
191
+ "epoch": 7.27,
192
+ "learning_rate": 7.254276315789473e-05,
193
+ "loss": 1.5855,
194
+ "step": 2500
195
+ },
196
+ {
197
+ "epoch": 7.27,
198
+ "eval_loss": 0.5596911311149597,
199
+ "eval_runtime": 141.6166,
200
+ "eval_samples_per_second": 32.623,
201
+ "eval_steps_per_second": 4.081,
202
+ "eval_wer": 0.49467661995961576,
203
+ "step": 2500
204
+ },
205
+ {
206
+ "epoch": 7.56,
207
+ "learning_rate": 7.204934210526316e-05,
208
+ "loss": 1.5606,
209
+ "step": 2600
210
+ },
211
+ {
212
+ "epoch": 7.85,
213
+ "learning_rate": 7.155592105263157e-05,
214
+ "loss": 1.5163,
215
+ "step": 2700
216
+ },
217
+ {
218
+ "epoch": 8.14,
219
+ "learning_rate": 7.10625e-05,
220
+ "loss": 1.5371,
221
+ "step": 2800
222
+ },
223
+ {
224
+ "epoch": 8.43,
225
+ "learning_rate": 7.056907894736841e-05,
226
+ "loss": 1.5072,
227
+ "step": 2900
228
+ },
229
+ {
230
+ "epoch": 8.72,
231
+ "learning_rate": 7.007565789473684e-05,
232
+ "loss": 1.4831,
233
+ "step": 3000
234
+ },
235
+ {
236
+ "epoch": 8.72,
237
+ "eval_loss": 0.49225884675979614,
238
+ "eval_runtime": 141.5992,
239
+ "eval_samples_per_second": 32.627,
240
+ "eval_steps_per_second": 4.082,
241
+ "eval_wer": 0.45267086826164105,
242
+ "step": 3000
243
+ },
244
+ {
245
+ "epoch": 9.01,
246
+ "learning_rate": 6.958717105263157e-05,
247
+ "loss": 1.5036,
248
+ "step": 3100
249
+ },
250
+ {
251
+ "epoch": 9.3,
252
+ "learning_rate": 6.909375e-05,
253
+ "loss": 1.4641,
254
+ "step": 3200
255
+ },
256
+ {
257
+ "epoch": 9.59,
258
+ "learning_rate": 6.860032894736842e-05,
259
+ "loss": 1.4493,
260
+ "step": 3300
261
+ },
262
+ {
263
+ "epoch": 9.88,
264
+ "learning_rate": 6.810690789473684e-05,
265
+ "loss": 1.4722,
266
+ "step": 3400
267
+ },
268
+ {
269
+ "epoch": 10.17,
270
+ "learning_rate": 6.761348684210526e-05,
271
+ "loss": 1.4416,
272
+ "step": 3500
273
+ },
274
+ {
275
+ "epoch": 10.17,
276
+ "eval_loss": 0.46698251366615295,
277
+ "eval_runtime": 142.3359,
278
+ "eval_samples_per_second": 32.458,
279
+ "eval_steps_per_second": 4.061,
280
+ "eval_wer": 0.4269717922046136,
281
+ "step": 3500
282
+ },
283
+ {
284
+ "epoch": 10.46,
285
+ "learning_rate": 6.712006578947368e-05,
286
+ "loss": 1.4211,
287
+ "step": 3600
288
+ },
289
+ {
290
+ "epoch": 10.75,
291
+ "learning_rate": 6.66266447368421e-05,
292
+ "loss": 1.4086,
293
+ "step": 3700
294
+ },
295
+ {
296
+ "epoch": 11.05,
297
+ "learning_rate": 6.613322368421052e-05,
298
+ "loss": 1.4385,
299
+ "step": 3800
300
+ },
301
+ {
302
+ "epoch": 11.34,
303
+ "learning_rate": 6.563980263157894e-05,
304
+ "loss": 1.3916,
305
+ "step": 3900
306
+ },
307
+ {
308
+ "epoch": 11.63,
309
+ "learning_rate": 6.514638157894736e-05,
310
+ "loss": 1.3848,
311
+ "step": 4000
312
+ },
313
+ {
314
+ "epoch": 11.63,
315
+ "eval_loss": 0.43410158157348633,
316
+ "eval_runtime": 142.891,
317
+ "eval_samples_per_second": 32.332,
318
+ "eval_steps_per_second": 4.045,
319
+ "eval_wer": 0.39799914336413145,
320
+ "step": 4000
321
+ },
322
+ {
323
+ "epoch": 11.92,
324
+ "learning_rate": 6.465296052631578e-05,
325
+ "loss": 1.3851,
326
+ "step": 4100
327
+ },
328
+ {
329
+ "epoch": 12.21,
330
+ "learning_rate": 6.415953947368421e-05,
331
+ "loss": 1.3951,
332
+ "step": 4200
333
+ },
334
+ {
335
+ "epoch": 12.5,
336
+ "learning_rate": 6.366611842105262e-05,
337
+ "loss": 1.377,
338
+ "step": 4300
339
+ },
340
+ {
341
+ "epoch": 12.79,
342
+ "learning_rate": 6.317269736842105e-05,
343
+ "loss": 1.3609,
344
+ "step": 4400
345
+ },
346
+ {
347
+ "epoch": 13.08,
348
+ "learning_rate": 6.267927631578946e-05,
349
+ "loss": 1.3749,
350
+ "step": 4500
351
+ },
352
+ {
353
+ "epoch": 13.08,
354
+ "eval_loss": 0.42033153772354126,
355
+ "eval_runtime": 142.2303,
356
+ "eval_samples_per_second": 32.483,
357
+ "eval_steps_per_second": 4.064,
358
+ "eval_wer": 0.40105855718044425,
359
+ "step": 4500
360
+ },
361
+ {
362
+ "epoch": 13.37,
363
+ "learning_rate": 6.218585526315789e-05,
364
+ "loss": 1.3346,
365
+ "step": 4600
366
+ },
367
+ {
368
+ "epoch": 13.66,
369
+ "learning_rate": 6.16924342105263e-05,
370
+ "loss": 1.3528,
371
+ "step": 4700
372
+ },
373
+ {
374
+ "epoch": 13.95,
375
+ "learning_rate": 6.119901315789473e-05,
376
+ "loss": 1.3348,
377
+ "step": 4800
378
+ },
379
+ {
380
+ "epoch": 14.24,
381
+ "learning_rate": 6.070559210526316e-05,
382
+ "loss": 1.3425,
383
+ "step": 4900
384
+ },
385
+ {
386
+ "epoch": 14.53,
387
+ "learning_rate": 6.021217105263157e-05,
388
+ "loss": 1.3311,
389
+ "step": 5000
390
+ },
391
+ {
392
+ "epoch": 14.53,
393
+ "eval_loss": 0.4309719204902649,
394
+ "eval_runtime": 143.1747,
395
+ "eval_samples_per_second": 32.268,
396
+ "eval_steps_per_second": 4.037,
397
+ "eval_wer": 0.3961023067980175,
398
+ "step": 5000
399
+ },
400
+ {
401
+ "epoch": 14.82,
402
+ "learning_rate": 5.971875e-05,
403
+ "loss": 1.3272,
404
+ "step": 5100
405
+ },
406
+ {
407
+ "epoch": 15.12,
408
+ "learning_rate": 5.922532894736842e-05,
409
+ "loss": 1.3359,
410
+ "step": 5200
411
+ },
412
+ {
413
+ "epoch": 15.41,
414
+ "learning_rate": 5.873190789473683e-05,
415
+ "loss": 1.3071,
416
+ "step": 5300
417
+ },
418
+ {
419
+ "epoch": 15.7,
420
+ "learning_rate": 5.823848684210526e-05,
421
+ "loss": 1.3136,
422
+ "step": 5400
423
+ },
424
+ {
425
+ "epoch": 15.99,
426
+ "learning_rate": 5.7745065789473685e-05,
427
+ "loss": 1.317,
428
+ "step": 5500
429
+ },
430
+ {
431
+ "epoch": 15.99,
432
+ "eval_loss": 0.3898037374019623,
433
+ "eval_runtime": 142.672,
434
+ "eval_samples_per_second": 32.382,
435
+ "eval_steps_per_second": 4.051,
436
+ "eval_wer": 0.43217279569234535,
437
+ "step": 5500
438
+ },
439
+ {
440
+ "epoch": 16.28,
441
+ "learning_rate": 5.72516447368421e-05,
442
+ "loss": 1.2904,
443
+ "step": 5600
444
+ },
445
+ {
446
+ "epoch": 16.57,
447
+ "learning_rate": 5.675822368421052e-05,
448
+ "loss": 1.3134,
449
+ "step": 5700
450
+ },
451
+ {
452
+ "epoch": 16.86,
453
+ "learning_rate": 5.6264802631578946e-05,
454
+ "loss": 1.2875,
455
+ "step": 5800
456
+ },
457
+ {
458
+ "epoch": 17.15,
459
+ "learning_rate": 5.577138157894736e-05,
460
+ "loss": 1.2874,
461
+ "step": 5900
462
+ },
463
+ {
464
+ "epoch": 17.44,
465
+ "learning_rate": 5.52828947368421e-05,
466
+ "loss": 1.2799,
467
+ "step": 6000
468
+ },
469
+ {
470
+ "epoch": 17.44,
471
+ "eval_loss": 0.3805598020553589,
472
+ "eval_runtime": 143.0363,
473
+ "eval_samples_per_second": 32.3,
474
+ "eval_steps_per_second": 4.041,
475
+ "eval_wer": 0.357247751330845,
476
+ "step": 6000
477
+ },
478
+ {
479
+ "epoch": 17.73,
480
+ "learning_rate": 5.478947368421052e-05,
481
+ "loss": 1.2704,
482
+ "step": 6100
483
+ },
484
+ {
485
+ "epoch": 18.02,
486
+ "learning_rate": 5.429605263157895e-05,
487
+ "loss": 1.2974,
488
+ "step": 6200
489
+ },
490
+ {
491
+ "epoch": 18.31,
492
+ "learning_rate": 5.380263157894736e-05,
493
+ "loss": 1.2545,
494
+ "step": 6300
495
+ },
496
+ {
497
+ "epoch": 18.6,
498
+ "learning_rate": 5.330921052631578e-05,
499
+ "loss": 1.2781,
500
+ "step": 6400
501
+ },
502
+ {
503
+ "epoch": 18.89,
504
+ "learning_rate": 5.281578947368421e-05,
505
+ "loss": 1.2771,
506
+ "step": 6500
507
+ },
508
+ {
509
+ "epoch": 18.89,
510
+ "eval_loss": 0.38284429907798767,
511
+ "eval_runtime": 142.0565,
512
+ "eval_samples_per_second": 32.522,
513
+ "eval_steps_per_second": 4.069,
514
+ "eval_wer": 0.34268494156519613,
515
+ "step": 6500
516
+ },
517
+ {
518
+ "epoch": 19.19,
519
+ "learning_rate": 5.232236842105262e-05,
520
+ "loss": 1.2641,
521
+ "step": 6600
522
+ },
523
+ {
524
+ "epoch": 19.48,
525
+ "learning_rate": 5.182894736842105e-05,
526
+ "loss": 1.241,
527
+ "step": 6700
528
+ },
529
+ {
530
+ "epoch": 19.77,
531
+ "learning_rate": 5.133552631578947e-05,
532
+ "loss": 1.2456,
533
+ "step": 6800
534
+ },
535
+ {
536
+ "epoch": 20.06,
537
+ "learning_rate": 5.084210526315789e-05,
538
+ "loss": 1.2597,
539
+ "step": 6900
540
+ },
541
+ {
542
+ "epoch": 20.35,
543
+ "learning_rate": 5.034868421052631e-05,
544
+ "loss": 1.2451,
545
+ "step": 7000
546
+ },
547
+ {
548
+ "epoch": 20.35,
549
+ "eval_loss": 0.37021246552467346,
550
+ "eval_runtime": 141.2064,
551
+ "eval_samples_per_second": 32.718,
552
+ "eval_steps_per_second": 4.093,
553
+ "eval_wer": 0.3358930428929817,
554
+ "step": 7000
555
+ },
556
+ {
557
+ "epoch": 20.64,
558
+ "learning_rate": 4.9855263157894736e-05,
559
+ "loss": 1.2458,
560
+ "step": 7100
561
+ },
562
+ {
563
+ "epoch": 20.93,
564
+ "learning_rate": 4.936184210526315e-05,
565
+ "loss": 1.2285,
566
+ "step": 7200
567
+ },
568
+ {
569
+ "epoch": 21.22,
570
+ "learning_rate": 4.886842105263158e-05,
571
+ "loss": 1.2305,
572
+ "step": 7300
573
+ },
574
+ {
575
+ "epoch": 21.51,
576
+ "learning_rate": 4.8375e-05,
577
+ "loss": 1.2228,
578
+ "step": 7400
579
+ },
580
+ {
581
+ "epoch": 21.8,
582
+ "learning_rate": 4.7881578947368424e-05,
583
+ "loss": 1.2182,
584
+ "step": 7500
585
+ },
586
+ {
587
+ "epoch": 21.8,
588
+ "eval_loss": 0.3685418367385864,
589
+ "eval_runtime": 141.7574,
590
+ "eval_samples_per_second": 32.591,
591
+ "eval_steps_per_second": 4.077,
592
+ "eval_wer": 0.3270207428256746,
593
+ "step": 7500
594
+ },
595
+ {
596
+ "epoch": 22.09,
597
+ "learning_rate": 4.738815789473684e-05,
598
+ "loss": 1.2297,
599
+ "step": 7600
600
+ },
601
+ {
602
+ "epoch": 22.38,
603
+ "learning_rate": 4.689473684210526e-05,
604
+ "loss": 1.2252,
605
+ "step": 7700
606
+ },
607
+ {
608
+ "epoch": 22.67,
609
+ "learning_rate": 4.6401315789473684e-05,
610
+ "loss": 1.2153,
611
+ "step": 7800
612
+ },
613
+ {
614
+ "epoch": 22.96,
615
+ "learning_rate": 4.59078947368421e-05,
616
+ "loss": 1.2132,
617
+ "step": 7900
618
+ },
619
+ {
620
+ "epoch": 23.26,
621
+ "learning_rate": 4.541940789473684e-05,
622
+ "loss": 1.2152,
623
+ "step": 8000
624
+ },
625
+ {
626
+ "epoch": 23.26,
627
+ "eval_loss": 0.3650066554546356,
628
+ "eval_runtime": 141.8703,
629
+ "eval_samples_per_second": 32.565,
630
+ "eval_steps_per_second": 4.074,
631
+ "eval_wer": 0.33078382181973937,
632
+ "step": 8000
633
+ },
634
+ {
635
+ "epoch": 23.55,
636
+ "learning_rate": 4.492598684210526e-05,
637
+ "loss": 1.185,
638
+ "step": 8100
639
+ },
640
+ {
641
+ "epoch": 23.84,
642
+ "learning_rate": 4.443256578947369e-05,
643
+ "loss": 1.2039,
644
+ "step": 8200
645
+ },
646
+ {
647
+ "epoch": 24.13,
648
+ "learning_rate": 4.39391447368421e-05,
649
+ "loss": 1.2078,
650
+ "step": 8300
651
+ },
652
+ {
653
+ "epoch": 24.42,
654
+ "learning_rate": 4.344572368421052e-05,
655
+ "loss": 1.1991,
656
+ "step": 8400
657
+ },
658
+ {
659
+ "epoch": 24.71,
660
+ "learning_rate": 4.295230263157895e-05,
661
+ "loss": 1.1837,
662
+ "step": 8500
663
+ },
664
+ {
665
+ "epoch": 24.71,
666
+ "eval_loss": 0.35678917169570923,
667
+ "eval_runtime": 142.5499,
668
+ "eval_samples_per_second": 32.41,
669
+ "eval_steps_per_second": 4.055,
670
+ "eval_wer": 0.3186991372453038,
671
+ "step": 8500
672
+ },
673
+ {
674
+ "epoch": 25.0,
675
+ "learning_rate": 4.2463815789473676e-05,
676
+ "loss": 1.1982,
677
+ "step": 8600
678
+ },
679
+ {
680
+ "epoch": 25.29,
681
+ "learning_rate": 4.19703947368421e-05,
682
+ "loss": 1.2087,
683
+ "step": 8700
684
+ },
685
+ {
686
+ "epoch": 25.58,
687
+ "learning_rate": 4.1476973684210523e-05,
688
+ "loss": 1.1841,
689
+ "step": 8800
690
+ },
691
+ {
692
+ "epoch": 25.87,
693
+ "learning_rate": 4.098355263157895e-05,
694
+ "loss": 1.1694,
695
+ "step": 8900
696
+ },
697
+ {
698
+ "epoch": 26.16,
699
+ "learning_rate": 4.0490131578947364e-05,
700
+ "loss": 1.1721,
701
+ "step": 9000
702
+ },
703
+ {
704
+ "epoch": 26.16,
705
+ "eval_loss": 0.3659152686595917,
706
+ "eval_runtime": 141.7914,
707
+ "eval_samples_per_second": 32.583,
708
+ "eval_steps_per_second": 4.076,
709
+ "eval_wer": 0.3249403414305819,
710
+ "step": 9000
711
+ },
712
+ {
713
+ "epoch": 26.45,
714
+ "learning_rate": 3.9996710526315784e-05,
715
+ "loss": 1.1585,
716
+ "step": 9100
717
+ },
718
+ {
719
+ "epoch": 26.74,
720
+ "learning_rate": 3.950328947368421e-05,
721
+ "loss": 1.1635,
722
+ "step": 9200
723
+ },
724
+ {
725
+ "epoch": 27.03,
726
+ "learning_rate": 3.9009868421052624e-05,
727
+ "loss": 1.193,
728
+ "step": 9300
729
+ },
730
+ {
731
+ "epoch": 27.32,
732
+ "learning_rate": 3.851644736842105e-05,
733
+ "loss": 1.1751,
734
+ "step": 9400
735
+ },
736
+ {
737
+ "epoch": 27.61,
738
+ "learning_rate": 3.802302631578947e-05,
739
+ "loss": 1.1764,
740
+ "step": 9500
741
+ },
742
+ {
743
+ "epoch": 27.61,
744
+ "eval_loss": 0.3546680510044098,
745
+ "eval_runtime": 142.2113,
746
+ "eval_samples_per_second": 32.487,
747
+ "eval_steps_per_second": 4.064,
748
+ "eval_wer": 0.3145077403169553,
749
+ "step": 9500
750
+ },
751
+ {
752
+ "epoch": 27.91,
753
+ "learning_rate": 3.752960526315789e-05,
754
+ "loss": 1.1551,
755
+ "step": 9600
756
+ },
757
+ {
758
+ "epoch": 28.2,
759
+ "learning_rate": 3.703618421052631e-05,
760
+ "loss": 1.1571,
761
+ "step": 9700
762
+ },
763
+ {
764
+ "epoch": 28.49,
765
+ "learning_rate": 3.654276315789473e-05,
766
+ "loss": 1.1472,
767
+ "step": 9800
768
+ },
769
+ {
770
+ "epoch": 28.78,
771
+ "learning_rate": 3.604934210526316e-05,
772
+ "loss": 1.1515,
773
+ "step": 9900
774
+ },
775
+ {
776
+ "epoch": 29.07,
777
+ "learning_rate": 3.555592105263158e-05,
778
+ "loss": 1.1606,
779
+ "step": 10000
780
+ },
781
+ {
782
+ "epoch": 29.07,
783
+ "eval_loss": 0.35135164856910706,
784
+ "eval_runtime": 141.0593,
785
+ "eval_samples_per_second": 32.752,
786
+ "eval_steps_per_second": 4.098,
787
+ "eval_wer": 0.310377531664933,
788
+ "step": 10000
789
+ },
790
+ {
791
+ "epoch": 29.36,
792
+ "learning_rate": 3.50625e-05,
793
+ "loss": 1.1487,
794
+ "step": 10100
795
+ },
796
+ {
797
+ "epoch": 29.65,
798
+ "learning_rate": 3.456907894736842e-05,
799
+ "loss": 1.1433,
800
+ "step": 10200
801
+ },
802
+ {
803
+ "epoch": 29.94,
804
+ "learning_rate": 3.407565789473684e-05,
805
+ "loss": 1.1556,
806
+ "step": 10300
807
+ },
808
+ {
809
+ "epoch": 30.23,
810
+ "learning_rate": 3.358223684210526e-05,
811
+ "loss": 1.1542,
812
+ "step": 10400
813
+ },
814
+ {
815
+ "epoch": 30.52,
816
+ "learning_rate": 3.308881578947368e-05,
817
+ "loss": 1.1431,
818
+ "step": 10500
819
+ },
820
+ {
821
+ "epoch": 30.52,
822
+ "eval_loss": 0.3469483554363251,
823
+ "eval_runtime": 141.5722,
824
+ "eval_samples_per_second": 32.634,
825
+ "eval_steps_per_second": 4.083,
826
+ "eval_wer": 0.3061555405984213,
827
+ "step": 10500
828
+ },
829
+ {
830
+ "epoch": 30.81,
831
+ "learning_rate": 3.25953947368421e-05,
832
+ "loss": 1.126,
833
+ "step": 10600
834
+ },
835
+ {
836
+ "epoch": 31.1,
837
+ "learning_rate": 3.2101973684210526e-05,
838
+ "loss": 1.1384,
839
+ "step": 10700
840
+ },
841
+ {
842
+ "epoch": 31.39,
843
+ "learning_rate": 3.1608552631578946e-05,
844
+ "loss": 1.1208,
845
+ "step": 10800
846
+ },
847
+ {
848
+ "epoch": 31.68,
849
+ "learning_rate": 3.1115131578947366e-05,
850
+ "loss": 1.1218,
851
+ "step": 10900
852
+ },
853
+ {
854
+ "epoch": 31.97,
855
+ "learning_rate": 3.0621710526315786e-05,
856
+ "loss": 1.1047,
857
+ "step": 11000
858
+ },
859
+ {
860
+ "epoch": 31.97,
861
+ "eval_loss": 0.3313155770301819,
862
+ "eval_runtime": 142.8254,
863
+ "eval_samples_per_second": 32.347,
864
+ "eval_steps_per_second": 4.047,
865
+ "eval_wer": 0.2978951232943768,
866
+ "step": 11000
867
+ },
868
+ {
869
+ "epoch": 32.27,
870
+ "learning_rate": 3.0128289473684206e-05,
871
+ "loss": 1.1228,
872
+ "step": 11100
873
+ },
874
+ {
875
+ "epoch": 32.56,
876
+ "learning_rate": 2.963486842105263e-05,
877
+ "loss": 1.1065,
878
+ "step": 11200
879
+ },
880
+ {
881
+ "epoch": 32.85,
882
+ "learning_rate": 2.914144736842105e-05,
883
+ "loss": 1.1134,
884
+ "step": 11300
885
+ },
886
+ {
887
+ "epoch": 33.14,
888
+ "learning_rate": 2.864802631578947e-05,
889
+ "loss": 1.1138,
890
+ "step": 11400
891
+ },
892
+ {
893
+ "epoch": 33.43,
894
+ "learning_rate": 2.8154605263157894e-05,
895
+ "loss": 1.1315,
896
+ "step": 11500
897
+ },
898
+ {
899
+ "epoch": 33.43,
900
+ "eval_loss": 0.3297792375087738,
901
+ "eval_runtime": 142.5868,
902
+ "eval_samples_per_second": 32.401,
903
+ "eval_steps_per_second": 4.054,
904
+ "eval_wer": 0.29924126537355444,
905
+ "step": 11500
906
+ },
907
+ {
908
+ "epoch": 33.72,
909
+ "learning_rate": 2.7661184210526314e-05,
910
+ "loss": 1.0891,
911
+ "step": 11600
912
+ },
913
+ {
914
+ "epoch": 34.01,
915
+ "learning_rate": 2.7167763157894734e-05,
916
+ "loss": 1.1259,
917
+ "step": 11700
918
+ },
919
+ {
920
+ "epoch": 34.3,
921
+ "learning_rate": 2.6674342105263157e-05,
922
+ "loss": 1.1049,
923
+ "step": 11800
924
+ },
925
+ {
926
+ "epoch": 34.59,
927
+ "learning_rate": 2.6180921052631577e-05,
928
+ "loss": 1.0896,
929
+ "step": 11900
930
+ },
931
+ {
932
+ "epoch": 34.88,
933
+ "learning_rate": 2.56875e-05,
934
+ "loss": 1.1022,
935
+ "step": 12000
936
+ },
937
+ {
938
+ "epoch": 34.88,
939
+ "eval_loss": 0.3296017050743103,
940
+ "eval_runtime": 141.6872,
941
+ "eval_samples_per_second": 32.607,
942
+ "eval_steps_per_second": 4.079,
943
+ "eval_wer": 0.2972526463929511,
944
+ "step": 12000
945
+ },
946
+ {
947
+ "epoch": 35.17,
948
+ "learning_rate": 2.5194078947368418e-05,
949
+ "loss": 1.1032,
950
+ "step": 12100
951
+ },
952
+ {
953
+ "epoch": 35.46,
954
+ "learning_rate": 2.4700657894736838e-05,
955
+ "loss": 1.0896,
956
+ "step": 12200
957
+ },
958
+ {
959
+ "epoch": 35.75,
960
+ "learning_rate": 2.420723684210526e-05,
961
+ "loss": 1.0879,
962
+ "step": 12300
963
+ },
964
+ {
965
+ "epoch": 36.05,
966
+ "learning_rate": 2.3718749999999997e-05,
967
+ "loss": 1.122,
968
+ "step": 12400
969
+ },
970
+ {
971
+ "epoch": 36.34,
972
+ "learning_rate": 2.322532894736842e-05,
973
+ "loss": 1.0935,
974
+ "step": 12500
975
+ },
976
+ {
977
+ "epoch": 36.34,
978
+ "eval_loss": 0.327805757522583,
979
+ "eval_runtime": 141.8254,
980
+ "eval_samples_per_second": 32.575,
981
+ "eval_steps_per_second": 4.075,
982
+ "eval_wer": 0.2926023373921557,
983
+ "step": 12500
984
+ },
985
+ {
986
+ "epoch": 36.63,
987
+ "learning_rate": 2.273190789473684e-05,
988
+ "loss": 1.089,
989
+ "step": 12600
990
+ },
991
+ {
992
+ "epoch": 36.92,
993
+ "learning_rate": 2.2238486842105264e-05,
994
+ "loss": 1.072,
995
+ "step": 12700
996
+ },
997
+ {
998
+ "epoch": 37.21,
999
+ "learning_rate": 2.174506578947368e-05,
1000
+ "loss": 1.0993,
1001
+ "step": 12800
1002
+ },
1003
+ {
1004
+ "epoch": 37.5,
1005
+ "learning_rate": 2.12516447368421e-05,
1006
+ "loss": 1.0868,
1007
+ "step": 12900
1008
+ },
1009
+ {
1010
+ "epoch": 37.79,
1011
+ "learning_rate": 2.0758223684210525e-05,
1012
+ "loss": 1.0676,
1013
+ "step": 13000
1014
+ },
1015
+ {
1016
+ "epoch": 37.79,
1017
+ "eval_loss": 0.3207636773586273,
1018
+ "eval_runtime": 141.3445,
1019
+ "eval_samples_per_second": 32.686,
1020
+ "eval_steps_per_second": 4.089,
1021
+ "eval_wer": 0.28675885700299825,
1022
+ "step": 13000
1023
+ },
1024
+ {
1025
+ "epoch": 38.08,
1026
+ "learning_rate": 2.0264802631578945e-05,
1027
+ "loss": 1.098,
1028
+ "step": 13100
1029
+ },
1030
+ {
1031
+ "epoch": 38.37,
1032
+ "learning_rate": 1.9771381578947365e-05,
1033
+ "loss": 1.074,
1034
+ "step": 13200
1035
+ },
1036
+ {
1037
+ "epoch": 38.66,
1038
+ "learning_rate": 1.927796052631579e-05,
1039
+ "loss": 1.0575,
1040
+ "step": 13300
1041
+ },
1042
+ {
1043
+ "epoch": 38.95,
1044
+ "learning_rate": 1.878453947368421e-05,
1045
+ "loss": 1.0775,
1046
+ "step": 13400
1047
+ },
1048
+ {
1049
+ "epoch": 39.24,
1050
+ "learning_rate": 1.829111842105263e-05,
1051
+ "loss": 1.0571,
1052
+ "step": 13500
1053
+ },
1054
+ {
1055
+ "epoch": 39.24,
1056
+ "eval_loss": 0.3322257101535797,
1057
+ "eval_runtime": 141.361,
1058
+ "eval_samples_per_second": 32.682,
1059
+ "eval_steps_per_second": 4.089,
1060
+ "eval_wer": 0.2885333170164596,
1061
+ "step": 13500
1062
+ },
1063
+ {
1064
+ "epoch": 39.53,
1065
+ "learning_rate": 1.7797697368421052e-05,
1066
+ "loss": 1.0639,
1067
+ "step": 13600
1068
+ },
1069
+ {
1070
+ "epoch": 39.82,
1071
+ "learning_rate": 1.7304276315789472e-05,
1072
+ "loss": 1.0656,
1073
+ "step": 13700
1074
+ },
1075
+ {
1076
+ "epoch": 40.12,
1077
+ "learning_rate": 1.6810855263157892e-05,
1078
+ "loss": 1.0896,
1079
+ "step": 13800
1080
+ },
1081
+ {
1082
+ "epoch": 40.41,
1083
+ "learning_rate": 1.6317434210526316e-05,
1084
+ "loss": 1.0577,
1085
+ "step": 13900
1086
+ },
1087
+ {
1088
+ "epoch": 40.7,
1089
+ "learning_rate": 1.582894736842105e-05,
1090
+ "loss": 1.0536,
1091
+ "step": 14000
1092
+ },
1093
+ {
1094
+ "epoch": 40.7,
1095
+ "eval_loss": 0.3245023787021637,
1096
+ "eval_runtime": 141.5405,
1097
+ "eval_samples_per_second": 32.641,
1098
+ "eval_steps_per_second": 4.084,
1099
+ "eval_wer": 0.283118154561586,
1100
+ "step": 14000
1101
+ },
1102
+ {
1103
+ "epoch": 40.99,
1104
+ "learning_rate": 1.5335526315789472e-05,
1105
+ "loss": 1.0625,
1106
+ "step": 14100
1107
+ },
1108
+ {
1109
+ "epoch": 41.28,
1110
+ "learning_rate": 1.4842105263157894e-05,
1111
+ "loss": 1.0675,
1112
+ "step": 14200
1113
+ },
1114
+ {
1115
+ "epoch": 41.57,
1116
+ "learning_rate": 1.4348684210526315e-05,
1117
+ "loss": 1.0562,
1118
+ "step": 14300
1119
+ },
1120
+ {
1121
+ "epoch": 41.86,
1122
+ "learning_rate": 1.3855263157894737e-05,
1123
+ "loss": 1.0601,
1124
+ "step": 14400
1125
+ },
1126
+ {
1127
+ "epoch": 42.15,
1128
+ "learning_rate": 1.3361842105263156e-05,
1129
+ "loss": 1.0525,
1130
+ "step": 14500
1131
+ },
1132
+ {
1133
+ "epoch": 42.15,
1134
+ "eval_loss": 0.32854029536247253,
1135
+ "eval_runtime": 141.2452,
1136
+ "eval_samples_per_second": 32.709,
1137
+ "eval_steps_per_second": 4.092,
1138
+ "eval_wer": 0.2825674600746497,
1139
+ "step": 14500
1140
+ },
1141
+ {
1142
+ "epoch": 42.44,
1143
+ "learning_rate": 1.2868421052631577e-05,
1144
+ "loss": 1.0534,
1145
+ "step": 14600
1146
+ },
1147
+ {
1148
+ "epoch": 42.73,
1149
+ "learning_rate": 1.2375e-05,
1150
+ "loss": 1.0514,
1151
+ "step": 14700
1152
+ },
1153
+ {
1154
+ "epoch": 43.02,
1155
+ "learning_rate": 1.188157894736842e-05,
1156
+ "loss": 1.065,
1157
+ "step": 14800
1158
+ },
1159
+ {
1160
+ "epoch": 43.31,
1161
+ "learning_rate": 1.1388157894736841e-05,
1162
+ "loss": 1.0382,
1163
+ "step": 14900
1164
+ },
1165
+ {
1166
+ "epoch": 43.6,
1167
+ "learning_rate": 1.0894736842105263e-05,
1168
+ "loss": 1.0464,
1169
+ "step": 15000
1170
+ },
1171
+ {
1172
+ "epoch": 43.6,
1173
+ "eval_loss": 0.3222814202308655,
1174
+ "eval_runtime": 140.9953,
1175
+ "eval_samples_per_second": 32.767,
1176
+ "eval_steps_per_second": 4.099,
1177
+ "eval_wer": 0.27963042281098943,
1178
+ "step": 15000
1179
+ },
1180
+ {
1181
+ "epoch": 43.89,
1182
+ "learning_rate": 1.0401315789473685e-05,
1183
+ "loss": 1.0578,
1184
+ "step": 15100
1185
+ },
1186
+ {
1187
+ "epoch": 44.19,
1188
+ "learning_rate": 9.907894736842103e-06,
1189
+ "loss": 1.034,
1190
+ "step": 15200
1191
+ },
1192
+ {
1193
+ "epoch": 44.48,
1194
+ "learning_rate": 9.414473684210525e-06,
1195
+ "loss": 1.0408,
1196
+ "step": 15300
1197
+ },
1198
+ {
1199
+ "epoch": 44.77,
1200
+ "learning_rate": 8.921052631578947e-06,
1201
+ "loss": 1.0396,
1202
+ "step": 15400
1203
+ },
1204
+ {
1205
+ "epoch": 45.06,
1206
+ "learning_rate": 8.427631578947367e-06,
1207
+ "loss": 1.0415,
1208
+ "step": 15500
1209
+ },
1210
+ {
1211
+ "epoch": 45.06,
1212
+ "eval_loss": 0.3165771961212158,
1213
+ "eval_runtime": 141.4647,
1214
+ "eval_samples_per_second": 32.658,
1215
+ "eval_steps_per_second": 4.086,
1216
+ "eval_wer": 0.2773970507250811,
1217
+ "step": 15500
1218
+ },
1219
+ {
1220
+ "epoch": 45.35,
1221
+ "learning_rate": 7.934210526315789e-06,
1222
+ "loss": 1.0306,
1223
+ "step": 15600
1224
+ },
1225
+ {
1226
+ "epoch": 45.64,
1227
+ "learning_rate": 7.44078947368421e-06,
1228
+ "loss": 1.0402,
1229
+ "step": 15700
1230
+ },
1231
+ {
1232
+ "epoch": 45.93,
1233
+ "learning_rate": 6.9473684210526315e-06,
1234
+ "loss": 1.0148,
1235
+ "step": 15800
1236
+ },
1237
+ {
1238
+ "epoch": 46.22,
1239
+ "learning_rate": 6.458881578947368e-06,
1240
+ "loss": 1.0276,
1241
+ "step": 15900
1242
+ },
1243
+ {
1244
+ "epoch": 46.51,
1245
+ "learning_rate": 5.965460526315788e-06,
1246
+ "loss": 1.0356,
1247
+ "step": 16000
1248
+ },
1249
+ {
1250
+ "epoch": 46.51,
1251
+ "eval_loss": 0.31774380803108215,
1252
+ "eval_runtime": 141.9517,
1253
+ "eval_samples_per_second": 32.546,
1254
+ "eval_steps_per_second": 4.072,
1255
+ "eval_wer": 0.27455179587591017,
1256
+ "step": 16000
1257
+ },
1258
+ {
1259
+ "epoch": 46.8,
1260
+ "learning_rate": 5.47203947368421e-06,
1261
+ "loss": 1.0331,
1262
+ "step": 16100
1263
+ },
1264
+ {
1265
+ "epoch": 47.09,
1266
+ "learning_rate": 4.978618421052631e-06,
1267
+ "loss": 1.0442,
1268
+ "step": 16200
1269
+ },
1270
+ {
1271
+ "epoch": 47.38,
1272
+ "learning_rate": 4.485197368421052e-06,
1273
+ "loss": 1.0157,
1274
+ "step": 16300
1275
+ },
1276
+ {
1277
+ "epoch": 47.67,
1278
+ "learning_rate": 3.991776315789474e-06,
1279
+ "loss": 1.0308,
1280
+ "step": 16400
1281
+ },
1282
+ {
1283
+ "epoch": 47.96,
1284
+ "learning_rate": 3.498355263157895e-06,
1285
+ "loss": 1.04,
1286
+ "step": 16500
1287
+ },
1288
+ {
1289
+ "epoch": 47.96,
1290
+ "eval_loss": 0.31499630212783813,
1291
+ "eval_runtime": 141.8201,
1292
+ "eval_samples_per_second": 32.576,
1293
+ "eval_steps_per_second": 4.076,
1294
+ "eval_wer": 0.27354218931652696,
1295
+ "step": 16500
1296
+ },
1297
+ {
1298
+ "epoch": 48.26,
1299
+ "learning_rate": 3.0049342105263154e-06,
1300
+ "loss": 1.0388,
1301
+ "step": 16600
1302
+ },
1303
+ {
1304
+ "epoch": 48.55,
1305
+ "learning_rate": 2.5115131578947363e-06,
1306
+ "loss": 1.0016,
1307
+ "step": 16700
1308
+ },
1309
+ {
1310
+ "epoch": 48.84,
1311
+ "learning_rate": 2.0180921052631577e-06,
1312
+ "loss": 1.0127,
1313
+ "step": 16800
1314
+ },
1315
+ {
1316
+ "epoch": 49.13,
1317
+ "learning_rate": 1.524671052631579e-06,
1318
+ "loss": 1.0343,
1319
+ "step": 16900
1320
+ },
1321
+ {
1322
+ "epoch": 49.42,
1323
+ "learning_rate": 1.0312499999999999e-06,
1324
+ "loss": 1.0209,
1325
+ "step": 17000
1326
+ },
1327
+ {
1328
+ "epoch": 49.42,
1329
+ "eval_loss": 0.3174569308757782,
1330
+ "eval_runtime": 141.608,
1331
+ "eval_samples_per_second": 32.625,
1332
+ "eval_steps_per_second": 4.082,
1333
+ "eval_wer": 0.2730526831059169,
1334
+ "step": 17000
1335
+ },
1336
+ {
1337
+ "epoch": 49.71,
1338
+ "learning_rate": 5.378289473684209e-07,
1339
+ "loss": 1.0189,
1340
+ "step": 17100
1341
+ },
1342
+ {
1343
+ "epoch": 50.0,
1344
+ "learning_rate": 4.44078947368421e-08,
1345
+ "loss": 1.0364,
1346
+ "step": 17200
1347
+ },
1348
+ {
1349
+ "epoch": 50.0,
1350
+ "step": 17200,
1351
+ "total_flos": 5.147257612039286e+19,
1352
+ "train_loss": 1.449138161858847,
1353
+ "train_runtime": 28230.9535,
1354
+ "train_samples_per_second": 19.535,
1355
+ "train_steps_per_second": 0.609
1356
+ }
1357
+ ],
1358
+ "max_steps": 17200,
1359
+ "num_train_epochs": 50,
1360
+ "total_flos": 5.147257612039286e+19,
1361
+ "trial_name": null,
1362
+ "trial_params": null
1363
+ }
wandb/run-20220109_220240-1g372i3v/files/config.yaml CHANGED
@@ -4802,6 +4802,26 @@ _wandb:
4802
  5: 1
4803
  6:
4804
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4805
  python_version: 3.8.12
4806
  start_time: 1641765761
4807
  t:
4802
  5: 1
4803
  6:
4804
  - 1
4805
+ - 1: train/train_runtime
4806
+ 5: 1
4807
+ 6:
4808
+ - 1
4809
+ - 1: train/train_samples_per_second
4810
+ 5: 1
4811
+ 6:
4812
+ - 1
4813
+ - 1: train/train_steps_per_second
4814
+ 5: 1
4815
+ 6:
4816
+ - 1
4817
+ - 1: train/total_flos
4818
+ 5: 1
4819
+ 6:
4820
+ - 1
4821
+ - 1: train/train_loss
4822
+ 5: 1
4823
+ 6:
4824
+ - 1
4825
  python_version: 3.8.12
4826
  start_time: 1641765761
4827
  t:
wandb/run-20220109_220240-1g372i3v/files/output.log CHANGED
The diff for this file is too large to render. See raw diff
wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
wandb/run-20220109_220240-1g372i3v/logs/debug-internal.log CHANGED
@@ -19671,3 +19671,298 @@
19671
  2022-01-10 05:48:50,928 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19672
  2022-01-10 05:48:50,928 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19673
  2022-01-10 05:48:53,858 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19671
  2022-01-10 05:48:50,928 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19672
  2022-01-10 05:48:50,928 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19673
  2022-01-10 05:48:53,858 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19674
+ 2022-01-10 05:49:06,006 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19675
+ 2022-01-10 05:49:06,006 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19676
+ 2022-01-10 05:49:06,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19677
+ 2022-01-10 05:49:08,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19678
+ 2022-01-10 05:49:10,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19679
+ 2022-01-10 05:49:12,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19680
+ 2022-01-10 05:49:14,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19681
+ 2022-01-10 05:49:16,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19682
+ 2022-01-10 05:49:18,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19683
+ 2022-01-10 05:49:20,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19684
+ 2022-01-10 05:49:21,075 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19685
+ 2022-01-10 05:49:21,075 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19686
+ 2022-01-10 05:49:22,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19687
+ 2022-01-10 05:49:24,118 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19688
+ 2022-01-10 05:49:24,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19689
+ 2022-01-10 05:49:26,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19690
+ 2022-01-10 05:49:28,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19691
+ 2022-01-10 05:49:30,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19692
+ 2022-01-10 05:49:32,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19693
+ 2022-01-10 05:49:34,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19694
+ 2022-01-10 05:49:36,190 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19695
+ 2022-01-10 05:49:36,190 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19696
+ 2022-01-10 05:49:36,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19697
+ 2022-01-10 05:49:38,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19698
+ 2022-01-10 05:49:40,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19699
+ 2022-01-10 05:49:42,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19700
+ 2022-01-10 05:49:44,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19701
+ 2022-01-10 05:49:46,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19702
+ 2022-01-10 05:49:48,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19703
+ 2022-01-10 05:49:50,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19704
+ 2022-01-10 05:49:51,290 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19705
+ 2022-01-10 05:49:51,290 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19706
+ 2022-01-10 05:49:52,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19707
+ 2022-01-10 05:49:54,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19708
+ 2022-01-10 05:49:54,370 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19709
+ 2022-01-10 05:49:56,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19710
+ 2022-01-10 05:49:58,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19711
+ 2022-01-10 05:50:00,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19712
+ 2022-01-10 05:50:02,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19713
+ 2022-01-10 05:50:04,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19714
+ 2022-01-10 05:50:06,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19715
+ 2022-01-10 05:50:06,410 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19716
+ 2022-01-10 05:50:06,410 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19717
+ 2022-01-10 05:50:08,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19718
+ 2022-01-10 05:50:10,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19719
+ 2022-01-10 05:50:12,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19720
+ 2022-01-10 05:50:14,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19721
+ 2022-01-10 05:50:16,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19722
+ 2022-01-10 05:50:18,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19723
+ 2022-01-10 05:50:20,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19724
+ 2022-01-10 05:50:21,526 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19725
+ 2022-01-10 05:50:21,526 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19726
+ 2022-01-10 05:50:22,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19727
+ 2022-01-10 05:50:24,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19728
+ 2022-01-10 05:50:24,605 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19729
+ 2022-01-10 05:50:26,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19730
+ 2022-01-10 05:50:28,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19731
+ 2022-01-10 05:50:30,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19732
+ 2022-01-10 05:50:32,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19733
+ 2022-01-10 05:50:34,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19734
+ 2022-01-10 05:50:36,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19735
+ 2022-01-10 05:50:36,607 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19736
+ 2022-01-10 05:50:36,607 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19737
+ 2022-01-10 05:50:38,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19738
+ 2022-01-10 05:50:40,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19739
+ 2022-01-10 05:50:42,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19740
+ 2022-01-10 05:50:44,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19741
+ 2022-01-10 05:50:46,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19742
+ 2022-01-10 05:50:48,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19743
+ 2022-01-10 05:50:50,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19744
+ 2022-01-10 05:50:51,693 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19745
+ 2022-01-10 05:50:51,693 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19746
+ 2022-01-10 05:50:52,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19747
+ 2022-01-10 05:50:54,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19748
+ 2022-01-10 05:50:54,846 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19749
+ 2022-01-10 05:50:56,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19750
+ 2022-01-10 05:50:58,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19751
+ 2022-01-10 05:51:00,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19752
+ 2022-01-10 05:51:02,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19753
+ 2022-01-10 05:51:04,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19754
+ 2022-01-10 05:51:06,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19755
+ 2022-01-10 05:51:06,777 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19756
+ 2022-01-10 05:51:06,777 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19757
+ 2022-01-10 05:51:08,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19758
+ 2022-01-10 05:51:08,977 DEBUG SenderThread:31514 [sender.py:send():182] send: history
19759
+ 2022-01-10 05:51:09,039 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
19760
+ 2022-01-10 05:51:09,067 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19761
+ 2022-01-10 05:51:09,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json
19762
+ 2022-01-10 05:51:11,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19763
+ 2022-01-10 05:51:13,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19764
+ 2022-01-10 05:51:15,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19765
+ 2022-01-10 05:51:17,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19766
+ 2022-01-10 05:51:19,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19767
+ 2022-01-10 05:51:21,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19768
+ 2022-01-10 05:51:21,883 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19769
+ 2022-01-10 05:51:21,884 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19770
+ 2022-01-10 05:51:23,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19771
+ 2022-01-10 05:51:25,090 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19772
+ 2022-01-10 05:51:25,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19773
+ 2022-01-10 05:51:27,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19774
+ 2022-01-10 05:51:29,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19775
+ 2022-01-10 05:51:31,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19776
+ 2022-01-10 05:51:33,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19777
+ 2022-01-10 05:51:35,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19778
+ 2022-01-10 05:51:36,963 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19779
+ 2022-01-10 05:51:36,963 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19780
+ 2022-01-10 05:51:37,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19781
+ 2022-01-10 05:51:39,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19782
+ 2022-01-10 05:51:41,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19783
+ 2022-01-10 05:51:43,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19784
+ 2022-01-10 05:51:45,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19785
+ 2022-01-10 05:51:47,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19786
+ 2022-01-10 05:51:49,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19787
+ 2022-01-10 05:51:51,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19788
+ 2022-01-10 05:51:52,064 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19789
+ 2022-01-10 05:51:52,064 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19790
+ 2022-01-10 05:51:53,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19791
+ 2022-01-10 05:51:55,329 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19792
+ 2022-01-10 05:51:55,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19793
+ 2022-01-10 05:51:57,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19794
+ 2022-01-10 05:51:59,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19795
+ 2022-01-10 05:52:01,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19796
+ 2022-01-10 05:52:03,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19797
+ 2022-01-10 05:52:05,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19798
+ 2022-01-10 05:52:07,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19799
+ 2022-01-10 05:52:07,175 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19800
+ 2022-01-10 05:52:07,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19801
+ 2022-01-10 05:52:09,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19802
+ 2022-01-10 05:52:11,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19803
+ 2022-01-10 05:52:13,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19804
+ 2022-01-10 05:52:15,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19805
+ 2022-01-10 05:52:17,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19806
+ 2022-01-10 05:52:21,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19807
+ 2022-01-10 05:52:22,264 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19808
+ 2022-01-10 05:52:22,264 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19809
+ 2022-01-10 05:52:23,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19810
+ 2022-01-10 05:52:25,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19811
+ 2022-01-10 05:52:25,571 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19812
+ 2022-01-10 05:52:27,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19813
+ 2022-01-10 05:52:29,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19814
+ 2022-01-10 05:52:31,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19815
+ 2022-01-10 05:52:33,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19816
+ 2022-01-10 05:52:35,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19817
+ 2022-01-10 05:52:37,361 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19818
+ 2022-01-10 05:52:37,361 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19819
+ 2022-01-10 05:52:37,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19820
+ 2022-01-10 05:52:39,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19821
+ 2022-01-10 05:52:41,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19822
+ 2022-01-10 05:52:43,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19823
+ 2022-01-10 05:52:45,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19824
+ 2022-01-10 05:52:47,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19825
+ 2022-01-10 05:52:49,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19826
+ 2022-01-10 05:52:51,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19827
+ 2022-01-10 05:52:52,478 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19828
+ 2022-01-10 05:52:52,478 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19829
+ 2022-01-10 05:52:53,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19830
+ 2022-01-10 05:52:55,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19831
+ 2022-01-10 05:52:55,805 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19832
+ 2022-01-10 05:52:57,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19833
+ 2022-01-10 05:52:59,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19834
+ 2022-01-10 05:53:01,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19835
+ 2022-01-10 05:53:03,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19836
+ 2022-01-10 05:53:05,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19837
+ 2022-01-10 05:53:07,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19838
+ 2022-01-10 05:53:07,547 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19839
+ 2022-01-10 05:53:07,547 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19840
+ 2022-01-10 05:53:09,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19841
+ 2022-01-10 05:53:11,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19842
+ 2022-01-10 05:53:11,853 DEBUG SenderThread:31514 [sender.py:send():182] send: history
19843
+ 2022-01-10 05:53:11,897 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
19844
+ 2022-01-10 05:53:11,936 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19845
+ 2022-01-10 05:53:11,936 DEBUG SenderThread:31514 [sender.py:send():182] send: metric
19846
+ 2022-01-10 05:53:11,936 DEBUG SenderThread:31514 [sender.py:send():182] send: metric
19847
+ 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: metric
19848
+ 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: metric
19849
+ 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: metric
19850
+ 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: history
19851
+ 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
19852
+ 2022-01-10 05:53:11,961 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19853
+ 2022-01-10 05:53:12,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json
19854
+ 2022-01-10 05:53:13,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19855
+ 2022-01-10 05:53:14,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19856
+ 2022-01-10 05:53:15,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19857
+ 2022-01-10 05:53:18,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/config.yaml
19858
+ 2022-01-10 05:53:22,653 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19859
+ 2022-01-10 05:53:22,653 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19860
+ 2022-01-10 05:53:26,204 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19861
+ 2022-01-10 05:53:37,825 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19862
+ 2022-01-10 05:53:37,825 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19863
+ 2022-01-10 05:53:39,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19864
+ 2022-01-10 05:53:42,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19865
+ 2022-01-10 05:53:44,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19866
+ 2022-01-10 05:53:46,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19867
+ 2022-01-10 05:53:48,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19868
+ 2022-01-10 05:53:50,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19869
+ 2022-01-10 05:53:52,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19870
+ 2022-01-10 05:53:52,960 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19871
+ 2022-01-10 05:53:52,961 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19872
+ 2022-01-10 05:53:54,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19873
+ 2022-01-10 05:53:56,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19874
+ 2022-01-10 05:53:56,488 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19875
+ 2022-01-10 05:53:58,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19876
+ 2022-01-10 05:54:00,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19877
+ 2022-01-10 05:54:02,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19878
+ 2022-01-10 05:54:04,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19879
+ 2022-01-10 05:54:06,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19880
+ 2022-01-10 05:54:08,060 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19881
+ 2022-01-10 05:54:08,060 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19882
+ 2022-01-10 05:54:08,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19883
+ 2022-01-10 05:54:10,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19884
+ 2022-01-10 05:54:12,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19885
+ 2022-01-10 05:54:14,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19886
+ 2022-01-10 05:54:16,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19887
+ 2022-01-10 05:54:18,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19888
+ 2022-01-10 05:54:20,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19889
+ 2022-01-10 05:54:22,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19890
+ 2022-01-10 05:54:23,173 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19891
+ 2022-01-10 05:54:23,173 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19892
+ 2022-01-10 05:54:24,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19893
+ 2022-01-10 05:54:26,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19894
+ 2022-01-10 05:54:26,730 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19895
+ 2022-01-10 05:54:28,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19896
+ 2022-01-10 05:54:30,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19897
+ 2022-01-10 05:54:32,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19898
+ 2022-01-10 05:54:34,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19899
+ 2022-01-10 05:54:36,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19900
+ 2022-01-10 05:54:38,247 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19901
+ 2022-01-10 05:54:38,247 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19902
+ 2022-01-10 05:54:38,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19903
+ 2022-01-10 05:54:40,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19904
+ 2022-01-10 05:54:42,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19905
+ 2022-01-10 05:54:44,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19906
+ 2022-01-10 05:54:46,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19907
+ 2022-01-10 05:54:48,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19908
+ 2022-01-10 05:54:50,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19909
+ 2022-01-10 05:54:52,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19910
+ 2022-01-10 05:54:53,363 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19911
+ 2022-01-10 05:54:53,363 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19912
+ 2022-01-10 05:54:54,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19913
+ 2022-01-10 05:54:56,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19914
+ 2022-01-10 05:54:56,973 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19915
+ 2022-01-10 05:54:59,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19916
+ 2022-01-10 05:55:01,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19917
+ 2022-01-10 05:55:03,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19918
+ 2022-01-10 05:55:05,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19919
+ 2022-01-10 05:55:07,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19920
+ 2022-01-10 05:55:08,450 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19921
+ 2022-01-10 05:55:08,450 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19922
+ 2022-01-10 05:55:09,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19923
+ 2022-01-10 05:55:11,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19924
+ 2022-01-10 05:55:13,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19925
+ 2022-01-10 05:55:15,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19926
+ 2022-01-10 05:55:17,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19927
+ 2022-01-10 05:55:19,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19928
+ 2022-01-10 05:55:21,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19929
+ 2022-01-10 05:55:23,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19930
+ 2022-01-10 05:55:23,582 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19931
+ 2022-01-10 05:55:23,582 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19932
+ 2022-01-10 05:55:25,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19933
+ 2022-01-10 05:55:27,213 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19934
+ 2022-01-10 05:55:27,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19935
+ 2022-01-10 05:55:29,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19936
+ 2022-01-10 05:55:31,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19937
+ 2022-01-10 05:55:33,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19938
+ 2022-01-10 05:55:35,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19939
+ 2022-01-10 05:55:37,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19940
+ 2022-01-10 05:55:38,654 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19941
+ 2022-01-10 05:55:38,655 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19942
+ 2022-01-10 05:55:39,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19943
+ 2022-01-10 05:55:41,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19944
+ 2022-01-10 05:55:43,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19945
+ 2022-01-10 05:55:45,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19946
+ 2022-01-10 05:55:47,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19947
+ 2022-01-10 05:55:49,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19948
+ 2022-01-10 05:55:51,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19949
+ 2022-01-10 05:55:53,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19950
+ 2022-01-10 05:55:53,729 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19951
+ 2022-01-10 05:55:53,729 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19952
+ 2022-01-10 05:55:55,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19953
+ 2022-01-10 05:55:57,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19954
+ 2022-01-10 05:55:57,452 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
19955
+ 2022-01-10 05:55:59,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19956
+ 2022-01-10 05:56:01,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19957
+ 2022-01-10 05:56:02,278 DEBUG SenderThread:31514 [sender.py:send():182] send: history
19958
+ 2022-01-10 05:56:02,298 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
19959
+ 2022-01-10 05:56:02,331 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19960
+ 2022-01-10 05:56:02,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json
19961
+ 2022-01-10 05:56:03,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19962
+ 2022-01-10 05:56:04,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19963
+ 2022-01-10 05:56:07,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
19964
+ 2022-01-10 05:56:08,871 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19965
+ 2022-01-10 05:56:08,872 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19966
+ 2022-01-10 05:56:23,945 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
19967
+ 2022-01-10 05:56:23,945 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
19968
+ 2022-01-10 05:56:27,729 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
wandb/run-20220109_220240-1g372i3v/run-1g372i3v.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:43df2ed4cd2f4241d0158b1a32a87d11cf402996599dfcb5a5a878534f0dbe8b
3
- size 117277324
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:284fe5281435c417c6ccdefb911ef82cdb3e85c223db5ec659310ed90ec813cf
3
+ size 118759435