versae commited on
Commit
7919922
1 Parent(s): 72b21ed

End of training

Browse files
all_results.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 15.0,
3
+ "eval_loss": NaN,
4
+ "eval_runtime": 370.8146,
5
+ "eval_samples": 5437,
6
+ "eval_samples_per_second": 14.662,
7
+ "eval_steps_per_second": 0.917,
8
+ "eval_wer": 1.0,
9
+ "train_loss": 0.5419238063665506,
10
+ "train_runtime": 74160.538,
11
+ "train_samples": 49645,
12
+ "train_samples_per_second": 10.041,
13
+ "train_steps_per_second": 0.314
14
+ }
eval_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 15.0,
3
+ "eval_loss": NaN,
4
+ "eval_runtime": 370.8146,
5
+ "eval_samples": 5437,
6
+ "eval_samples_per_second": 14.662,
7
+ "eval_steps_per_second": 0.917,
8
+ "eval_wer": 1.0
9
+ }
runs/Feb01_21-30-10_dante/events.out.tfevents.1643822063.dante.3356217.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbd801a50cbf465611b731568618e12c6182ea6f13c58b2ec0a91f9952c94ad5
3
+ size 364
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 15.0,
3
+ "train_loss": 0.5419238063665506,
4
+ "train_runtime": 74160.538,
5
+ "train_samples": 49645,
6
+ "train_samples_per_second": 10.041,
7
+ "train_steps_per_second": 0.314
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,1831 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 14.999677731227845,
5
+ "global_step": 23265,
6
+ "is_hyper_param_search": false,
7
+ "is_local_process_zero": true,
8
+ "is_world_process_zero": true,
9
+ "log_history": [
10
+ {
11
+ "epoch": 0.06,
12
+ "learning_rate": 4.950000000000001e-06,
13
+ "loss": 9.3801,
14
+ "step": 100
15
+ },
16
+ {
17
+ "epoch": 0.13,
18
+ "learning_rate": 9.85e-06,
19
+ "loss": 8.1479,
20
+ "step": 200
21
+ },
22
+ {
23
+ "epoch": 0.19,
24
+ "learning_rate": 1.485e-05,
25
+ "loss": 4.0405,
26
+ "step": 300
27
+ },
28
+ {
29
+ "epoch": 0.26,
30
+ "learning_rate": 1.985e-05,
31
+ "loss": 3.1569,
32
+ "step": 400
33
+ },
34
+ {
35
+ "epoch": 0.32,
36
+ "learning_rate": 2.485e-05,
37
+ "loss": 2.9728,
38
+ "step": 500
39
+ },
40
+ {
41
+ "epoch": 0.32,
42
+ "eval_loss": 2.9448530673980713,
43
+ "eval_runtime": 378.7996,
44
+ "eval_samples_per_second": 14.353,
45
+ "eval_steps_per_second": 0.898,
46
+ "eval_wer": 1.0,
47
+ "step": 500
48
+ },
49
+ {
50
+ "epoch": 0.39,
51
+ "learning_rate": 2.985e-05,
52
+ "loss": 2.9272,
53
+ "step": 600
54
+ },
55
+ {
56
+ "epoch": 0.45,
57
+ "learning_rate": 3.485e-05,
58
+ "loss": 2.9,
59
+ "step": 700
60
+ },
61
+ {
62
+ "epoch": 0.52,
63
+ "learning_rate": 3.9850000000000006e-05,
64
+ "loss": 2.888,
65
+ "step": 800
66
+ },
67
+ {
68
+ "epoch": 0.58,
69
+ "learning_rate": 4.4850000000000006e-05,
70
+ "loss": 2.8488,
71
+ "step": 900
72
+ },
73
+ {
74
+ "epoch": 0.64,
75
+ "learning_rate": 4.9850000000000006e-05,
76
+ "loss": 2.5099,
77
+ "step": 1000
78
+ },
79
+ {
80
+ "epoch": 0.64,
81
+ "eval_loss": 1.8491624593734741,
82
+ "eval_runtime": 377.919,
83
+ "eval_samples_per_second": 14.387,
84
+ "eval_steps_per_second": 0.9,
85
+ "eval_wer": 0.9910086579662114,
86
+ "step": 1000
87
+ },
88
+ {
89
+ "epoch": 0.71,
90
+ "learning_rate": 5.485e-05,
91
+ "loss": 1.6261,
92
+ "step": 1100
93
+ },
94
+ {
95
+ "epoch": 0.77,
96
+ "learning_rate": 5.9850000000000005e-05,
97
+ "loss": 1.1446,
98
+ "step": 1200
99
+ },
100
+ {
101
+ "epoch": 0.84,
102
+ "learning_rate": 6.485e-05,
103
+ "loss": 0.9612,
104
+ "step": 1300
105
+ },
106
+ {
107
+ "epoch": 0.9,
108
+ "learning_rate": 6.98e-05,
109
+ "loss": 0.8481,
110
+ "step": 1400
111
+ },
112
+ {
113
+ "epoch": 0.97,
114
+ "learning_rate": 7.48e-05,
115
+ "loss": 0.7872,
116
+ "step": 1500
117
+ },
118
+ {
119
+ "epoch": 0.97,
120
+ "eval_loss": 0.44667136669158936,
121
+ "eval_runtime": 377.5063,
122
+ "eval_samples_per_second": 14.402,
123
+ "eval_steps_per_second": 0.901,
124
+ "eval_wer": 0.37744026199417574,
125
+ "step": 1500
126
+ },
127
+ {
128
+ "epoch": 1.03,
129
+ "learning_rate": 7.98e-05,
130
+ "loss": 0.7204,
131
+ "step": 1600
132
+ },
133
+ {
134
+ "epoch": 1.1,
135
+ "learning_rate": 8.48e-05,
136
+ "loss": 0.698,
137
+ "step": 1700
138
+ },
139
+ {
140
+ "epoch": 1.16,
141
+ "learning_rate": 8.98e-05,
142
+ "loss": 0.6488,
143
+ "step": 1800
144
+ },
145
+ {
146
+ "epoch": 1.22,
147
+ "learning_rate": 9.475e-05,
148
+ "loss": 0.6333,
149
+ "step": 1900
150
+ },
151
+ {
152
+ "epoch": 1.29,
153
+ "learning_rate": 9.975000000000001e-05,
154
+ "loss": 0.5993,
155
+ "step": 2000
156
+ },
157
+ {
158
+ "epoch": 1.29,
159
+ "eval_loss": 0.31809717416763306,
160
+ "eval_runtime": 384.016,
161
+ "eval_samples_per_second": 14.158,
162
+ "eval_steps_per_second": 0.885,
163
+ "eval_wer": 0.2819476992165668,
164
+ "step": 2000
165
+ },
166
+ {
167
+ "epoch": 1.35,
168
+ "learning_rate": 9.955325652480602e-05,
169
+ "loss": 0.5798,
170
+ "step": 2100
171
+ },
172
+ {
173
+ "epoch": 1.42,
174
+ "learning_rate": 9.908300023512816e-05,
175
+ "loss": 0.5414,
176
+ "step": 2200
177
+ },
178
+ {
179
+ "epoch": 1.48,
180
+ "learning_rate": 9.861274394545027e-05,
181
+ "loss": 0.5285,
182
+ "step": 2300
183
+ },
184
+ {
185
+ "epoch": 1.55,
186
+ "learning_rate": 9.81424876557724e-05,
187
+ "loss": 0.6176,
188
+ "step": 2400
189
+ },
190
+ {
191
+ "epoch": 1.61,
192
+ "learning_rate": 9.767223136609452e-05,
193
+ "loss": 0.5134,
194
+ "step": 2500
195
+ },
196
+ {
197
+ "epoch": 1.61,
198
+ "eval_loss": 0.2638131380081177,
199
+ "eval_runtime": 377.43,
200
+ "eval_samples_per_second": 14.405,
201
+ "eval_steps_per_second": 0.901,
202
+ "eval_wer": 0.24006000764803356,
203
+ "step": 2500
204
+ },
205
+ {
206
+ "epoch": 1.68,
207
+ "learning_rate": 9.720197507641666e-05,
208
+ "loss": 0.4847,
209
+ "step": 2600
210
+ },
211
+ {
212
+ "epoch": 1.74,
213
+ "learning_rate": 9.673171878673878e-05,
214
+ "loss": 0.4825,
215
+ "step": 2700
216
+ },
217
+ {
218
+ "epoch": 1.81,
219
+ "learning_rate": 9.62614624970609e-05,
220
+ "loss": 0.476,
221
+ "step": 2800
222
+ },
223
+ {
224
+ "epoch": 1.87,
225
+ "learning_rate": 9.579120620738303e-05,
226
+ "loss": 0.4645,
227
+ "step": 2900
228
+ },
229
+ {
230
+ "epoch": 1.93,
231
+ "learning_rate": 9.532094991770515e-05,
232
+ "loss": 0.4544,
233
+ "step": 3000
234
+ },
235
+ {
236
+ "epoch": 1.93,
237
+ "eval_loss": 0.22873832285404205,
238
+ "eval_runtime": 377.8259,
239
+ "eval_samples_per_second": 14.39,
240
+ "eval_steps_per_second": 0.9,
241
+ "eval_wer": 0.2091246923627521,
242
+ "step": 3000
243
+ },
244
+ {
245
+ "epoch": 2.0,
246
+ "learning_rate": 9.485069362802728e-05,
247
+ "loss": 0.453,
248
+ "step": 3100
249
+ },
250
+ {
251
+ "epoch": 2.06,
252
+ "learning_rate": 9.43804373383494e-05,
253
+ "loss": 0.4392,
254
+ "step": 3200
255
+ },
256
+ {
257
+ "epoch": 2.13,
258
+ "learning_rate": 9.391018104867153e-05,
259
+ "loss": 0.4275,
260
+ "step": 3300
261
+ },
262
+ {
263
+ "epoch": 2.19,
264
+ "learning_rate": 9.343992475899366e-05,
265
+ "loss": 0.4119,
266
+ "step": 3400
267
+ },
268
+ {
269
+ "epoch": 2.26,
270
+ "learning_rate": 9.296966846931579e-05,
271
+ "loss": 0.4085,
272
+ "step": 3500
273
+ },
274
+ {
275
+ "epoch": 2.26,
276
+ "eval_loss": 0.21533556282520294,
277
+ "eval_runtime": 377.0477,
278
+ "eval_samples_per_second": 14.42,
279
+ "eval_steps_per_second": 0.902,
280
+ "eval_wer": 0.1917891495974977,
281
+ "step": 3500
282
+ },
283
+ {
284
+ "epoch": 2.32,
285
+ "learning_rate": 9.249941217963791e-05,
286
+ "loss": 0.3964,
287
+ "step": 3600
288
+ },
289
+ {
290
+ "epoch": 2.39,
291
+ "learning_rate": 9.202915588996003e-05,
292
+ "loss": 0.3885,
293
+ "step": 3700
294
+ },
295
+ {
296
+ "epoch": 2.45,
297
+ "learning_rate": 9.155889960028216e-05,
298
+ "loss": 0.3915,
299
+ "step": 3800
300
+ },
301
+ {
302
+ "epoch": 2.51,
303
+ "learning_rate": 9.108864331060428e-05,
304
+ "loss": 0.4073,
305
+ "step": 3900
306
+ },
307
+ {
308
+ "epoch": 2.58,
309
+ "learning_rate": 9.061838702092641e-05,
310
+ "loss": 0.3921,
311
+ "step": 4000
312
+ },
313
+ {
314
+ "epoch": 2.58,
315
+ "eval_loss": 0.20039014518260956,
316
+ "eval_runtime": 376.6397,
317
+ "eval_samples_per_second": 14.436,
318
+ "eval_steps_per_second": 0.903,
319
+ "eval_wer": 0.18042495612185866,
320
+ "step": 4000
321
+ },
322
+ {
323
+ "epoch": 2.64,
324
+ "learning_rate": 9.015283329414532e-05,
325
+ "loss": 0.3795,
326
+ "step": 4100
327
+ },
328
+ {
329
+ "epoch": 2.71,
330
+ "learning_rate": 8.968257700446744e-05,
331
+ "loss": 0.3866,
332
+ "step": 4200
333
+ },
334
+ {
335
+ "epoch": 2.77,
336
+ "learning_rate": 8.921232071478956e-05,
337
+ "loss": 0.3692,
338
+ "step": 4300
339
+ },
340
+ {
341
+ "epoch": 2.84,
342
+ "learning_rate": 8.874206442511169e-05,
343
+ "loss": 0.373,
344
+ "step": 4400
345
+ },
346
+ {
347
+ "epoch": 2.9,
348
+ "learning_rate": 8.827180813543383e-05,
349
+ "loss": 0.4613,
350
+ "step": 4500
351
+ },
352
+ {
353
+ "epoch": 2.9,
354
+ "eval_loss": 0.19046556949615479,
355
+ "eval_runtime": 376.5699,
356
+ "eval_samples_per_second": 14.438,
357
+ "eval_steps_per_second": 0.903,
358
+ "eval_wer": 0.17323776559757617,
359
+ "step": 4500
360
+ },
361
+ {
362
+ "epoch": 2.97,
363
+ "learning_rate": 8.780155184575594e-05,
364
+ "loss": 0.3563,
365
+ "step": 4600
366
+ },
367
+ {
368
+ "epoch": 3.03,
369
+ "learning_rate": 8.733129555607806e-05,
370
+ "loss": 0.3491,
371
+ "step": 4700
372
+ },
373
+ {
374
+ "epoch": 3.09,
375
+ "learning_rate": 8.686103926640018e-05,
376
+ "loss": 0.3391,
377
+ "step": 4800
378
+ },
379
+ {
380
+ "epoch": 3.16,
381
+ "learning_rate": 8.639078297672232e-05,
382
+ "loss": 0.3459,
383
+ "step": 4900
384
+ },
385
+ {
386
+ "epoch": 3.22,
387
+ "learning_rate": 8.592052668704445e-05,
388
+ "loss": 0.3402,
389
+ "step": 5000
390
+ },
391
+ {
392
+ "epoch": 3.22,
393
+ "eval_loss": 0.17775115370750427,
394
+ "eval_runtime": 374.7655,
395
+ "eval_samples_per_second": 14.508,
396
+ "eval_steps_per_second": 0.907,
397
+ "eval_wer": 0.1658936923333366,
398
+ "step": 5000
399
+ },
400
+ {
401
+ "epoch": 3.29,
402
+ "learning_rate": 8.545027039736657e-05,
403
+ "loss": 0.3317,
404
+ "step": 5100
405
+ },
406
+ {
407
+ "epoch": 3.35,
408
+ "learning_rate": 8.49800141076887e-05,
409
+ "loss": 0.3284,
410
+ "step": 5200
411
+ },
412
+ {
413
+ "epoch": 3.42,
414
+ "learning_rate": 8.450975781801082e-05,
415
+ "loss": 0.3231,
416
+ "step": 5300
417
+ },
418
+ {
419
+ "epoch": 3.48,
420
+ "learning_rate": 8.403950152833294e-05,
421
+ "loss": 0.3284,
422
+ "step": 5400
423
+ },
424
+ {
425
+ "epoch": 3.55,
426
+ "learning_rate": 8.356924523865507e-05,
427
+ "loss": 0.3258,
428
+ "step": 5500
429
+ },
430
+ {
431
+ "epoch": 3.55,
432
+ "eval_loss": 0.17322729527950287,
433
+ "eval_runtime": 379.1854,
434
+ "eval_samples_per_second": 14.339,
435
+ "eval_steps_per_second": 0.897,
436
+ "eval_wer": 0.15707884338199968,
437
+ "step": 5500
438
+ },
439
+ {
440
+ "epoch": 3.61,
441
+ "learning_rate": 8.309898894897719e-05,
442
+ "loss": 0.3334,
443
+ "step": 5600
444
+ },
445
+ {
446
+ "epoch": 3.67,
447
+ "learning_rate": 8.262873265929933e-05,
448
+ "loss": 0.3186,
449
+ "step": 5700
450
+ },
451
+ {
452
+ "epoch": 3.74,
453
+ "learning_rate": 8.215847636962145e-05,
454
+ "loss": 0.3145,
455
+ "step": 5800
456
+ },
457
+ {
458
+ "epoch": 3.8,
459
+ "learning_rate": 8.168822007994358e-05,
460
+ "loss": 0.3208,
461
+ "step": 5900
462
+ },
463
+ {
464
+ "epoch": 3.87,
465
+ "learning_rate": 8.122266635316248e-05,
466
+ "loss": 0.3044,
467
+ "step": 6000
468
+ },
469
+ {
470
+ "epoch": 3.87,
471
+ "eval_loss": 0.16769851744174957,
472
+ "eval_runtime": 377.3431,
473
+ "eval_samples_per_second": 14.409,
474
+ "eval_steps_per_second": 0.901,
475
+ "eval_wer": 0.1497249649465128,
476
+ "step": 6000
477
+ },
478
+ {
479
+ "epoch": 3.93,
480
+ "learning_rate": 8.075241006348461e-05,
481
+ "loss": 0.3189,
482
+ "step": 6100
483
+ },
484
+ {
485
+ "epoch": 4.0,
486
+ "learning_rate": 8.028215377380672e-05,
487
+ "loss": 0.4003,
488
+ "step": 6200
489
+ },
490
+ {
491
+ "epoch": 4.06,
492
+ "learning_rate": 7.981189748412886e-05,
493
+ "loss": 0.3851,
494
+ "step": 6300
495
+ },
496
+ {
497
+ "epoch": 4.13,
498
+ "learning_rate": 7.934164119445098e-05,
499
+ "loss": 0.297,
500
+ "step": 6400
501
+ },
502
+ {
503
+ "epoch": 4.19,
504
+ "learning_rate": 7.88713849047731e-05,
505
+ "loss": 0.2914,
506
+ "step": 6500
507
+ },
508
+ {
509
+ "epoch": 4.19,
510
+ "eval_loss": 0.15965130925178528,
511
+ "eval_runtime": 376.7695,
512
+ "eval_samples_per_second": 14.431,
513
+ "eval_steps_per_second": 0.902,
514
+ "eval_wer": 0.1420475158598645,
515
+ "step": 6500
516
+ },
517
+ {
518
+ "epoch": 4.26,
519
+ "learning_rate": 7.840112861509523e-05,
520
+ "loss": 0.2895,
521
+ "step": 6600
522
+ },
523
+ {
524
+ "epoch": 4.32,
525
+ "learning_rate": 7.793557488831414e-05,
526
+ "loss": 0.2979,
527
+ "step": 6700
528
+ },
529
+ {
530
+ "epoch": 4.38,
531
+ "learning_rate": 7.746531859863626e-05,
532
+ "loss": 0.2951,
533
+ "step": 6800
534
+ },
535
+ {
536
+ "epoch": 4.45,
537
+ "learning_rate": 7.699506230895838e-05,
538
+ "loss": 0.294,
539
+ "step": 6900
540
+ },
541
+ {
542
+ "epoch": 4.51,
543
+ "learning_rate": 7.652480601928051e-05,
544
+ "loss": 0.278,
545
+ "step": 7000
546
+ },
547
+ {
548
+ "epoch": 4.51,
549
+ "eval_loss": 0.15744146704673767,
550
+ "eval_runtime": 378.117,
551
+ "eval_samples_per_second": 14.379,
552
+ "eval_steps_per_second": 0.899,
553
+ "eval_wer": 0.13855687489582005,
554
+ "step": 7000
555
+ },
556
+ {
557
+ "epoch": 4.58,
558
+ "learning_rate": 7.605454972960265e-05,
559
+ "loss": 0.2823,
560
+ "step": 7100
561
+ },
562
+ {
563
+ "epoch": 4.64,
564
+ "learning_rate": 7.558429343992476e-05,
565
+ "loss": 0.2865,
566
+ "step": 7200
567
+ },
568
+ {
569
+ "epoch": 4.71,
570
+ "learning_rate": 7.511403715024688e-05,
571
+ "loss": 0.2698,
572
+ "step": 7300
573
+ },
574
+ {
575
+ "epoch": 4.77,
576
+ "learning_rate": 7.464378086056902e-05,
577
+ "loss": 0.2951,
578
+ "step": 7400
579
+ },
580
+ {
581
+ "epoch": 4.84,
582
+ "learning_rate": 7.417352457089114e-05,
583
+ "loss": 0.2858,
584
+ "step": 7500
585
+ },
586
+ {
587
+ "epoch": 4.84,
588
+ "eval_loss": 0.15517516434192657,
589
+ "eval_runtime": 376.387,
590
+ "eval_samples_per_second": 14.445,
591
+ "eval_steps_per_second": 0.903,
592
+ "eval_wer": 0.12995773971192406,
593
+ "step": 7500
594
+ },
595
+ {
596
+ "epoch": 4.9,
597
+ "learning_rate": 7.370326828121327e-05,
598
+ "loss": 0.2851,
599
+ "step": 7600
600
+ },
601
+ {
602
+ "epoch": 4.96,
603
+ "learning_rate": 7.323301199153539e-05,
604
+ "loss": 0.2814,
605
+ "step": 7700
606
+ },
607
+ {
608
+ "epoch": 5.03,
609
+ "learning_rate": 7.276275570185751e-05,
610
+ "loss": 0.2662,
611
+ "step": 7800
612
+ },
613
+ {
614
+ "epoch": 5.09,
615
+ "learning_rate": 7.229249941217964e-05,
616
+ "loss": 0.2806,
617
+ "step": 7900
618
+ },
619
+ {
620
+ "epoch": 5.16,
621
+ "learning_rate": 7.182224312250176e-05,
622
+ "loss": 0.2585,
623
+ "step": 8000
624
+ },
625
+ {
626
+ "epoch": 5.16,
627
+ "eval_loss": 0.15228664875030518,
628
+ "eval_runtime": 380.3124,
629
+ "eval_samples_per_second": 14.296,
630
+ "eval_steps_per_second": 0.894,
631
+ "eval_wer": 0.12756527792757902,
632
+ "step": 8000
633
+ },
634
+ {
635
+ "epoch": 5.22,
636
+ "learning_rate": 7.135198683282389e-05,
637
+ "loss": 0.2699,
638
+ "step": 8100
639
+ },
640
+ {
641
+ "epoch": 5.29,
642
+ "learning_rate": 7.088173054314602e-05,
643
+ "loss": 0.2688,
644
+ "step": 8200
645
+ },
646
+ {
647
+ "epoch": 5.35,
648
+ "learning_rate": 7.041147425346815e-05,
649
+ "loss": 0.2686,
650
+ "step": 8300
651
+ },
652
+ {
653
+ "epoch": 5.42,
654
+ "learning_rate": 6.994121796379027e-05,
655
+ "loss": 0.2592,
656
+ "step": 8400
657
+ },
658
+ {
659
+ "epoch": 5.48,
660
+ "learning_rate": 6.947096167411238e-05,
661
+ "loss": 0.2827,
662
+ "step": 8500
663
+ },
664
+ {
665
+ "epoch": 5.48,
666
+ "eval_loss": 0.14475098252296448,
667
+ "eval_runtime": 374.5535,
668
+ "eval_samples_per_second": 14.516,
669
+ "eval_steps_per_second": 0.908,
670
+ "eval_wer": 0.12654554011785815,
671
+ "step": 8500
672
+ },
673
+ {
674
+ "epoch": 5.54,
675
+ "learning_rate": 6.900070538443452e-05,
676
+ "loss": 0.2587,
677
+ "step": 8600
678
+ },
679
+ {
680
+ "epoch": 5.61,
681
+ "learning_rate": 6.853044909475665e-05,
682
+ "loss": 0.2552,
683
+ "step": 8700
684
+ },
685
+ {
686
+ "epoch": 5.67,
687
+ "learning_rate": 6.806019280507877e-05,
688
+ "loss": 0.2679,
689
+ "step": 8800
690
+ },
691
+ {
692
+ "epoch": 5.74,
693
+ "learning_rate": 6.75899365154009e-05,
694
+ "loss": 0.2651,
695
+ "step": 8900
696
+ },
697
+ {
698
+ "epoch": 5.8,
699
+ "learning_rate": 6.711968022572303e-05,
700
+ "loss": 0.3365,
701
+ "step": 9000
702
+ },
703
+ {
704
+ "epoch": 5.8,
705
+ "eval_loss": 0.14109323918819427,
706
+ "eval_runtime": 377.5361,
707
+ "eval_samples_per_second": 14.401,
708
+ "eval_steps_per_second": 0.901,
709
+ "eval_wer": 0.1232313922362654,
710
+ "step": 9000
711
+ },
712
+ {
713
+ "epoch": 5.87,
714
+ "learning_rate": 6.664942393604515e-05,
715
+ "loss": 0.2593,
716
+ "step": 9100
717
+ },
718
+ {
719
+ "epoch": 5.93,
720
+ "learning_rate": 6.617916764636727e-05,
721
+ "loss": 0.2495,
722
+ "step": 9200
723
+ },
724
+ {
725
+ "epoch": 6.0,
726
+ "learning_rate": 6.571361391958619e-05,
727
+ "loss": 0.2436,
728
+ "step": 9300
729
+ },
730
+ {
731
+ "epoch": 6.06,
732
+ "learning_rate": 6.524335762990831e-05,
733
+ "loss": 0.3209,
734
+ "step": 9400
735
+ },
736
+ {
737
+ "epoch": 6.13,
738
+ "learning_rate": 6.477310134023042e-05,
739
+ "loss": 0.2488,
740
+ "step": 9500
741
+ },
742
+ {
743
+ "epoch": 6.13,
744
+ "eval_loss": 0.1456409990787506,
745
+ "eval_runtime": 378.3904,
746
+ "eval_samples_per_second": 14.369,
747
+ "eval_steps_per_second": 0.899,
748
+ "eval_wer": 0.11950542716228539,
749
+ "step": 9500
750
+ },
751
+ {
752
+ "epoch": 6.19,
753
+ "learning_rate": 6.430284505055255e-05,
754
+ "loss": 0.2393,
755
+ "step": 9600
756
+ },
757
+ {
758
+ "epoch": 6.25,
759
+ "learning_rate": 6.383258876087468e-05,
760
+ "loss": 0.2475,
761
+ "step": 9700
762
+ },
763
+ {
764
+ "epoch": 6.32,
765
+ "learning_rate": 6.336233247119681e-05,
766
+ "loss": 0.2339,
767
+ "step": 9800
768
+ },
769
+ {
770
+ "epoch": 6.38,
771
+ "learning_rate": 6.289207618151893e-05,
772
+ "loss": 0.2384,
773
+ "step": 9900
774
+ },
775
+ {
776
+ "epoch": 6.45,
777
+ "learning_rate": 6.242181989184106e-05,
778
+ "loss": 0.2406,
779
+ "step": 10000
780
+ },
781
+ {
782
+ "epoch": 6.45,
783
+ "eval_loss": 0.1413952112197876,
784
+ "eval_runtime": 378.3628,
785
+ "eval_samples_per_second": 14.37,
786
+ "eval_steps_per_second": 0.899,
787
+ "eval_wer": 0.11942698579230686,
788
+ "step": 10000
789
+ },
790
+ {
791
+ "epoch": 6.51,
792
+ "learning_rate": 6.19515636021632e-05,
793
+ "loss": 0.2518,
794
+ "step": 10100
795
+ },
796
+ {
797
+ "epoch": 6.58,
798
+ "learning_rate": 6.14813073124853e-05,
799
+ "loss": 0.2387,
800
+ "step": 10200
801
+ },
802
+ {
803
+ "epoch": 6.64,
804
+ "learning_rate": 6.101105102280743e-05,
805
+ "loss": 0.242,
806
+ "step": 10300
807
+ },
808
+ {
809
+ "epoch": 6.71,
810
+ "learning_rate": 6.054079473312956e-05,
811
+ "loss": 0.2409,
812
+ "step": 10400
813
+ },
814
+ {
815
+ "epoch": 6.77,
816
+ "learning_rate": 6.007524100634846e-05,
817
+ "loss": 0.2488,
818
+ "step": 10500
819
+ },
820
+ {
821
+ "epoch": 6.77,
822
+ "eval_loss": 0.13929419219493866,
823
+ "eval_runtime": 376.1627,
824
+ "eval_samples_per_second": 14.454,
825
+ "eval_steps_per_second": 0.904,
826
+ "eval_wer": 0.11731887397413396,
827
+ "step": 10500
828
+ },
829
+ {
830
+ "epoch": 6.83,
831
+ "learning_rate": 5.9604984716670584e-05,
832
+ "loss": 0.2506,
833
+ "step": 10600
834
+ },
835
+ {
836
+ "epoch": 6.9,
837
+ "learning_rate": 5.9134728426992715e-05,
838
+ "loss": 0.2412,
839
+ "step": 10700
840
+ },
841
+ {
842
+ "epoch": 6.96,
843
+ "learning_rate": 5.866447213731484e-05,
844
+ "loss": 0.2414,
845
+ "step": 10800
846
+ },
847
+ {
848
+ "epoch": 7.03,
849
+ "learning_rate": 5.819421584763697e-05,
850
+ "loss": 0.251,
851
+ "step": 10900
852
+ },
853
+ {
854
+ "epoch": 7.09,
855
+ "learning_rate": 5.7723959557959094e-05,
856
+ "loss": 0.3084,
857
+ "step": 11000
858
+ },
859
+ {
860
+ "epoch": 7.09,
861
+ "eval_loss": 0.13794787228107452,
862
+ "eval_runtime": 376.7047,
863
+ "eval_samples_per_second": 14.433,
864
+ "eval_steps_per_second": 0.903,
865
+ "eval_wer": 0.11644621373312285,
866
+ "step": 11000
867
+ },
868
+ {
869
+ "epoch": 7.16,
870
+ "learning_rate": 5.725370326828121e-05,
871
+ "loss": 0.2374,
872
+ "step": 11100
873
+ },
874
+ {
875
+ "epoch": 7.22,
876
+ "learning_rate": 5.6783446978603336e-05,
877
+ "loss": 0.2345,
878
+ "step": 11200
879
+ },
880
+ {
881
+ "epoch": 7.29,
882
+ "learning_rate": 5.6313190688925466e-05,
883
+ "loss": 0.2247,
884
+ "step": 11300
885
+ },
886
+ {
887
+ "epoch": 7.35,
888
+ "learning_rate": 5.584293439924759e-05,
889
+ "loss": 0.2367,
890
+ "step": 11400
891
+ },
892
+ {
893
+ "epoch": 7.41,
894
+ "learning_rate": 5.537267810956972e-05,
895
+ "loss": 0.2365,
896
+ "step": 11500
897
+ },
898
+ {
899
+ "epoch": 7.41,
900
+ "eval_loss": 0.13865751028060913,
901
+ "eval_runtime": 382.6889,
902
+ "eval_samples_per_second": 14.207,
903
+ "eval_steps_per_second": 0.888,
904
+ "eval_wer": 0.11650504476060675,
905
+ "step": 11500
906
+ },
907
+ {
908
+ "epoch": 7.48,
909
+ "learning_rate": 5.4902421819891845e-05,
910
+ "loss": 0.2221,
911
+ "step": 11600
912
+ },
913
+ {
914
+ "epoch": 7.54,
915
+ "learning_rate": 5.4432165530213976e-05,
916
+ "loss": 0.2178,
917
+ "step": 11700
918
+ },
919
+ {
920
+ "epoch": 7.61,
921
+ "learning_rate": 5.396661180343288e-05,
922
+ "loss": 0.2296,
923
+ "step": 11800
924
+ },
925
+ {
926
+ "epoch": 7.67,
927
+ "learning_rate": 5.3496355513755e-05,
928
+ "loss": 0.2256,
929
+ "step": 11900
930
+ },
931
+ {
932
+ "epoch": 7.74,
933
+ "learning_rate": 5.302609922407712e-05,
934
+ "loss": 0.2217,
935
+ "step": 12000
936
+ },
937
+ {
938
+ "epoch": 7.74,
939
+ "eval_loss": 0.1380530297756195,
940
+ "eval_runtime": 374.6191,
941
+ "eval_samples_per_second": 14.513,
942
+ "eval_steps_per_second": 0.908,
943
+ "eval_wer": 0.11323992273525058,
944
+ "step": 12000
945
+ },
946
+ {
947
+ "epoch": 7.8,
948
+ "learning_rate": 5.255584293439924e-05,
949
+ "loss": 0.2296,
950
+ "step": 12100
951
+ },
952
+ {
953
+ "epoch": 7.87,
954
+ "learning_rate": 5.2085586644721374e-05,
955
+ "loss": 0.2326,
956
+ "step": 12200
957
+ },
958
+ {
959
+ "epoch": 7.93,
960
+ "learning_rate": 5.16153303550435e-05,
961
+ "loss": 0.227,
962
+ "step": 12300
963
+ },
964
+ {
965
+ "epoch": 7.99,
966
+ "learning_rate": 5.114507406536563e-05,
967
+ "loss": 0.2326,
968
+ "step": 12400
969
+ },
970
+ {
971
+ "epoch": 8.06,
972
+ "learning_rate": 5.067481777568775e-05,
973
+ "loss": 0.2381,
974
+ "step": 12500
975
+ },
976
+ {
977
+ "epoch": 8.06,
978
+ "eval_loss": 0.13600507378578186,
979
+ "eval_runtime": 376.6806,
980
+ "eval_samples_per_second": 14.434,
981
+ "eval_steps_per_second": 0.903,
982
+ "eval_wer": 0.11259278143292772,
983
+ "step": 12500
984
+ },
985
+ {
986
+ "epoch": 8.12,
987
+ "learning_rate": 5.0204561486009884e-05,
988
+ "loss": 0.2296,
989
+ "step": 12600
990
+ },
991
+ {
992
+ "epoch": 8.19,
993
+ "learning_rate": 4.9734305196332e-05,
994
+ "loss": 0.2185,
995
+ "step": 12700
996
+ },
997
+ {
998
+ "epoch": 8.25,
999
+ "learning_rate": 4.926404890665413e-05,
1000
+ "loss": 0.2353,
1001
+ "step": 12800
1002
+ },
1003
+ {
1004
+ "epoch": 8.32,
1005
+ "learning_rate": 4.8793792616976256e-05,
1006
+ "loss": 0.2217,
1007
+ "step": 12900
1008
+ },
1009
+ {
1010
+ "epoch": 8.38,
1011
+ "learning_rate": 4.832353632729838e-05,
1012
+ "loss": 0.2329,
1013
+ "step": 13000
1014
+ },
1015
+ {
1016
+ "epoch": 8.38,
1017
+ "eval_loss": 0.1356525719165802,
1018
+ "eval_runtime": 375.4068,
1019
+ "eval_samples_per_second": 14.483,
1020
+ "eval_steps_per_second": 0.906,
1021
+ "eval_wer": 0.11240648317922873,
1022
+ "step": 13000
1023
+ },
1024
+ {
1025
+ "epoch": 8.45,
1026
+ "learning_rate": 4.7853280037620504e-05,
1027
+ "loss": 0.2241,
1028
+ "step": 13100
1029
+ },
1030
+ {
1031
+ "epoch": 8.51,
1032
+ "learning_rate": 4.738302374794263e-05,
1033
+ "loss": 0.2256,
1034
+ "step": 13200
1035
+ },
1036
+ {
1037
+ "epoch": 8.57,
1038
+ "learning_rate": 4.691276745826476e-05,
1039
+ "loss": 0.2189,
1040
+ "step": 13300
1041
+ },
1042
+ {
1043
+ "epoch": 8.64,
1044
+ "learning_rate": 4.644251116858688e-05,
1045
+ "loss": 0.2932,
1046
+ "step": 13400
1047
+ },
1048
+ {
1049
+ "epoch": 8.7,
1050
+ "learning_rate": 4.597225487890901e-05,
1051
+ "loss": 0.2103,
1052
+ "step": 13500
1053
+ },
1054
+ {
1055
+ "epoch": 8.7,
1056
+ "eval_loss": 0.13354040682315826,
1057
+ "eval_runtime": 376.3349,
1058
+ "eval_samples_per_second": 14.447,
1059
+ "eval_steps_per_second": 0.903,
1060
+ "eval_wer": 0.10866090776275408,
1061
+ "step": 13500
1062
+ },
1063
+ {
1064
+ "epoch": 8.77,
1065
+ "learning_rate": 4.550199858923113e-05,
1066
+ "loss": 0.2253,
1067
+ "step": 13600
1068
+ },
1069
+ {
1070
+ "epoch": 8.83,
1071
+ "learning_rate": 4.503644486245004e-05,
1072
+ "loss": 0.2348,
1073
+ "step": 13700
1074
+ },
1075
+ {
1076
+ "epoch": 8.9,
1077
+ "learning_rate": 4.4566188572772164e-05,
1078
+ "loss": 0.2313,
1079
+ "step": 13800
1080
+ },
1081
+ {
1082
+ "epoch": 8.96,
1083
+ "learning_rate": 4.409593228309429e-05,
1084
+ "loss": 0.2333,
1085
+ "step": 13900
1086
+ },
1087
+ {
1088
+ "epoch": 9.03,
1089
+ "learning_rate": 4.362567599341641e-05,
1090
+ "loss": 0.2366,
1091
+ "step": 14000
1092
+ },
1093
+ {
1094
+ "epoch": 9.03,
1095
+ "eval_loss": 0.13876694440841675,
1096
+ "eval_runtime": 378.8799,
1097
+ "eval_samples_per_second": 14.35,
1098
+ "eval_steps_per_second": 0.897,
1099
+ "eval_wer": 0.11050427995724946,
1100
+ "step": 14000
1101
+ },
1102
+ {
1103
+ "epoch": 9.09,
1104
+ "learning_rate": 4.315541970373854e-05,
1105
+ "loss": 0.2322,
1106
+ "step": 14100
1107
+ },
1108
+ {
1109
+ "epoch": 9.16,
1110
+ "learning_rate": 4.268516341406067e-05,
1111
+ "loss": 0.3049,
1112
+ "step": 14200
1113
+ },
1114
+ {
1115
+ "epoch": 9.22,
1116
+ "learning_rate": 4.221490712438279e-05,
1117
+ "loss": 0.2376,
1118
+ "step": 14300
1119
+ },
1120
+ {
1121
+ "epoch": 9.28,
1122
+ "learning_rate": 4.1744650834704915e-05,
1123
+ "loss": 0.2289,
1124
+ "step": 14400
1125
+ },
1126
+ {
1127
+ "epoch": 9.35,
1128
+ "learning_rate": 4.127439454502704e-05,
1129
+ "loss": 0.2289,
1130
+ "step": 14500
1131
+ },
1132
+ {
1133
+ "epoch": 9.35,
1134
+ "eval_loss": 0.13831551373004913,
1135
+ "eval_runtime": 376.3835,
1136
+ "eval_samples_per_second": 14.445,
1137
+ "eval_steps_per_second": 0.903,
1138
+ "eval_wer": 0.1097983076274427,
1139
+ "step": 14500
1140
+ },
1141
+ {
1142
+ "epoch": 9.41,
1143
+ "learning_rate": 4.080413825534917e-05,
1144
+ "loss": 0.2304,
1145
+ "step": 14600
1146
+ },
1147
+ {
1148
+ "epoch": 9.48,
1149
+ "learning_rate": 4.0333881965671294e-05,
1150
+ "loss": 0.2287,
1151
+ "step": 14700
1152
+ },
1153
+ {
1154
+ "epoch": 9.54,
1155
+ "learning_rate": 3.986362567599342e-05,
1156
+ "loss": 0.2348,
1157
+ "step": 14800
1158
+ },
1159
+ {
1160
+ "epoch": 9.61,
1161
+ "learning_rate": 3.939336938631554e-05,
1162
+ "loss": 0.2324,
1163
+ "step": 14900
1164
+ },
1165
+ {
1166
+ "epoch": 9.67,
1167
+ "learning_rate": 3.892311309663767e-05,
1168
+ "loss": 0.2486,
1169
+ "step": 15000
1170
+ },
1171
+ {
1172
+ "epoch": 9.67,
1173
+ "eval_loss": 0.1386488676071167,
1174
+ "eval_runtime": 381.3083,
1175
+ "eval_samples_per_second": 14.259,
1176
+ "eval_steps_per_second": 0.892,
1177
+ "eval_wer": 0.10869032327649603,
1178
+ "step": 15000
1179
+ },
1180
+ {
1181
+ "epoch": 9.74,
1182
+ "learning_rate": 3.84528568069598e-05,
1183
+ "loss": 0.2326,
1184
+ "step": 15100
1185
+ },
1186
+ {
1187
+ "epoch": 9.8,
1188
+ "learning_rate": 3.798260051728192e-05,
1189
+ "loss": 0.2364,
1190
+ "step": 15200
1191
+ },
1192
+ {
1193
+ "epoch": 9.86,
1194
+ "learning_rate": 3.7512344227604045e-05,
1195
+ "loss": 0.2519,
1196
+ "step": 15300
1197
+ },
1198
+ {
1199
+ "epoch": 9.93,
1200
+ "learning_rate": 3.7046790500822946e-05,
1201
+ "loss": 0.2615,
1202
+ "step": 15400
1203
+ },
1204
+ {
1205
+ "epoch": 9.99,
1206
+ "learning_rate": 3.657653421114508e-05,
1207
+ "loss": 0.2772,
1208
+ "step": 15500
1209
+ },
1210
+ {
1211
+ "epoch": 9.99,
1212
+ "eval_loss": 0.15979500114917755,
1213
+ "eval_runtime": 378.6086,
1214
+ "eval_samples_per_second": 14.36,
1215
+ "eval_steps_per_second": 0.898,
1216
+ "eval_wer": 0.10933746457881886,
1217
+ "step": 15500
1218
+ },
1219
+ {
1220
+ "epoch": 10.06,
1221
+ "learning_rate": 3.61062779214672e-05,
1222
+ "loss": 0.273,
1223
+ "step": 15600
1224
+ },
1225
+ {
1226
+ "epoch": 10.12,
1227
+ "learning_rate": 3.563602163178933e-05,
1228
+ "loss": 0.2799,
1229
+ "step": 15700
1230
+ },
1231
+ {
1232
+ "epoch": 10.19,
1233
+ "learning_rate": 3.516576534211145e-05,
1234
+ "loss": 0.2674,
1235
+ "step": 15800
1236
+ },
1237
+ {
1238
+ "epoch": 10.25,
1239
+ "learning_rate": 3.469550905243358e-05,
1240
+ "loss": 0.2784,
1241
+ "step": 15900
1242
+ },
1243
+ {
1244
+ "epoch": 10.32,
1245
+ "learning_rate": 3.4225252762755704e-05,
1246
+ "loss": 0.2728,
1247
+ "step": 16000
1248
+ },
1249
+ {
1250
+ "epoch": 10.32,
1251
+ "eval_loss": 0.18136879801750183,
1252
+ "eval_runtime": 374.0064,
1253
+ "eval_samples_per_second": 14.537,
1254
+ "eval_steps_per_second": 0.909,
1255
+ "eval_wer": 0.1109651230058733,
1256
+ "step": 16000
1257
+ },
1258
+ {
1259
+ "epoch": 10.38,
1260
+ "learning_rate": 3.375499647307783e-05,
1261
+ "loss": 0.2874,
1262
+ "step": 16100
1263
+ },
1264
+ {
1265
+ "epoch": 10.44,
1266
+ "learning_rate": 3.328474018339995e-05,
1267
+ "loss": 0.316,
1268
+ "step": 16200
1269
+ },
1270
+ {
1271
+ "epoch": 10.51,
1272
+ "learning_rate": 3.2814483893722083e-05,
1273
+ "loss": 0.3058,
1274
+ "step": 16300
1275
+ },
1276
+ {
1277
+ "epoch": 10.57,
1278
+ "learning_rate": 3.2348930166940985e-05,
1279
+ "loss": 0.3039,
1280
+ "step": 16400
1281
+ },
1282
+ {
1283
+ "epoch": 10.64,
1284
+ "learning_rate": 3.187867387726311e-05,
1285
+ "loss": 0.3437,
1286
+ "step": 16500
1287
+ },
1288
+ {
1289
+ "epoch": 10.64,
1290
+ "eval_loss": 0.25054600834846497,
1291
+ "eval_runtime": 375.3433,
1292
+ "eval_samples_per_second": 14.485,
1293
+ "eval_steps_per_second": 0.906,
1294
+ "eval_wer": 0.1123868728367341,
1295
+ "step": 16500
1296
+ },
1297
+ {
1298
+ "epoch": 10.7,
1299
+ "learning_rate": 3.140841758758524e-05,
1300
+ "loss": 0.3646,
1301
+ "step": 16600
1302
+ },
1303
+ {
1304
+ "epoch": 10.77,
1305
+ "learning_rate": 3.093816129790736e-05,
1306
+ "loss": 0.4111,
1307
+ "step": 16700
1308
+ },
1309
+ {
1310
+ "epoch": 10.83,
1311
+ "learning_rate": 3.0467905008229485e-05,
1312
+ "loss": 0.3842,
1313
+ "step": 16800
1314
+ },
1315
+ {
1316
+ "epoch": 10.9,
1317
+ "learning_rate": 2.9997648718551612e-05,
1318
+ "loss": 0.3806,
1319
+ "step": 16900
1320
+ },
1321
+ {
1322
+ "epoch": 10.96,
1323
+ "learning_rate": 2.952739242887374e-05,
1324
+ "loss": 0.431,
1325
+ "step": 17000
1326
+ },
1327
+ {
1328
+ "epoch": 10.96,
1329
+ "eval_loss": 0.28276580572128296,
1330
+ "eval_runtime": 375.6956,
1331
+ "eval_samples_per_second": 14.472,
1332
+ "eval_steps_per_second": 0.905,
1333
+ "eval_wer": 0.11427927088746605,
1334
+ "step": 17000
1335
+ },
1336
+ {
1337
+ "epoch": 11.03,
1338
+ "learning_rate": 2.905713613919586e-05,
1339
+ "loss": 0.3948,
1340
+ "step": 17100
1341
+ },
1342
+ {
1343
+ "epoch": 11.09,
1344
+ "learning_rate": 2.8586879849517988e-05,
1345
+ "loss": 0.391,
1346
+ "step": 17200
1347
+ },
1348
+ {
1349
+ "epoch": 11.15,
1350
+ "learning_rate": 2.8116623559840115e-05,
1351
+ "loss": 0.4083,
1352
+ "step": 17300
1353
+ },
1354
+ {
1355
+ "epoch": 11.22,
1356
+ "learning_rate": 2.764636727016224e-05,
1357
+ "loss": 0.4305,
1358
+ "step": 17400
1359
+ },
1360
+ {
1361
+ "epoch": 11.28,
1362
+ "learning_rate": 2.7176110980484367e-05,
1363
+ "loss": 0.3929,
1364
+ "step": 17500
1365
+ },
1366
+ {
1367
+ "epoch": 11.28,
1368
+ "eval_loss": 0.29774826765060425,
1369
+ "eval_runtime": 382.3796,
1370
+ "eval_samples_per_second": 14.219,
1371
+ "eval_steps_per_second": 0.889,
1372
+ "eval_wer": 0.11490680184729427,
1373
+ "step": 17500
1374
+ },
1375
+ {
1376
+ "epoch": 11.35,
1377
+ "learning_rate": 2.670585469080649e-05,
1378
+ "loss": 0.4219,
1379
+ "step": 17600
1380
+ },
1381
+ {
1382
+ "epoch": 11.41,
1383
+ "learning_rate": 2.6235598401128615e-05,
1384
+ "loss": 0.4197,
1385
+ "step": 17700
1386
+ },
1387
+ {
1388
+ "epoch": 11.48,
1389
+ "learning_rate": 2.5765342111450742e-05,
1390
+ "loss": 0.4265,
1391
+ "step": 17800
1392
+ },
1393
+ {
1394
+ "epoch": 11.54,
1395
+ "learning_rate": 2.529508582177287e-05,
1396
+ "loss": 0.4829,
1397
+ "step": 17900
1398
+ },
1399
+ {
1400
+ "epoch": 11.61,
1401
+ "learning_rate": 2.4824829532094994e-05,
1402
+ "loss": 0.4396,
1403
+ "step": 18000
1404
+ },
1405
+ {
1406
+ "epoch": 11.61,
1407
+ "eval_loss": 0.3197712004184723,
1408
+ "eval_runtime": 378.387,
1409
+ "eval_samples_per_second": 14.369,
1410
+ "eval_steps_per_second": 0.899,
1411
+ "eval_wer": 0.11699530332297253,
1412
+ "step": 18000
1413
+ },
1414
+ {
1415
+ "epoch": 11.67,
1416
+ "learning_rate": 2.43592758053139e-05,
1417
+ "loss": 0.4394,
1418
+ "step": 18100
1419
+ },
1420
+ {
1421
+ "epoch": 11.73,
1422
+ "learning_rate": 2.3889019515636023e-05,
1423
+ "loss": 0.5335,
1424
+ "step": 18200
1425
+ },
1426
+ {
1427
+ "epoch": 11.8,
1428
+ "learning_rate": 2.341876322595815e-05,
1429
+ "loss": 0.5873,
1430
+ "step": 18300
1431
+ },
1432
+ {
1433
+ "epoch": 11.86,
1434
+ "learning_rate": 2.2948506936280274e-05,
1435
+ "loss": 0.6076,
1436
+ "step": 18400
1437
+ },
1438
+ {
1439
+ "epoch": 11.93,
1440
+ "learning_rate": 2.24782506466024e-05,
1441
+ "loss": 0.59,
1442
+ "step": 18500
1443
+ },
1444
+ {
1445
+ "epoch": 11.93,
1446
+ "eval_loss": 0.41584599018096924,
1447
+ "eval_runtime": 384.0446,
1448
+ "eval_samples_per_second": 14.157,
1449
+ "eval_steps_per_second": 0.885,
1450
+ "eval_wer": 0.1315265671114946,
1451
+ "step": 18500
1452
+ },
1453
+ {
1454
+ "epoch": 11.99,
1455
+ "learning_rate": 2.2007994356924526e-05,
1456
+ "loss": 0.6303,
1457
+ "step": 18600
1458
+ },
1459
+ {
1460
+ "epoch": 12.06,
1461
+ "learning_rate": 2.1537738067246653e-05,
1462
+ "loss": 0.6319,
1463
+ "step": 18700
1464
+ },
1465
+ {
1466
+ "epoch": 12.12,
1467
+ "learning_rate": 2.1067481777568777e-05,
1468
+ "loss": 0.6773,
1469
+ "step": 18800
1470
+ },
1471
+ {
1472
+ "epoch": 12.19,
1473
+ "learning_rate": 2.0601928050787682e-05,
1474
+ "loss": 0.6564,
1475
+ "step": 18900
1476
+ },
1477
+ {
1478
+ "epoch": 12.25,
1479
+ "learning_rate": 2.0131671761109806e-05,
1480
+ "loss": 0.7813,
1481
+ "step": 19000
1482
+ },
1483
+ {
1484
+ "epoch": 12.25,
1485
+ "eval_loss": 0.6122739911079407,
1486
+ "eval_runtime": 374.3179,
1487
+ "eval_samples_per_second": 14.525,
1488
+ "eval_steps_per_second": 0.908,
1489
+ "eval_wer": 0.2208026513183053,
1490
+ "step": 19000
1491
+ },
1492
+ {
1493
+ "epoch": 12.31,
1494
+ "learning_rate": 1.9661415471431934e-05,
1495
+ "loss": 0.8561,
1496
+ "step": 19100
1497
+ },
1498
+ {
1499
+ "epoch": 12.38,
1500
+ "learning_rate": 1.9191159181754058e-05,
1501
+ "loss": 0.8639,
1502
+ "step": 19200
1503
+ },
1504
+ {
1505
+ "epoch": 12.44,
1506
+ "learning_rate": 1.8720902892076185e-05,
1507
+ "loss": 0.9351,
1508
+ "step": 19300
1509
+ },
1510
+ {
1511
+ "epoch": 12.51,
1512
+ "learning_rate": 1.825064660239831e-05,
1513
+ "loss": 0.9492,
1514
+ "step": 19400
1515
+ },
1516
+ {
1517
+ "epoch": 12.57,
1518
+ "learning_rate": 1.7780390312720433e-05,
1519
+ "loss": 0.9345,
1520
+ "step": 19500
1521
+ },
1522
+ {
1523
+ "epoch": 12.57,
1524
+ "eval_loss": 0.6814701557159424,
1525
+ "eval_runtime": 375.5048,
1526
+ "eval_samples_per_second": 14.479,
1527
+ "eval_steps_per_second": 0.905,
1528
+ "eval_wer": 0.28850735878102113,
1529
+ "step": 19500
1530
+ },
1531
+ {
1532
+ "epoch": 12.64,
1533
+ "learning_rate": 1.731013402304256e-05,
1534
+ "loss": 0.9227,
1535
+ "step": 19600
1536
+ },
1537
+ {
1538
+ "epoch": 12.7,
1539
+ "learning_rate": 1.6839877733364685e-05,
1540
+ "loss": 0.9694,
1541
+ "step": 19700
1542
+ },
1543
+ {
1544
+ "epoch": 12.77,
1545
+ "learning_rate": 1.6369621443686812e-05,
1546
+ "loss": 0.9394,
1547
+ "step": 19800
1548
+ },
1549
+ {
1550
+ "epoch": 12.83,
1551
+ "learning_rate": 1.5936985657183166e-05,
1552
+ "loss": 0.9483,
1553
+ "step": 19900
1554
+ },
1555
+ {
1556
+ "epoch": 12.89,
1557
+ "learning_rate": 1.5518457559369855e-05,
1558
+ "loss": 0.998,
1559
+ "step": 20000
1560
+ },
1561
+ {
1562
+ "epoch": 12.89,
1563
+ "eval_loss": 0.7587289214134216,
1564
+ "eval_runtime": 378.2354,
1565
+ "eval_samples_per_second": 14.375,
1566
+ "eval_steps_per_second": 0.899,
1567
+ "eval_wer": 0.19911361251924264,
1568
+ "step": 20000
1569
+ },
1570
+ {
1571
+ "epoch": 12.96,
1572
+ "learning_rate": 1.5104632024453328e-05,
1573
+ "loss": 1.0172,
1574
+ "step": 20100
1575
+ },
1576
+ {
1577
+ "epoch": 13.02,
1578
+ "learning_rate": 1.4667293675052904e-05,
1579
+ "loss": 0.999,
1580
+ "step": 20200
1581
+ },
1582
+ {
1583
+ "epoch": 13.09,
1584
+ "learning_rate": 1.4253468140136376e-05,
1585
+ "loss": 1.0465,
1586
+ "step": 20300
1587
+ },
1588
+ {
1589
+ "epoch": 13.15,
1590
+ "learning_rate": 1.3839642605219846e-05,
1591
+ "loss": 1.0361,
1592
+ "step": 20400
1593
+ },
1594
+ {
1595
+ "epoch": 13.22,
1596
+ "learning_rate": 1.3421114507406538e-05,
1597
+ "loss": 1.0493,
1598
+ "step": 20500
1599
+ },
1600
+ {
1601
+ "epoch": 13.22,
1602
+ "eval_loss": 0.7583341598510742,
1603
+ "eval_runtime": 375.5467,
1604
+ "eval_samples_per_second": 14.478,
1605
+ "eval_steps_per_second": 0.905,
1606
+ "eval_wer": 0.1996430917665977,
1607
+ "step": 20500
1608
+ },
1609
+ {
1610
+ "epoch": 13.28,
1611
+ "learning_rate": 1.3026099224077124e-05,
1612
+ "loss": 1.0257,
1613
+ "step": 20600
1614
+ },
1615
+ {
1616
+ "epoch": 13.35,
1617
+ "learning_rate": 1.2607571126263815e-05,
1618
+ "loss": 0.9884,
1619
+ "step": 20700
1620
+ },
1621
+ {
1622
+ "epoch": 13.41,
1623
+ "learning_rate": 1.217963790265695e-05,
1624
+ "loss": 0.9969,
1625
+ "step": 20800
1626
+ },
1627
+ {
1628
+ "epoch": 13.48,
1629
+ "learning_rate": 1.1775217493533977e-05,
1630
+ "loss": 1.0021,
1631
+ "step": 20900
1632
+ },
1633
+ {
1634
+ "epoch": 13.54,
1635
+ "learning_rate": 1.1441335527862685e-05,
1636
+ "loss": 1.438,
1637
+ "step": 21000
1638
+ },
1639
+ {
1640
+ "epoch": 13.54,
1641
+ "eval_loss": NaN,
1642
+ "eval_runtime": 375.5955,
1643
+ "eval_samples_per_second": 14.476,
1644
+ "eval_steps_per_second": 0.905,
1645
+ "eval_wer": 1.0,
1646
+ "step": 21000
1647
+ },
1648
+ {
1649
+ "epoch": 13.6,
1650
+ "learning_rate": 1.0971079238184811e-05,
1651
+ "loss": 0.0,
1652
+ "step": 21100
1653
+ },
1654
+ {
1655
+ "epoch": 13.67,
1656
+ "learning_rate": 1.0500822948506937e-05,
1657
+ "loss": 0.0,
1658
+ "step": 21200
1659
+ },
1660
+ {
1661
+ "epoch": 13.73,
1662
+ "learning_rate": 1.0030566658829062e-05,
1663
+ "loss": 0.0,
1664
+ "step": 21300
1665
+ },
1666
+ {
1667
+ "epoch": 13.8,
1668
+ "learning_rate": 9.560310369151188e-06,
1669
+ "loss": 0.0,
1670
+ "step": 21400
1671
+ },
1672
+ {
1673
+ "epoch": 13.86,
1674
+ "learning_rate": 9.090054079473314e-06,
1675
+ "loss": 0.0,
1676
+ "step": 21500
1677
+ },
1678
+ {
1679
+ "epoch": 13.86,
1680
+ "eval_loss": NaN,
1681
+ "eval_runtime": 369.5033,
1682
+ "eval_samples_per_second": 14.714,
1683
+ "eval_steps_per_second": 0.92,
1684
+ "eval_wer": 1.0,
1685
+ "step": 21500
1686
+ },
1687
+ {
1688
+ "epoch": 13.93,
1689
+ "learning_rate": 8.61979778979544e-06,
1690
+ "loss": 0.0,
1691
+ "step": 21600
1692
+ },
1693
+ {
1694
+ "epoch": 13.99,
1695
+ "learning_rate": 8.149541500117565e-06,
1696
+ "loss": 0.0,
1697
+ "step": 21700
1698
+ },
1699
+ {
1700
+ "epoch": 14.06,
1701
+ "learning_rate": 7.679285210439691e-06,
1702
+ "loss": 0.0,
1703
+ "step": 21800
1704
+ },
1705
+ {
1706
+ "epoch": 14.12,
1707
+ "learning_rate": 7.209028920761815e-06,
1708
+ "loss": 0.0,
1709
+ "step": 21900
1710
+ },
1711
+ {
1712
+ "epoch": 14.18,
1713
+ "learning_rate": 6.738772631083941e-06,
1714
+ "loss": 0.0,
1715
+ "step": 22000
1716
+ },
1717
+ {
1718
+ "epoch": 14.18,
1719
+ "eval_loss": NaN,
1720
+ "eval_runtime": 375.3678,
1721
+ "eval_samples_per_second": 14.484,
1722
+ "eval_steps_per_second": 0.906,
1723
+ "eval_wer": 1.0,
1724
+ "step": 22000
1725
+ },
1726
+ {
1727
+ "epoch": 14.25,
1728
+ "learning_rate": 6.268516341406067e-06,
1729
+ "loss": 0.0,
1730
+ "step": 22100
1731
+ },
1732
+ {
1733
+ "epoch": 14.31,
1734
+ "learning_rate": 5.798260051728193e-06,
1735
+ "loss": 0.0,
1736
+ "step": 22200
1737
+ },
1738
+ {
1739
+ "epoch": 14.38,
1740
+ "learning_rate": 5.3280037620503175e-06,
1741
+ "loss": 0.0,
1742
+ "step": 22300
1743
+ },
1744
+ {
1745
+ "epoch": 14.44,
1746
+ "learning_rate": 4.857747472372443e-06,
1747
+ "loss": 0.0,
1748
+ "step": 22400
1749
+ },
1750
+ {
1751
+ "epoch": 14.51,
1752
+ "learning_rate": 4.387491182694569e-06,
1753
+ "loss": 0.0,
1754
+ "step": 22500
1755
+ },
1756
+ {
1757
+ "epoch": 14.51,
1758
+ "eval_loss": NaN,
1759
+ "eval_runtime": 371.6568,
1760
+ "eval_samples_per_second": 14.629,
1761
+ "eval_steps_per_second": 0.915,
1762
+ "eval_wer": 1.0,
1763
+ "step": 22500
1764
+ },
1765
+ {
1766
+ "epoch": 14.57,
1767
+ "learning_rate": 3.917234893016694e-06,
1768
+ "loss": 0.0,
1769
+ "step": 22600
1770
+ },
1771
+ {
1772
+ "epoch": 14.64,
1773
+ "learning_rate": 3.4469786033388197e-06,
1774
+ "loss": 0.0,
1775
+ "step": 22700
1776
+ },
1777
+ {
1778
+ "epoch": 14.7,
1779
+ "learning_rate": 2.9767223136609455e-06,
1780
+ "loss": 0.0,
1781
+ "step": 22800
1782
+ },
1783
+ {
1784
+ "epoch": 14.76,
1785
+ "learning_rate": 2.506466023983071e-06,
1786
+ "loss": 0.0,
1787
+ "step": 22900
1788
+ },
1789
+ {
1790
+ "epoch": 14.83,
1791
+ "learning_rate": 2.0362097343051966e-06,
1792
+ "loss": 0.0,
1793
+ "step": 23000
1794
+ },
1795
+ {
1796
+ "epoch": 14.83,
1797
+ "eval_loss": NaN,
1798
+ "eval_runtime": 369.8493,
1799
+ "eval_samples_per_second": 14.701,
1800
+ "eval_steps_per_second": 0.919,
1801
+ "eval_wer": 1.0,
1802
+ "step": 23000
1803
+ },
1804
+ {
1805
+ "epoch": 14.89,
1806
+ "learning_rate": 1.565953444627322e-06,
1807
+ "loss": 0.0,
1808
+ "step": 23100
1809
+ },
1810
+ {
1811
+ "epoch": 14.96,
1812
+ "learning_rate": 1.0956971549494475e-06,
1813
+ "loss": 0.0,
1814
+ "step": 23200
1815
+ },
1816
+ {
1817
+ "epoch": 15.0,
1818
+ "step": 23265,
1819
+ "total_flos": 1.618046661664003e+20,
1820
+ "train_loss": 0.5419238063665506,
1821
+ "train_runtime": 74160.538,
1822
+ "train_samples_per_second": 10.041,
1823
+ "train_steps_per_second": 0.314
1824
+ }
1825
+ ],
1826
+ "max_steps": 23265,
1827
+ "num_train_epochs": 15,
1828
+ "total_flos": 1.618046661664003e+20,
1829
+ "trial_name": null,
1830
+ "trial_params": null
1831
+ }
wandb/run-20220201_213057-2vounkdu/files/output.log CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220201_213057-2vounkdu/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220201_213057-2vounkdu/logs/debug-internal.log CHANGED
@@ -40840,3 +40840,270 @@
40840
  2022-02-02 18:07:42,597 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40841
  2022-02-02 18:07:43,597 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40842
  2022-02-02 18:07:44,598 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
40840
  2022-02-02 18:07:42,597 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40841
  2022-02-02 18:07:43,597 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40842
  2022-02-02 18:07:44,598 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40843
+ 2022-02-02 18:07:48,600 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40844
+ 2022-02-02 18:07:50,805 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
40845
+ 2022-02-02 18:07:51,658 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40846
+ 2022-02-02 18:07:51,659 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40847
+ 2022-02-02 18:07:54,603 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40848
+ 2022-02-02 18:07:56,604 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40849
+ 2022-02-02 18:07:58,605 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40850
+ 2022-02-02 18:08:00,606 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40851
+ 2022-02-02 18:08:02,607 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40852
+ 2022-02-02 18:08:04,608 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40853
+ 2022-02-02 18:08:06,609 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40854
+ 2022-02-02 18:08:06,895 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40855
+ 2022-02-02 18:08:06,895 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40856
+ 2022-02-02 18:08:08,609 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40857
+ 2022-02-02 18:08:10,610 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40858
+ 2022-02-02 18:08:11,611 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40859
+ 2022-02-02 18:08:12,611 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40860
+ 2022-02-02 18:08:13,612 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40861
+ 2022-02-02 18:08:14,612 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40862
+ 2022-02-02 18:08:16,613 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40863
+ 2022-02-02 18:08:18,615 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40864
+ 2022-02-02 18:08:20,616 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40865
+ 2022-02-02 18:08:21,599 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
40866
+ 2022-02-02 18:08:22,258 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40867
+ 2022-02-02 18:08:22,259 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40868
+ 2022-02-02 18:08:22,617 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40869
+ 2022-02-02 18:08:24,618 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40870
+ 2022-02-02 18:08:26,619 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40871
+ 2022-02-02 18:08:28,620 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40872
+ 2022-02-02 18:08:30,621 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40873
+ 2022-02-02 18:08:32,622 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40874
+ 2022-02-02 18:08:34,623 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40875
+ 2022-02-02 18:08:36,625 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40876
+ 2022-02-02 18:08:37,493 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40877
+ 2022-02-02 18:08:37,493 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40878
+ 2022-02-02 18:08:38,626 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40879
+ 2022-02-02 18:08:40,627 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40880
+ 2022-02-02 18:08:42,628 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40881
+ 2022-02-02 18:08:44,629 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40882
+ 2022-02-02 18:08:46,630 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40883
+ 2022-02-02 18:08:48,631 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40884
+ 2022-02-02 18:08:50,632 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40885
+ 2022-02-02 18:08:52,384 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
40886
+ 2022-02-02 18:08:52,633 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40887
+ 2022-02-02 18:08:52,805 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40888
+ 2022-02-02 18:08:52,805 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40889
+ 2022-02-02 18:08:54,634 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40890
+ 2022-02-02 18:08:56,635 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40891
+ 2022-02-02 18:08:58,636 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40892
+ 2022-02-02 18:09:00,637 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40893
+ 2022-02-02 18:09:02,637 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40894
+ 2022-02-02 18:09:04,638 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40895
+ 2022-02-02 18:09:06,639 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40896
+ 2022-02-02 18:09:08,036 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40897
+ 2022-02-02 18:09:08,036 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40898
+ 2022-02-02 18:09:08,640 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40899
+ 2022-02-02 18:09:10,641 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40900
+ 2022-02-02 18:09:12,642 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40901
+ 2022-02-02 18:09:15,644 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40902
+ 2022-02-02 18:09:17,645 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40903
+ 2022-02-02 18:09:19,645 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40904
+ 2022-02-02 18:09:21,647 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40905
+ 2022-02-02 18:09:23,234 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
40906
+ 2022-02-02 18:09:23,306 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40907
+ 2022-02-02 18:09:23,306 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40908
+ 2022-02-02 18:09:23,648 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40909
+ 2022-02-02 18:09:25,649 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40910
+ 2022-02-02 18:09:27,650 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40911
+ 2022-02-02 18:09:29,651 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40912
+ 2022-02-02 18:09:31,652 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40913
+ 2022-02-02 18:09:33,654 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40914
+ 2022-02-02 18:09:35,655 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40915
+ 2022-02-02 18:09:37,656 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40916
+ 2022-02-02 18:09:38,556 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40917
+ 2022-02-02 18:09:38,556 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40918
+ 2022-02-02 18:09:39,657 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40919
+ 2022-02-02 18:09:41,658 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40920
+ 2022-02-02 18:09:43,659 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40921
+ 2022-02-02 18:09:45,660 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40922
+ 2022-02-02 18:09:47,661 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40923
+ 2022-02-02 18:09:49,662 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40924
+ 2022-02-02 18:09:51,663 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40925
+ 2022-02-02 18:09:53,664 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40926
+ 2022-02-02 18:09:53,981 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40927
+ 2022-02-02 18:09:53,981 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40928
+ 2022-02-02 18:09:54,209 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
40929
+ 2022-02-02 18:09:55,665 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40930
+ 2022-02-02 18:09:57,666 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40931
+ 2022-02-02 18:09:59,667 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40932
+ 2022-02-02 18:10:01,668 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40933
+ 2022-02-02 18:10:03,669 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40934
+ 2022-02-02 18:10:05,670 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40935
+ 2022-02-02 18:10:07,671 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40936
+ 2022-02-02 18:10:09,244 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40937
+ 2022-02-02 18:10:09,244 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40938
+ 2022-02-02 18:10:10,673 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40939
+ 2022-02-02 18:10:12,674 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40940
+ 2022-02-02 18:10:14,675 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40941
+ 2022-02-02 18:10:16,676 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40942
+ 2022-02-02 18:10:18,677 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40943
+ 2022-02-02 18:10:20,678 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40944
+ 2022-02-02 18:10:22,679 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40945
+ 2022-02-02 18:10:24,572 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40946
+ 2022-02-02 18:10:24,572 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40947
+ 2022-02-02 18:10:24,680 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40948
+ 2022-02-02 18:10:24,906 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
40949
+ 2022-02-02 18:10:26,681 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40950
+ 2022-02-02 18:10:28,682 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40951
+ 2022-02-02 18:10:30,683 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40952
+ 2022-02-02 18:10:32,684 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40953
+ 2022-02-02 18:10:34,685 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40954
+ 2022-02-02 18:10:36,686 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40955
+ 2022-02-02 18:10:38,687 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40956
+ 2022-02-02 18:10:39,805 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40957
+ 2022-02-02 18:10:39,806 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40958
+ 2022-02-02 18:10:40,688 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40959
+ 2022-02-02 18:10:42,689 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40960
+ 2022-02-02 18:10:44,690 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40961
+ 2022-02-02 18:10:46,691 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40962
+ 2022-02-02 18:10:48,693 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40963
+ 2022-02-02 18:10:50,694 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40964
+ 2022-02-02 18:10:52,695 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40965
+ 2022-02-02 18:10:54,696 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40966
+ 2022-02-02 18:10:55,316 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40967
+ 2022-02-02 18:10:55,317 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40968
+ 2022-02-02 18:10:55,840 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
40969
+ 2022-02-02 18:10:56,697 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40970
+ 2022-02-02 18:10:58,698 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40971
+ 2022-02-02 18:11:00,699 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40972
+ 2022-02-02 18:11:02,700 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40973
+ 2022-02-02 18:11:04,701 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40974
+ 2022-02-02 18:11:07,702 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40975
+ 2022-02-02 18:11:09,704 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40976
+ 2022-02-02 18:11:10,545 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40977
+ 2022-02-02 18:11:10,546 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40978
+ 2022-02-02 18:11:11,705 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40979
+ 2022-02-02 18:11:13,706 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40980
+ 2022-02-02 18:11:15,707 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40981
+ 2022-02-02 18:11:17,708 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40982
+ 2022-02-02 18:11:19,709 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40983
+ 2022-02-02 18:11:21,710 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40984
+ 2022-02-02 18:11:23,711 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40985
+ 2022-02-02 18:11:25,712 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40986
+ 2022-02-02 18:11:26,045 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40987
+ 2022-02-02 18:11:26,046 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40988
+ 2022-02-02 18:11:26,634 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
40989
+ 2022-02-02 18:11:27,713 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40990
+ 2022-02-02 18:11:29,714 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40991
+ 2022-02-02 18:11:31,716 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40992
+ 2022-02-02 18:11:33,717 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40993
+ 2022-02-02 18:11:35,718 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40994
+ 2022-02-02 18:11:37,719 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40995
+ 2022-02-02 18:11:39,720 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40996
+ 2022-02-02 18:11:41,335 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
40997
+ 2022-02-02 18:11:41,335 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
40998
+ 2022-02-02 18:11:41,721 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
40999
+ 2022-02-02 18:11:43,722 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41000
+ 2022-02-02 18:11:45,723 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41001
+ 2022-02-02 18:11:47,724 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41002
+ 2022-02-02 18:11:49,725 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41003
+ 2022-02-02 18:11:51,726 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41004
+ 2022-02-02 18:11:54,728 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41005
+ 2022-02-02 18:11:56,571 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41006
+ 2022-02-02 18:11:56,572 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41007
+ 2022-02-02 18:11:56,729 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41008
+ 2022-02-02 18:11:57,452 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
41009
+ 2022-02-02 18:11:58,730 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41010
+ 2022-02-02 18:12:00,731 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41011
+ 2022-02-02 18:12:02,732 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41012
+ 2022-02-02 18:12:04,733 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41013
+ 2022-02-02 18:12:06,734 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41014
+ 2022-02-02 18:12:08,735 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41015
+ 2022-02-02 18:12:10,736 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41016
+ 2022-02-02 18:12:11,963 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41017
+ 2022-02-02 18:12:11,963 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41018
+ 2022-02-02 18:12:12,737 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41019
+ 2022-02-02 18:12:14,739 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41020
+ 2022-02-02 18:12:16,740 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41021
+ 2022-02-02 18:12:18,741 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41022
+ 2022-02-02 18:12:20,742 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41023
+ 2022-02-02 18:12:22,742 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41024
+ 2022-02-02 18:12:24,743 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41025
+ 2022-02-02 18:12:26,744 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41026
+ 2022-02-02 18:12:27,236 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41027
+ 2022-02-02 18:12:27,236 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41028
+ 2022-02-02 18:12:28,276 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
41029
+ 2022-02-02 18:12:28,745 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41030
+ 2022-02-02 18:12:30,746 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41031
+ 2022-02-02 18:12:32,747 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41032
+ 2022-02-02 18:12:34,748 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41033
+ 2022-02-02 18:12:36,748 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41034
+ 2022-02-02 18:12:38,749 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41035
+ 2022-02-02 18:12:40,750 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41036
+ 2022-02-02 18:12:42,526 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41037
+ 2022-02-02 18:12:42,527 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41038
+ 2022-02-02 18:12:42,751 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41039
+ 2022-02-02 18:12:44,752 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41040
+ 2022-02-02 18:12:46,753 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41041
+ 2022-02-02 18:12:48,754 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41042
+ 2022-02-02 18:12:50,756 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41043
+ 2022-02-02 18:12:52,757 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41044
+ 2022-02-02 18:12:54,758 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41045
+ 2022-02-02 18:12:56,759 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41046
+ 2022-02-02 18:12:57,809 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41047
+ 2022-02-02 18:12:57,809 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41048
+ 2022-02-02 18:12:58,760 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41049
+ 2022-02-02 18:12:59,087 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
41050
+ 2022-02-02 18:13:00,761 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41051
+ 2022-02-02 18:13:02,762 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41052
+ 2022-02-02 18:13:05,763 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41053
+ 2022-02-02 18:13:07,764 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41054
+ 2022-02-02 18:13:09,765 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41055
+ 2022-02-02 18:13:11,767 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41056
+ 2022-02-02 18:13:13,419 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41057
+ 2022-02-02 18:13:13,419 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41058
+ 2022-02-02 18:13:13,768 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41059
+ 2022-02-02 18:13:15,769 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41060
+ 2022-02-02 18:13:17,770 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41061
+ 2022-02-02 18:13:19,771 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41062
+ 2022-02-02 18:13:21,772 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41063
+ 2022-02-02 18:13:23,773 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41064
+ 2022-02-02 18:13:25,774 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41065
+ 2022-02-02 18:13:27,775 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41066
+ 2022-02-02 18:13:28,726 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41067
+ 2022-02-02 18:13:28,726 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41068
+ 2022-02-02 18:13:29,776 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41069
+ 2022-02-02 18:13:29,877 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
41070
+ 2022-02-02 18:13:31,778 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41071
+ 2022-02-02 18:13:33,779 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41072
+ 2022-02-02 18:13:35,780 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41073
+ 2022-02-02 18:13:37,781 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41074
+ 2022-02-02 18:13:39,782 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41075
+ 2022-02-02 18:13:41,783 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41076
+ 2022-02-02 18:13:43,784 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41077
+ 2022-02-02 18:13:44,029 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41078
+ 2022-02-02 18:13:44,029 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41079
+ 2022-02-02 18:13:45,785 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41080
+ 2022-02-02 18:13:47,786 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41081
+ 2022-02-02 18:13:49,787 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41082
+ 2022-02-02 18:13:51,788 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41083
+ 2022-02-02 18:13:53,789 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41084
+ 2022-02-02 18:13:55,791 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41085
+ 2022-02-02 18:13:57,792 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41086
+ 2022-02-02 18:13:59,340 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41087
+ 2022-02-02 18:13:59,341 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41088
+ 2022-02-02 18:14:00,655 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
41089
+ 2022-02-02 18:14:00,793 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41090
+ 2022-02-02 18:14:02,794 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41091
+ 2022-02-02 18:14:04,795 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41092
+ 2022-02-02 18:14:06,796 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41093
+ 2022-02-02 18:14:08,797 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41094
+ 2022-02-02 18:14:10,799 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41095
+ 2022-02-02 18:14:12,800 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41096
+ 2022-02-02 18:14:14,725 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41097
+ 2022-02-02 18:14:14,726 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41098
+ 2022-02-02 18:14:14,801 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41099
+ 2022-02-02 18:14:16,802 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41100
+ 2022-02-02 18:14:18,803 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41101
+ 2022-02-02 18:14:23,490 DEBUG SenderThread:3357094 [sender.py:send():234] send: history
41102
+ 2022-02-02 18:14:23,510 DEBUG SenderThread:3357094 [sender.py:send():234] send: summary
41103
+ 2022-02-02 18:14:23,538 INFO SenderThread:3357094 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
41104
+ 2022-02-02 18:14:23,805 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/wandb-summary.json
41105
+ 2022-02-02 18:14:24,806 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41106
+ 2022-02-02 18:14:26,807 INFO Thread-8 :3357094 [dir_watcher.py:_on_file_modified():230] file/dir modified: /mnt/lv_ai_1_dante/javierr/wav2vec2-large-voxrex-npsc/wandb/run-20220201_213057-2vounkdu/files/output.log
41107
+ 2022-02-02 18:14:29,976 DEBUG HandlerThread:3357094 [handler.py:handle_request():130] handle_request: stop_status
41108
+ 2022-02-02 18:14:29,978 DEBUG SenderThread:3357094 [sender.py:send_request():248] send_request: stop_status
41109
+ 2022-02-02 18:14:31,442 DEBUG SenderThread:3357094 [sender.py:send():234] send: stats
wandb/run-20220201_213057-2vounkdu/run-2vounkdu.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0e07bdc77192db29bb9f4d632a0df641f86dd1ca7ec9c646780141e83152e148
3
- size 161058289
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b34ed493239966a99df7d8bdc3d1810bb74497a40e601de8ac1ea18a83741a5d
3
+ size 161198012