rlaorrn commited on
Commit
35c352c
1 Parent(s): 966d24c

Training in progress, step 1000

Browse files
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:961dc10472077d0896da30b8695710d2c78ff5b4aa1cdc2ae8b68012760dc1a7
3
  size 377611120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0def9a1a9181c351cf9572140d649ae8913e1524310593099e35cdc790c4805f
3
  size 377611120
runs/May26_14-12-33_142d81d78b72/events.out.tfevents.1716732784.142d81d78b72.34.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8aeb8da49cecff2e3dcb6ae165369cebc8512e825be136aceb15642afc851062
3
- size 6848
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ed60bbf4bf9e1d5df566c116fa18406f772ce3a50a7975b47df3a54d91b7cb2
3
+ size 7377
wandb/debug-internal.log CHANGED
@@ -231,3 +231,149 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
231
  2024-05-26 14:18:59,983 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
232
  2024-05-26 14:19:04,983 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
233
  2024-05-26 14:19:06,561 DEBUG SenderThread:225 [sender.py:send():379] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
231
  2024-05-26 14:18:59,983 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
232
  2024-05-26 14:19:04,983 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
233
  2024-05-26 14:19:06,561 DEBUG SenderThread:225 [sender.py:send():379] send: stats
234
+ 2024-05-26 14:19:08,998 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
235
+ 2024-05-26 14:19:08,999 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
236
+ 2024-05-26 14:19:08,999 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
237
+ 2024-05-26 14:19:10,173 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
238
+ 2024-05-26 14:19:15,182 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
239
+ 2024-05-26 14:19:15,611 INFO Thread-12 :225 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240526_141305-wfyhopk0/files/config.yaml
240
+ 2024-05-26 14:19:20,444 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
241
+ 2024-05-26 14:19:24,110 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
242
+ 2024-05-26 14:19:24,111 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
243
+ 2024-05-26 14:19:24,112 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
244
+ 2024-05-26 14:19:26,358 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
245
+ 2024-05-26 14:19:31,359 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
246
+ 2024-05-26 14:19:36,360 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
247
+ 2024-05-26 14:19:36,561 DEBUG SenderThread:225 [sender.py:send():379] send: stats
248
+ 2024-05-26 14:19:39,080 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
249
+ 2024-05-26 14:19:39,094 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
250
+ 2024-05-26 14:19:39,095 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
251
+ 2024-05-26 14:19:42,342 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
252
+ 2024-05-26 14:19:47,343 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
253
+ 2024-05-26 14:19:52,344 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
254
+ 2024-05-26 14:19:54,133 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
255
+ 2024-05-26 14:19:54,134 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
256
+ 2024-05-26 14:19:54,134 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
257
+ 2024-05-26 14:19:57,378 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
258
+ 2024-05-26 14:20:02,379 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
259
+ 2024-05-26 14:20:06,562 DEBUG SenderThread:225 [sender.py:send():379] send: stats
260
+ 2024-05-26 14:20:07,563 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
261
+ 2024-05-26 14:20:09,161 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
262
+ 2024-05-26 14:20:09,162 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
263
+ 2024-05-26 14:20:09,202 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
264
+ 2024-05-26 14:20:13,403 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
265
+ 2024-05-26 14:20:18,404 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
266
+ 2024-05-26 14:20:23,405 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
267
+ 2024-05-26 14:20:24,256 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
268
+ 2024-05-26 14:20:24,257 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
269
+ 2024-05-26 14:20:24,258 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
270
+ 2024-05-26 14:20:28,448 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
271
+ 2024-05-26 14:20:33,449 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
272
+ 2024-05-26 14:20:36,563 DEBUG SenderThread:225 [sender.py:send():379] send: stats
273
+ 2024-05-26 14:20:38,564 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
274
+ 2024-05-26 14:20:39,217 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
275
+ 2024-05-26 14:20:39,229 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
276
+ 2024-05-26 14:20:39,229 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
277
+ 2024-05-26 14:20:44,376 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
278
+ 2024-05-26 14:20:49,378 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
279
+ 2024-05-26 14:20:54,323 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
280
+ 2024-05-26 14:20:54,324 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
281
+ 2024-05-26 14:20:54,325 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
282
+ 2024-05-26 14:20:54,536 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
283
+ 2024-05-26 14:20:59,537 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
284
+ 2024-05-26 14:21:04,539 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
285
+ 2024-05-26 14:21:06,564 DEBUG SenderThread:225 [sender.py:send():379] send: stats
286
+ 2024-05-26 14:21:09,282 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
287
+ 2024-05-26 14:21:09,282 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
288
+ 2024-05-26 14:21:09,283 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
289
+ 2024-05-26 14:21:10,414 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
290
+ 2024-05-26 14:21:15,415 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
291
+ 2024-05-26 14:21:20,416 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
292
+ 2024-05-26 14:21:24,408 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
293
+ 2024-05-26 14:21:24,408 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
294
+ 2024-05-26 14:21:24,448 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
295
+ 2024-05-26 14:21:25,636 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
296
+ 2024-05-26 14:21:30,637 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
297
+ 2024-05-26 14:21:35,638 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
298
+ 2024-05-26 14:21:36,565 DEBUG SenderThread:225 [sender.py:send():379] send: stats
299
+ 2024-05-26 14:21:39,424 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
300
+ 2024-05-26 14:21:39,425 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
301
+ 2024-05-26 14:21:39,465 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
302
+ 2024-05-26 14:21:41,638 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
303
+ 2024-05-26 14:21:46,639 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
304
+ 2024-05-26 14:21:51,640 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
305
+ 2024-05-26 14:21:54,587 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
306
+ 2024-05-26 14:21:54,588 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
307
+ 2024-05-26 14:21:54,588 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
308
+ 2024-05-26 14:21:56,779 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
309
+ 2024-05-26 14:22:01,780 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
310
+ 2024-05-26 14:22:06,566 DEBUG SenderThread:225 [sender.py:send():379] send: stats
311
+ 2024-05-26 14:22:07,567 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
312
+ 2024-05-26 14:22:09,559 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
313
+ 2024-05-26 14:22:09,560 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
314
+ 2024-05-26 14:22:09,560 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
315
+ 2024-05-26 14:22:12,730 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
316
+ 2024-05-26 14:22:17,730 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
317
+ 2024-05-26 14:22:22,731 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
318
+ 2024-05-26 14:22:24,792 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
319
+ 2024-05-26 14:22:24,794 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
320
+ 2024-05-26 14:22:24,794 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
321
+ 2024-05-26 14:22:28,053 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
322
+ 2024-05-26 14:22:33,054 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
323
+ 2024-05-26 14:22:36,567 DEBUG SenderThread:225 [sender.py:send():379] send: stats
324
+ 2024-05-26 14:22:38,568 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
325
+ 2024-05-26 14:22:39,741 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
326
+ 2024-05-26 14:22:39,742 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
327
+ 2024-05-26 14:22:39,782 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
328
+ 2024-05-26 14:22:43,915 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
329
+ 2024-05-26 14:22:48,916 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
330
+ 2024-05-26 14:22:53,917 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
331
+ 2024-05-26 14:22:54,741 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
332
+ 2024-05-26 14:22:54,741 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
333
+ 2024-05-26 14:22:54,782 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
334
+ 2024-05-26 14:22:59,906 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
335
+ 2024-05-26 14:23:04,907 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
336
+ 2024-05-26 14:23:06,568 DEBUG SenderThread:225 [sender.py:send():379] send: stats
337
+ 2024-05-26 14:23:09,808 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
338
+ 2024-05-26 14:23:09,809 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
339
+ 2024-05-26 14:23:09,849 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
340
+ 2024-05-26 14:23:10,024 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
341
+ 2024-05-26 14:23:15,025 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
342
+ 2024-05-26 14:23:20,026 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
343
+ 2024-05-26 14:23:24,784 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
344
+ 2024-05-26 14:23:24,785 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
345
+ 2024-05-26 14:23:24,826 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
346
+ 2024-05-26 14:23:26,014 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
347
+ 2024-05-26 14:23:31,015 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
348
+ 2024-05-26 14:23:36,016 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
349
+ 2024-05-26 14:23:36,569 DEBUG SenderThread:225 [sender.py:send():379] send: stats
350
+ 2024-05-26 14:23:39,780 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
351
+ 2024-05-26 14:23:39,784 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
352
+ 2024-05-26 14:23:39,784 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
353
+ 2024-05-26 14:23:41,930 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
354
+ 2024-05-26 14:23:46,931 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
355
+ 2024-05-26 14:23:51,933 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
356
+ 2024-05-26 14:23:55,089 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
357
+ 2024-05-26 14:23:55,090 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
358
+ 2024-05-26 14:23:55,091 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
359
+ 2024-05-26 14:23:55,427 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: partial_history
360
+ 2024-05-26 14:23:55,428 DEBUG SenderThread:225 [sender.py:send():379] send: history
361
+ 2024-05-26 14:23:55,428 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: summary_record
362
+ 2024-05-26 14:23:55,429 INFO SenderThread:225 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
363
+ 2024-05-26 14:23:55,720 INFO Thread-12 :225 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240526_141305-wfyhopk0/files/wandb-summary.json
364
+ 2024-05-26 14:23:57,430 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
365
+ 2024-05-26 14:24:02,431 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
366
+ 2024-05-26 14:24:05,670 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: partial_history
367
+ 2024-05-26 14:24:05,672 DEBUG SenderThread:225 [sender.py:send():379] send: history
368
+ 2024-05-26 14:24:05,672 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: summary_record
369
+ 2024-05-26 14:24:05,672 INFO SenderThread:225 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
370
+ 2024-05-26 14:24:05,725 INFO Thread-12 :225 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240526_141305-wfyhopk0/files/wandb-summary.json
371
+ 2024-05-26 14:24:06,569 DEBUG SenderThread:225 [sender.py:send():379] send: stats
372
+ 2024-05-26 14:24:07,570 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
373
+ 2024-05-26 14:24:09,929 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
374
+ 2024-05-26 14:24:09,930 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
375
+ 2024-05-26 14:24:09,931 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
376
+ 2024-05-26 14:24:10,727 INFO Thread-12 :225 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240526_141305-wfyhopk0/files/output.log
377
+ 2024-05-26 14:24:13,110 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
378
+ 2024-05-26 14:24:18,111 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
379
+ 2024-05-26 14:24:23,113 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240526_141305-wfyhopk0/files/config.yaml CHANGED
@@ -70,6 +70,26 @@ _wandb:
70
  5: 1
71
  6:
72
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
73
  return_dict:
74
  desc: null
75
  value: true
 
70
  5: 1
71
  6:
72
  - 1
73
+ - 1: eval/loss
74
+ 5: 1
75
+ 6:
76
+ - 1
77
+ - 1: eval/wer
78
+ 5: 1
79
+ 6:
80
+ - 1
81
+ - 1: eval/runtime
82
+ 5: 1
83
+ 6:
84
+ - 1
85
+ - 1: eval/samples_per_second
86
+ 5: 1
87
+ 6:
88
+ - 1
89
+ - 1: eval/steps_per_second
90
+ 5: 1
91
+ 6:
92
+ - 1
93
  return_dict:
94
  desc: null
95
  value: true
wandb/run-20240526_141305-wfyhopk0/files/output.log CHANGED
@@ -4,4 +4,8 @@
4
  warnings.warn(
5
  /opt/conda/lib/python3.10/site-packages/transformers/models/wav2vec2/processing_wav2vec2.py:156: UserWarning: `as_target_processor` is deprecated and will be removed in v5 of Transformers. You can process your labels by using the argument `text` of the regular `__call__` method (either in the same call as your audio inputs, or in a separate call.
6
  warnings.warn(
 
 
 
 
7
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
 
4
  warnings.warn(
5
  /opt/conda/lib/python3.10/site-packages/transformers/models/wav2vec2/processing_wav2vec2.py:156: UserWarning: `as_target_processor` is deprecated and will be removed in v5 of Transformers. You can process your labels by using the argument `text` of the regular `__call__` method (either in the same call as your audio inputs, or in a separate call.
6
  warnings.warn(
7
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
8
+ warnings.warn(
9
+ /opt/conda/lib/python3.10/site-packages/transformers/models/wav2vec2/processing_wav2vec2.py:156: UserWarning: `as_target_processor` is deprecated and will be removed in v5 of Transformers. You can process your labels by using the argument `text` of the regular `__call__` method (either in the same call as your audio inputs, or in a separate call.
10
+ warnings.warn(
11
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
wandb/run-20240526_141305-wfyhopk0/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 4343.6755, "train/grad_norm": NaN, "train/learning_rate": 3.8e-06, "train/epoch": 5.68, "train/global_step": 500, "_timestamp": 1716733124.540537, "_runtime": 339.51146721839905, "_step": 1, "eval/loss": NaN, "eval/wer": 1.0, "eval/runtime": 10.0932, "eval/samples_per_second": 19.815, "eval/steps_per_second": 2.477}
 
1
+ {"train/loss": 0.0, "train/grad_norm": NaN, "train/learning_rate": 3.8e-06, "train/epoch": 11.36, "train/global_step": 1000, "_timestamp": 1716733445.6703541, "_runtime": 660.6412842273712, "_step": 3, "eval/loss": NaN, "eval/wer": 1.0, "eval/runtime": 10.2398, "eval/samples_per_second": 19.532, "eval/steps_per_second": 2.441}
wandb/run-20240526_141305-wfyhopk0/logs/debug-internal.log CHANGED
@@ -231,3 +231,149 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
231
  2024-05-26 14:18:59,983 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
232
  2024-05-26 14:19:04,983 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
233
  2024-05-26 14:19:06,561 DEBUG SenderThread:225 [sender.py:send():379] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
231
  2024-05-26 14:18:59,983 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
232
  2024-05-26 14:19:04,983 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
233
  2024-05-26 14:19:06,561 DEBUG SenderThread:225 [sender.py:send():379] send: stats
234
+ 2024-05-26 14:19:08,998 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
235
+ 2024-05-26 14:19:08,999 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
236
+ 2024-05-26 14:19:08,999 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
237
+ 2024-05-26 14:19:10,173 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
238
+ 2024-05-26 14:19:15,182 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
239
+ 2024-05-26 14:19:15,611 INFO Thread-12 :225 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240526_141305-wfyhopk0/files/config.yaml
240
+ 2024-05-26 14:19:20,444 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
241
+ 2024-05-26 14:19:24,110 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
242
+ 2024-05-26 14:19:24,111 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
243
+ 2024-05-26 14:19:24,112 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
244
+ 2024-05-26 14:19:26,358 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
245
+ 2024-05-26 14:19:31,359 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
246
+ 2024-05-26 14:19:36,360 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
247
+ 2024-05-26 14:19:36,561 DEBUG SenderThread:225 [sender.py:send():379] send: stats
248
+ 2024-05-26 14:19:39,080 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
249
+ 2024-05-26 14:19:39,094 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
250
+ 2024-05-26 14:19:39,095 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
251
+ 2024-05-26 14:19:42,342 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
252
+ 2024-05-26 14:19:47,343 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
253
+ 2024-05-26 14:19:52,344 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
254
+ 2024-05-26 14:19:54,133 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
255
+ 2024-05-26 14:19:54,134 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
256
+ 2024-05-26 14:19:54,134 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
257
+ 2024-05-26 14:19:57,378 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
258
+ 2024-05-26 14:20:02,379 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
259
+ 2024-05-26 14:20:06,562 DEBUG SenderThread:225 [sender.py:send():379] send: stats
260
+ 2024-05-26 14:20:07,563 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
261
+ 2024-05-26 14:20:09,161 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
262
+ 2024-05-26 14:20:09,162 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
263
+ 2024-05-26 14:20:09,202 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
264
+ 2024-05-26 14:20:13,403 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
265
+ 2024-05-26 14:20:18,404 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
266
+ 2024-05-26 14:20:23,405 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
267
+ 2024-05-26 14:20:24,256 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
268
+ 2024-05-26 14:20:24,257 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
269
+ 2024-05-26 14:20:24,258 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
270
+ 2024-05-26 14:20:28,448 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
271
+ 2024-05-26 14:20:33,449 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
272
+ 2024-05-26 14:20:36,563 DEBUG SenderThread:225 [sender.py:send():379] send: stats
273
+ 2024-05-26 14:20:38,564 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
274
+ 2024-05-26 14:20:39,217 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
275
+ 2024-05-26 14:20:39,229 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
276
+ 2024-05-26 14:20:39,229 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
277
+ 2024-05-26 14:20:44,376 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
278
+ 2024-05-26 14:20:49,378 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
279
+ 2024-05-26 14:20:54,323 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
280
+ 2024-05-26 14:20:54,324 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
281
+ 2024-05-26 14:20:54,325 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
282
+ 2024-05-26 14:20:54,536 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
283
+ 2024-05-26 14:20:59,537 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
284
+ 2024-05-26 14:21:04,539 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
285
+ 2024-05-26 14:21:06,564 DEBUG SenderThread:225 [sender.py:send():379] send: stats
286
+ 2024-05-26 14:21:09,282 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
287
+ 2024-05-26 14:21:09,282 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
288
+ 2024-05-26 14:21:09,283 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
289
+ 2024-05-26 14:21:10,414 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
290
+ 2024-05-26 14:21:15,415 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
291
+ 2024-05-26 14:21:20,416 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
292
+ 2024-05-26 14:21:24,408 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
293
+ 2024-05-26 14:21:24,408 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
294
+ 2024-05-26 14:21:24,448 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
295
+ 2024-05-26 14:21:25,636 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
296
+ 2024-05-26 14:21:30,637 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
297
+ 2024-05-26 14:21:35,638 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
298
+ 2024-05-26 14:21:36,565 DEBUG SenderThread:225 [sender.py:send():379] send: stats
299
+ 2024-05-26 14:21:39,424 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
300
+ 2024-05-26 14:21:39,425 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
301
+ 2024-05-26 14:21:39,465 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
302
+ 2024-05-26 14:21:41,638 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
303
+ 2024-05-26 14:21:46,639 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
304
+ 2024-05-26 14:21:51,640 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
305
+ 2024-05-26 14:21:54,587 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
306
+ 2024-05-26 14:21:54,588 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
307
+ 2024-05-26 14:21:54,588 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
308
+ 2024-05-26 14:21:56,779 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
309
+ 2024-05-26 14:22:01,780 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
310
+ 2024-05-26 14:22:06,566 DEBUG SenderThread:225 [sender.py:send():379] send: stats
311
+ 2024-05-26 14:22:07,567 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
312
+ 2024-05-26 14:22:09,559 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
313
+ 2024-05-26 14:22:09,560 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
314
+ 2024-05-26 14:22:09,560 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
315
+ 2024-05-26 14:22:12,730 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
316
+ 2024-05-26 14:22:17,730 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
317
+ 2024-05-26 14:22:22,731 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
318
+ 2024-05-26 14:22:24,792 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
319
+ 2024-05-26 14:22:24,794 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
320
+ 2024-05-26 14:22:24,794 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
321
+ 2024-05-26 14:22:28,053 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
322
+ 2024-05-26 14:22:33,054 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
323
+ 2024-05-26 14:22:36,567 DEBUG SenderThread:225 [sender.py:send():379] send: stats
324
+ 2024-05-26 14:22:38,568 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
325
+ 2024-05-26 14:22:39,741 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
326
+ 2024-05-26 14:22:39,742 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
327
+ 2024-05-26 14:22:39,782 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
328
+ 2024-05-26 14:22:43,915 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
329
+ 2024-05-26 14:22:48,916 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
330
+ 2024-05-26 14:22:53,917 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
331
+ 2024-05-26 14:22:54,741 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
332
+ 2024-05-26 14:22:54,741 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
333
+ 2024-05-26 14:22:54,782 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
334
+ 2024-05-26 14:22:59,906 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
335
+ 2024-05-26 14:23:04,907 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
336
+ 2024-05-26 14:23:06,568 DEBUG SenderThread:225 [sender.py:send():379] send: stats
337
+ 2024-05-26 14:23:09,808 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
338
+ 2024-05-26 14:23:09,809 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
339
+ 2024-05-26 14:23:09,849 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
340
+ 2024-05-26 14:23:10,024 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
341
+ 2024-05-26 14:23:15,025 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
342
+ 2024-05-26 14:23:20,026 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
343
+ 2024-05-26 14:23:24,784 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
344
+ 2024-05-26 14:23:24,785 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
345
+ 2024-05-26 14:23:24,826 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
346
+ 2024-05-26 14:23:26,014 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
347
+ 2024-05-26 14:23:31,015 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
348
+ 2024-05-26 14:23:36,016 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
349
+ 2024-05-26 14:23:36,569 DEBUG SenderThread:225 [sender.py:send():379] send: stats
350
+ 2024-05-26 14:23:39,780 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
351
+ 2024-05-26 14:23:39,784 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
352
+ 2024-05-26 14:23:39,784 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
353
+ 2024-05-26 14:23:41,930 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
354
+ 2024-05-26 14:23:46,931 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
355
+ 2024-05-26 14:23:51,933 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
356
+ 2024-05-26 14:23:55,089 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
357
+ 2024-05-26 14:23:55,090 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
358
+ 2024-05-26 14:23:55,091 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
359
+ 2024-05-26 14:23:55,427 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: partial_history
360
+ 2024-05-26 14:23:55,428 DEBUG SenderThread:225 [sender.py:send():379] send: history
361
+ 2024-05-26 14:23:55,428 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: summary_record
362
+ 2024-05-26 14:23:55,429 INFO SenderThread:225 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
363
+ 2024-05-26 14:23:55,720 INFO Thread-12 :225 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240526_141305-wfyhopk0/files/wandb-summary.json
364
+ 2024-05-26 14:23:57,430 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
365
+ 2024-05-26 14:24:02,431 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
366
+ 2024-05-26 14:24:05,670 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: partial_history
367
+ 2024-05-26 14:24:05,672 DEBUG SenderThread:225 [sender.py:send():379] send: history
368
+ 2024-05-26 14:24:05,672 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: summary_record
369
+ 2024-05-26 14:24:05,672 INFO SenderThread:225 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
370
+ 2024-05-26 14:24:05,725 INFO Thread-12 :225 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240526_141305-wfyhopk0/files/wandb-summary.json
371
+ 2024-05-26 14:24:06,569 DEBUG SenderThread:225 [sender.py:send():379] send: stats
372
+ 2024-05-26 14:24:07,570 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
373
+ 2024-05-26 14:24:09,929 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: internal_messages
374
+ 2024-05-26 14:24:09,930 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: stop_status
375
+ 2024-05-26 14:24:09,931 DEBUG SenderThread:225 [sender.py:send_request():406] send_request: stop_status
376
+ 2024-05-26 14:24:10,727 INFO Thread-12 :225 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240526_141305-wfyhopk0/files/output.log
377
+ 2024-05-26 14:24:13,110 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
378
+ 2024-05-26 14:24:18,111 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
379
+ 2024-05-26 14:24:23,113 DEBUG HandlerThread:225 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240526_141305-wfyhopk0/run-wfyhopk0.wandb CHANGED
Binary files a/wandb/run-20240526_141305-wfyhopk0/run-wfyhopk0.wandb and b/wandb/run-20240526_141305-wfyhopk0/run-wfyhopk0.wandb differ