Commit
•
c0d3318
1
Parent(s):
b3823b7
Training in progress, step 500
Browse files- .gitattributes +1 -0
- pytorch_model.bin +1 -1
- training_args.bin +1 -1
- wandb/debug-internal.log +1 -1
- wandb/debug.log +1 -1
- wandb/latest-run +1 -1
- wandb/run-20220228_093705-yn2gmwrw/files/config.yaml +7 -0
- wandb/run-20220228_093705-yn2gmwrw/files/output.log +7 -0
- wandb/run-20220228_093705-yn2gmwrw/files/wandb-summary.json +0 -0
- wandb/run-20220228_093705-yn2gmwrw/logs/debug-internal.log +116 -0
- wandb/run-20220228_093705-yn2gmwrw/logs/debug.log +106 -0
- wandb/run-20220228_093705-yn2gmwrw/run-yn2gmwrw.wandb +2 -2
- wandb/run-20220228_122826-3vepvy3m/files/config.yaml +0 -0
- wandb/run-20220228_122826-3vepvy3m/files/output.log +0 -0
- wandb/run-20220228_122826-3vepvy3m/files/requirements.txt +184 -0
- wandb/run-20220228_122826-3vepvy3m/files/wandb-metadata.json +60 -0
- wandb/run-20220228_122826-3vepvy3m/files/wandb-summary.json +0 -0
- wandb/run-20220228_122826-3vepvy3m/logs/debug-internal.log +0 -0
- wandb/run-20220228_122826-3vepvy3m/logs/debug.log +26 -0
- wandb/run-20220228_122826-3vepvy3m/run-3vepvy3m.wandb +3 -0
.gitattributes
CHANGED
@@ -26,3 +26,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
26 |
*.zstandard filter=lfs diff=lfs merge=lfs -text
|
27 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
28 |
wandb/run-20220228_093705-yn2gmwrw/run-yn2gmwrw.wandb filter=lfs diff=lfs merge=lfs -text
|
|
26 |
*.zstandard filter=lfs diff=lfs merge=lfs -text
|
27 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
28 |
wandb/run-20220228_093705-yn2gmwrw/run-yn2gmwrw.wandb filter=lfs diff=lfs merge=lfs -text
|
29 |
+
wandb/run-20220228_122826-3vepvy3m/run-3vepvy3m.wandb filter=lfs diff=lfs merge=lfs -text
|
pytorch_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 3210531882
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:37c5284c293184dd63cdc3a064aba2de1f795a3ff8c9d3ceb701c6f9531cb2d4
|
3 |
size 3210531882
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 3119
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0d21185bc901c23ad3c01a41bca0ef40c7574d24f4ecc76ce739b2a6bed3be6e
|
3 |
size 3119
|
wandb/debug-internal.log
CHANGED
@@ -1 +1 @@
|
|
1 |
-
run-
|
1 |
+
run-20220228_122826-3vepvy3m/logs/debug-internal.log
|
wandb/debug.log
CHANGED
@@ -1 +1 @@
|
|
1 |
-
run-
|
1 |
+
run-20220228_122826-3vepvy3m/logs/debug.log
|
wandb/latest-run
CHANGED
@@ -1 +1 @@
|
|
1 |
-
run-
|
1 |
+
run-20220228_122826-3vepvy3m
|
wandb/run-20220228_093705-yn2gmwrw/files/config.yaml
CHANGED
@@ -10673,7 +10673,14 @@ _wandb:
|
|
10673 |
- 1
|
10674 |
- 5
|
10675 |
- 11
|
|
|
|
|
|
|
|
|
|
|
10676 |
3:
|
|
|
|
|
10677 |
- 13
|
10678 |
4: 3.9.5
|
10679 |
5: 0.12.10
|
10673 |
- 1
|
10674 |
- 5
|
10675 |
- 11
|
10676 |
+
2:
|
10677 |
+
- 1
|
10678 |
+
- 5
|
10679 |
+
- 11
|
10680 |
+
- 12
|
10681 |
3:
|
10682 |
+
- 1
|
10683 |
+
- 7
|
10684 |
- 13
|
10685 |
4: 3.9.5
|
10686 |
5: 0.12.10
|
wandb/run-20220228_093705-yn2gmwrw/files/output.log
CHANGED
@@ -5936,3 +5936,10 @@ Upload file wandb/run-20220228_093705-yn2gmwrw/run-yn2gmwrw.wandb: 65%|██
|
|
5936 |
eval_steps_per_second = 0.287
|
5937 |
[INFO|trainer.py:2114] 2022-02-28 12:26:01,469 >> Saving model checkpoint to ./ | 3/331 [00:05<11:09, 2.04s/it] argument in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
5938 |
[INFO|modeling_utils.py:1081] 2022-02-28 12:26:18,192 >> Model weights saved in ./pytorch_model.bin:05<11:09, 2.04s/it] argument in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5936 |
eval_steps_per_second = 0.287
|
5937 |
[INFO|trainer.py:2114] 2022-02-28 12:26:01,469 >> Saving model checkpoint to ./ | 3/331 [00:05<11:09, 2.04s/it] argument in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
5938 |
[INFO|modeling_utils.py:1081] 2022-02-28 12:26:18,192 >> Model weights saved in ./pytorch_model.bin:05<11:09, 2.04s/it] argument in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
5939 |
+
Upload file wandb/run-20220228_093705-yn2gmwrw/run-yn2gmwrw.wandb: 27%|███ | 14.5M/53.1M [00:01<00:02, 15.2MB/s] argument in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
5940 |
+
Upload file wandb/run-20220228_093705-yn2gmwrw/run-yn2gmwrw.wandb: 27%|███ | 14.5M/53.1M [00:01<00:02, 15.2MB/s] argument in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
5941 |
+
02/28/2022 12:26:49 - WARNING - huggingface_hub.repository - To https://huggingface.co/sanchit-gandhi/wav2vec2-gpt2-wandb-grid-search
|
5942 |
+
Upload file wandb/run-20220228_093705-yn2gmwrw/run-yn2gmwrw.wandb: 100%|███████████| 53.1M/53.1M [00:03<00:00, 18.5MB/s] argument in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
5943 |
+
return ModelInfo(**d)f.finetuned_from)formers/src/transformers/modelcard.py", line 611, in from_trainercard31, in mainule>ent in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
5944 |
+
return ModelInfo(**d)f.finetuned_from)formers/src/transformers/modelcard.py", line 611, in from_trainercard31, in mainule>ent in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
5945 |
+
return ModelInfo(**d)f.finetuned_from)formers/src/transformers/modelcard.py", line 611, in from_trainercard31, in mainule>ent in `SpeechEncoderDecoderModel.forward` and have been ignored: input_length. If input_length are not expected by `SpeechEncoderDecoderModel.forward`, you can safely ignore this message.
|
wandb/run-20220228_093705-yn2gmwrw/files/wandb-summary.json
CHANGED
The diff for this file is too large to render.
See raw diff
|
wandb/run-20220228_093705-yn2gmwrw/logs/debug-internal.log
CHANGED
@@ -16373,3 +16373,119 @@
|
|
16373 |
2022-02-28 12:26:22,723 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: stop_status
|
16374 |
2022-02-28 12:26:37,775 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: stop_status
|
16375 |
2022-02-28 12:26:37,775 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: stop_status
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16373 |
2022-02-28 12:26:22,723 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: stop_status
|
16374 |
2022-02-28 12:26:37,775 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: stop_status
|
16375 |
2022-02-28 12:26:37,775 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: stop_status
|
16376 |
+
2022-02-28 12:26:48,430 INFO Thread-8 :219340 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/output.log
|
16377 |
+
2022-02-28 12:26:49,430 DEBUG SenderThread:219340 [sender.py:send():235] send: stats
|
16378 |
+
2022-02-28 12:26:50,432 INFO Thread-8 :219340 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/output.log
|
16379 |
+
2022-02-28 12:26:52,828 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: stop_status
|
16380 |
+
2022-02-28 12:26:52,829 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: stop_status
|
16381 |
+
2022-02-28 12:26:54,434 INFO Thread-8 :219340 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/output.log
|
16382 |
+
2022-02-28 12:26:55,366 DEBUG SenderThread:219340 [sender.py:send():235] send: telemetry
|
16383 |
+
2022-02-28 12:26:55,366 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16384 |
+
2022-02-28 12:26:55,366 DEBUG SenderThread:219340 [sender.py:send():235] send: exit
|
16385 |
+
2022-02-28 12:26:55,367 INFO SenderThread:219340 [sender.py:send_exit():371] handling exit code: 1
|
16386 |
+
2022-02-28 12:26:55,367 INFO SenderThread:219340 [sender.py:send_exit():373] handling runtime: 10188
|
16387 |
+
2022-02-28 12:26:55,422 INFO SenderThread:219340 [sender.py:_save_file():944] saving file wandb-summary.json with policy end
|
16388 |
+
2022-02-28 12:26:55,423 INFO SenderThread:219340 [sender.py:send_exit():379] send defer
|
16389 |
+
2022-02-28 12:26:55,423 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16390 |
+
2022-02-28 12:26:55,424 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16391 |
+
2022-02-28 12:26:55,424 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 0
|
16392 |
+
2022-02-28 12:26:55,424 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16393 |
+
2022-02-28 12:26:55,424 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 0
|
16394 |
+
2022-02-28 12:26:55,424 INFO SenderThread:219340 [sender.py:transition_state():392] send defer: 1
|
16395 |
+
2022-02-28 12:26:55,424 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16396 |
+
2022-02-28 12:26:55,424 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 1
|
16397 |
+
2022-02-28 12:26:55,435 INFO Thread-8 :219340 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/output.log
|
16398 |
+
2022-02-28 12:26:55,435 INFO Thread-8 :219340 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/wandb-summary.json
|
16399 |
+
2022-02-28 12:26:55,541 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16400 |
+
2022-02-28 12:26:55,541 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16401 |
+
2022-02-28 12:26:55,542 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 1
|
16402 |
+
2022-02-28 12:26:55,542 INFO SenderThread:219340 [sender.py:transition_state():392] send defer: 2
|
16403 |
+
2022-02-28 12:26:55,542 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16404 |
+
2022-02-28 12:26:55,542 DEBUG SenderThread:219340 [sender.py:send():235] send: stats
|
16405 |
+
2022-02-28 12:26:55,543 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16406 |
+
2022-02-28 12:26:55,543 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 2
|
16407 |
+
2022-02-28 12:26:55,543 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16408 |
+
2022-02-28 12:26:55,543 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 2
|
16409 |
+
2022-02-28 12:26:55,544 INFO SenderThread:219340 [sender.py:transition_state():392] send defer: 3
|
16410 |
+
2022-02-28 12:26:55,544 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16411 |
+
2022-02-28 12:26:55,544 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 3
|
16412 |
+
2022-02-28 12:26:55,602 DEBUG SenderThread:219340 [sender.py:send():235] send: summary
|
16413 |
+
2022-02-28 12:26:55,695 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16414 |
+
2022-02-28 12:26:55,699 INFO SenderThread:219340 [sender.py:_save_file():944] saving file wandb-summary.json with policy end
|
16415 |
+
2022-02-28 12:26:55,699 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16416 |
+
2022-02-28 12:26:55,699 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 3
|
16417 |
+
2022-02-28 12:26:55,699 INFO SenderThread:219340 [sender.py:transition_state():392] send defer: 4
|
16418 |
+
2022-02-28 12:26:55,700 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16419 |
+
2022-02-28 12:26:55,700 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16420 |
+
2022-02-28 12:26:55,700 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 4
|
16421 |
+
2022-02-28 12:26:55,700 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16422 |
+
2022-02-28 12:26:55,701 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 4
|
16423 |
+
2022-02-28 12:26:55,801 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16424 |
+
2022-02-28 12:26:56,501 INFO Thread-8 :219340 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/wandb-summary.json
|
16425 |
+
2022-02-28 12:26:56,587 INFO SenderThread:219340 [sender.py:transition_state():392] send defer: 5
|
16426 |
+
2022-02-28 12:26:56,587 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16427 |
+
2022-02-28 12:26:56,588 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16428 |
+
2022-02-28 12:26:56,588 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 5
|
16429 |
+
2022-02-28 12:26:56,588 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16430 |
+
2022-02-28 12:26:56,589 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 5
|
16431 |
+
2022-02-28 12:26:56,589 INFO SenderThread:219340 [dir_watcher.py:finish():283] shutting down directory watcher
|
16432 |
+
2022-02-28 12:26:56,689 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16433 |
+
2022-02-28 12:26:57,492 INFO Thread-8 :219340 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/config.yaml
|
16434 |
+
2022-02-28 12:26:57,492 INFO SenderThread:219340 [dir_watcher.py:finish():313] scan: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files
|
16435 |
+
2022-02-28 12:26:57,493 INFO SenderThread:219340 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/wandb-metadata.json wandb-metadata.json
|
16436 |
+
2022-02-28 12:26:57,493 INFO SenderThread:219340 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/output.log output.log
|
16437 |
+
2022-02-28 12:26:57,493 INFO SenderThread:219340 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/wandb-summary.json wandb-summary.json
|
16438 |
+
2022-02-28 12:26:57,496 INFO SenderThread:219340 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/requirements.txt requirements.txt
|
16439 |
+
2022-02-28 12:26:57,496 INFO SenderThread:219340 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/config.yaml config.yaml
|
16440 |
+
2022-02-28 12:26:57,499 INFO SenderThread:219340 [sender.py:transition_state():392] send defer: 6
|
16441 |
+
2022-02-28 12:26:57,499 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16442 |
+
2022-02-28 12:26:57,505 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16443 |
+
2022-02-28 12:26:57,505 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 6
|
16444 |
+
2022-02-28 12:26:57,506 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16445 |
+
2022-02-28 12:26:57,506 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 6
|
16446 |
+
2022-02-28 12:26:57,506 INFO SenderThread:219340 [file_pusher.py:finish():177] shutting down file pusher
|
16447 |
+
2022-02-28 12:26:57,601 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16448 |
+
2022-02-28 12:26:57,601 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16449 |
+
2022-02-28 12:26:57,703 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16450 |
+
2022-02-28 12:26:57,704 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16451 |
+
2022-02-28 12:26:57,799 INFO Thread-15 :219340 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/config.yaml
|
16452 |
+
2022-02-28 12:26:57,805 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16453 |
+
2022-02-28 12:26:57,806 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16454 |
+
2022-02-28 12:26:57,839 INFO Thread-14 :219340 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/requirements.txt
|
16455 |
+
2022-02-28 12:26:57,841 INFO Thread-12 :219340 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/output.log
|
16456 |
+
2022-02-28 12:26:57,858 INFO Thread-13 :219340 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/files/wandb-summary.json
|
16457 |
+
2022-02-28 12:26:57,907 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16458 |
+
2022-02-28 12:26:57,908 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16459 |
+
2022-02-28 12:26:58,009 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16460 |
+
2022-02-28 12:26:58,010 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16461 |
+
2022-02-28 12:26:58,059 INFO Thread-7 :219340 [sender.py:transition_state():392] send defer: 7
|
16462 |
+
2022-02-28 12:26:58,060 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16463 |
+
2022-02-28 12:26:58,060 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 7
|
16464 |
+
2022-02-28 12:26:58,060 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16465 |
+
2022-02-28 12:26:58,060 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 7
|
16466 |
+
2022-02-28 12:26:58,111 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16467 |
+
2022-02-28 12:26:59,338 INFO SenderThread:219340 [sender.py:transition_state():392] send defer: 8
|
16468 |
+
2022-02-28 12:26:59,338 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16469 |
+
2022-02-28 12:26:59,339 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16470 |
+
2022-02-28 12:26:59,339 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 8
|
16471 |
+
2022-02-28 12:26:59,339 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16472 |
+
2022-02-28 12:26:59,339 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 8
|
16473 |
+
2022-02-28 12:26:59,339 INFO SenderThread:219340 [sender.py:transition_state():392] send defer: 9
|
16474 |
+
2022-02-28 12:26:59,340 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: defer
|
16475 |
+
2022-02-28 12:26:59,340 INFO HandlerThread:219340 [handler.py:handle_request_defer():154] handle defer: 9
|
16476 |
+
2022-02-28 12:26:59,340 DEBUG SenderThread:219340 [sender.py:send():235] send: final
|
16477 |
+
2022-02-28 12:26:59,340 DEBUG SenderThread:219340 [sender.py:send():235] send: footer
|
16478 |
+
2022-02-28 12:26:59,340 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: defer
|
16479 |
+
2022-02-28 12:26:59,341 INFO SenderThread:219340 [sender.py:send_request_defer():388] handle sender defer: 9
|
16480 |
+
2022-02-28 12:26:59,440 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: poll_exit
|
16481 |
+
2022-02-28 12:26:59,441 DEBUG SenderThread:219340 [sender.py:send_request():249] send_request: poll_exit
|
16482 |
+
2022-02-28 12:26:59,441 INFO SenderThread:219340 [file_pusher.py:join():182] waiting for file pusher
|
16483 |
+
2022-02-28 12:26:59,525 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: get_summary
|
16484 |
+
2022-02-28 12:26:59,629 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: sampled_history
|
16485 |
+
2022-02-28 12:26:59,632 DEBUG HandlerThread:219340 [handler.py:handle_request():131] handle_request: shutdown
|
16486 |
+
2022-02-28 12:26:59,632 INFO HandlerThread:219340 [handler.py:finish():739] shutting down handler
|
16487 |
+
2022-02-28 12:27:00,342 INFO WriterThread:219340 [datastore.py:close():281] close: /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_093705-yn2gmwrw/run-yn2gmwrw.wandb
|
16488 |
+
2022-02-28 12:27:00,523 INFO SenderThread:219340 [sender.py:finish():1075] shutting down sender
|
16489 |
+
2022-02-28 12:27:00,524 INFO SenderThread:219340 [file_pusher.py:finish():177] shutting down file pusher
|
16490 |
+
2022-02-28 12:27:00,524 INFO SenderThread:219340 [file_pusher.py:join():182] waiting for file pusher
|
16491 |
+
2022-02-28 12:27:00,608 INFO MainThread:219340 [internal.py:handle_exit():79] Internal process exited
|
wandb/run-20220228_093705-yn2gmwrw/logs/debug.log
CHANGED
@@ -25,3 +25,109 @@ config: {}
|
|
25 |
2022-02-28 09:37:06,925 INFO MainThread:219058 [wandb_init.py:init():651] run started, returning control to user process
|
26 |
2022-02-28 09:37:06,927 INFO MainThread:219058 [wandb_run.py:_config_callback():966] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'torch.float32', 'use_bfloat16': False, 'pruned_heads': {}, 'tie_word_embeddings': False, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 50, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'architectures': ['SpeechEncoderDecoderModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 50256, 'eos_token_id': 50256, 'sep_token_id': None, 'decoder_start_token_id': 50256, 'task_specific_params': None, 'problem_type': None, '_name_or_path': './', 'transformers_version': None, 'decoder': {'vocab_size': 50257, 'n_positions': 1024, 'n_embd': 1024, 'n_layer': 24, 'n_head': 16, 'n_inner': None, 'activation_function': 'gelu_new', 'resid_pdrop': 0.0, 'embd_pdrop': 0.0, 'attn_pdrop': 0.0, 'layer_norm_epsilon': 1e-05, 'initializer_range': 0.02, 'summary_type': 'cls_index', 'summary_use_proj': True, 'summary_activation': None, 'summary_first_dropout': 0.0, 'summary_proj_to_labels': True, 'scale_attn_weights': True, 'use_cache': False, 'scale_attn_by_inverse_layer_idx': False, 'reorder_and_upcast_attn': False, 'bos_token_id': 50256, 'eos_token_id': 50256, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': True, 'cross_attention_hidden_size': None, 'add_cross_attention': True, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'architectures': ['GPT2LMHeadModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'pad_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': {'text-generation': {'do_sample': True, 'max_length': 50}}, 'problem_type': None, '_name_or_path': 'gpt2-medium', 'transformers_version': '4.17.0.dev0', 'n_ctx': 1024, 'n_special': 0, 'predict_special_tokens': True, 'model_type': 'gpt2'}, 'encoder': {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'architectures': ['Wav2Vec2ForPreTraining'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 1, 'pad_token_id': 0, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'facebook/wav2vec2-large-lv60', 'transformers_version': '4.17.0.dev0', 'feat_extract_dropout': 0.0, 'gradient_checkpointing': False, 'hidden_dropout_prob': 0.0, 'num_feat_extract_layers': 7, 'hidden_size': 1024, 'feat_extract_norm': 'layer', 'feat_extract_activation': 'gelu', 'conv_dim': [512, 512, 512, 512, 512, 512, 512], 'conv_stride': [5, 2, 2, 2, 2, 2, 2], 'conv_kernel': [10, 3, 3, 3, 3, 2, 2], 'conv_bias': True, 'num_conv_pos_embeddings': 128, 'num_conv_pos_embedding_groups': 16, 'num_hidden_layers': 24, 'intermediate_size': 4096, 'hidden_act': 'gelu', 'num_attention_heads': 16, 'hidden_dropout': 0.0, 'attention_dropout': 0.0, 'activation_dropout': 0.0, 'feat_proj_dropout': 0.0, 'final_dropout': 0.0, 'layerdrop': 0.0, 'layer_norm_eps': 1e-05, 'initializer_range': 0.02, 'vocab_size': 32, 'do_stable_layer_norm': True, 'use_weighted_layer_sum': False, 'apply_spec_augment': False, 'mask_time_prob': 0.0, 'mask_time_length': 10, 'mask_time_min_masks': 2, 'mask_feature_prob': 0.0, 'mask_feature_length': 10, 'mask_feature_min_masks': 0, 'num_codevectors_per_group': 320, 'num_codevector_groups': 2, 'contrastive_logits_temperature': 0.1, 'feat_quantizer_dropout': 0.0, 'num_negatives': 100, 'codevector_dim': 768, 'proj_codevector_dim': 768, 'diversity_loss_weight': 0.1, 'ctc_loss_reduction': 'sum', 'ctc_zero_infinity': False, 'add_adapter': True, 'adapter_kernel_size': 3, 'adapter_stride': 2, 'num_adapter_layers': 3, 'output_hidden_size': 1024, 'classifier_proj_size': 256, 'tdnn_dim': [512, 512, 512, 512, 1500], 'tdnn_kernel': [5, 3, 3, 1, 1], 'tdnn_dilation': [1, 2, 3, 1, 1], 'xvector_output_dim': 512, 'model_type': 'wav2vec2'}, 'model_type': 'speech-encoder-decoder', 'processor_class': 'Wav2Vec2Processor', 'use_cache': False, 'output_dir': './', 'overwrite_output_dir': True, 'do_train': True, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'steps', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': 'None', 'per_gpu_eval_batch_size': 'None', 'gradient_accumulation_steps': 2, 'eval_accumulation_steps': 'None', 'learning_rate': 1e-05, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 1.0, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'warmup_ratio': 0.0, 'warmup_steps': 500, 'log_level': -1, 'log_level_replica': -1, 'log_on_each_node': True, 'logging_dir': './runs/Feb28_09-34-39_sanchit--v100', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 1, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 1, 'save_on_each_node': False, 'no_cuda': False, 'seed': 42, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'amp', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': 'None', 'local_rank': -1, 'xpu_backend': 'None', 'tpu_num_cores': 'None', 'tpu_metrics_debug': False, 'debug': '[]', 'dataloader_drop_last': False, 'eval_steps': 500, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': './', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': 'None', 'load_best_model_at_end': False, 'metric_for_best_model': 'None', 'greater_is_better': 'None', 'ignore_data_skip': False, 'sharded_ddp': '[]', 'deepspeed': 'None', 'label_smoothing_factor': 0.0, 'optim': 'adamw_hf', 'adafactor': False, 'group_by_length': True, 'length_column_name': 'input_length', 'report_to': "['wandb']", 'ddp_find_unused_parameters': 'None', 'ddp_bucket_cap_mb': 'None', 'dataloader_pin_memory': True, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': 'None', 'hub_model_id': 'None', 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'gradient_checkpointing': True, 'fp16_backend': 'auto', 'push_to_hub_model_id': 'None', 'push_to_hub_organization': 'None', 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', '_n_gpu': 1, 'mp_parameters': '', 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': 40, 'generation_num_beams': 1, 'train_batch_size': 8, 'eval_batch_size': 8}
|
27 |
2022-02-28 09:37:06,930 INFO MainThread:219058 [wandb_watch.py:watch():43] Watching
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
25 |
2022-02-28 09:37:06,925 INFO MainThread:219058 [wandb_init.py:init():651] run started, returning control to user process
|
26 |
2022-02-28 09:37:06,927 INFO MainThread:219058 [wandb_run.py:_config_callback():966] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'torch.float32', 'use_bfloat16': False, 'pruned_heads': {}, 'tie_word_embeddings': False, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 50, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'architectures': ['SpeechEncoderDecoderModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 50256, 'eos_token_id': 50256, 'sep_token_id': None, 'decoder_start_token_id': 50256, 'task_specific_params': None, 'problem_type': None, '_name_or_path': './', 'transformers_version': None, 'decoder': {'vocab_size': 50257, 'n_positions': 1024, 'n_embd': 1024, 'n_layer': 24, 'n_head': 16, 'n_inner': None, 'activation_function': 'gelu_new', 'resid_pdrop': 0.0, 'embd_pdrop': 0.0, 'attn_pdrop': 0.0, 'layer_norm_epsilon': 1e-05, 'initializer_range': 0.02, 'summary_type': 'cls_index', 'summary_use_proj': True, 'summary_activation': None, 'summary_first_dropout': 0.0, 'summary_proj_to_labels': True, 'scale_attn_weights': True, 'use_cache': False, 'scale_attn_by_inverse_layer_idx': False, 'reorder_and_upcast_attn': False, 'bos_token_id': 50256, 'eos_token_id': 50256, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': True, 'cross_attention_hidden_size': None, 'add_cross_attention': True, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'architectures': ['GPT2LMHeadModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'pad_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': {'text-generation': {'do_sample': True, 'max_length': 50}}, 'problem_type': None, '_name_or_path': 'gpt2-medium', 'transformers_version': '4.17.0.dev0', 'n_ctx': 1024, 'n_special': 0, 'predict_special_tokens': True, 'model_type': 'gpt2'}, 'encoder': {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'architectures': ['Wav2Vec2ForPreTraining'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 1, 'pad_token_id': 0, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'facebook/wav2vec2-large-lv60', 'transformers_version': '4.17.0.dev0', 'feat_extract_dropout': 0.0, 'gradient_checkpointing': False, 'hidden_dropout_prob': 0.0, 'num_feat_extract_layers': 7, 'hidden_size': 1024, 'feat_extract_norm': 'layer', 'feat_extract_activation': 'gelu', 'conv_dim': [512, 512, 512, 512, 512, 512, 512], 'conv_stride': [5, 2, 2, 2, 2, 2, 2], 'conv_kernel': [10, 3, 3, 3, 3, 2, 2], 'conv_bias': True, 'num_conv_pos_embeddings': 128, 'num_conv_pos_embedding_groups': 16, 'num_hidden_layers': 24, 'intermediate_size': 4096, 'hidden_act': 'gelu', 'num_attention_heads': 16, 'hidden_dropout': 0.0, 'attention_dropout': 0.0, 'activation_dropout': 0.0, 'feat_proj_dropout': 0.0, 'final_dropout': 0.0, 'layerdrop': 0.0, 'layer_norm_eps': 1e-05, 'initializer_range': 0.02, 'vocab_size': 32, 'do_stable_layer_norm': True, 'use_weighted_layer_sum': False, 'apply_spec_augment': False, 'mask_time_prob': 0.0, 'mask_time_length': 10, 'mask_time_min_masks': 2, 'mask_feature_prob': 0.0, 'mask_feature_length': 10, 'mask_feature_min_masks': 0, 'num_codevectors_per_group': 320, 'num_codevector_groups': 2, 'contrastive_logits_temperature': 0.1, 'feat_quantizer_dropout': 0.0, 'num_negatives': 100, 'codevector_dim': 768, 'proj_codevector_dim': 768, 'diversity_loss_weight': 0.1, 'ctc_loss_reduction': 'sum', 'ctc_zero_infinity': False, 'add_adapter': True, 'adapter_kernel_size': 3, 'adapter_stride': 2, 'num_adapter_layers': 3, 'output_hidden_size': 1024, 'classifier_proj_size': 256, 'tdnn_dim': [512, 512, 512, 512, 1500], 'tdnn_kernel': [5, 3, 3, 1, 1], 'tdnn_dilation': [1, 2, 3, 1, 1], 'xvector_output_dim': 512, 'model_type': 'wav2vec2'}, 'model_type': 'speech-encoder-decoder', 'processor_class': 'Wav2Vec2Processor', 'use_cache': False, 'output_dir': './', 'overwrite_output_dir': True, 'do_train': True, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'steps', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': 'None', 'per_gpu_eval_batch_size': 'None', 'gradient_accumulation_steps': 2, 'eval_accumulation_steps': 'None', 'learning_rate': 1e-05, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 1.0, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'warmup_ratio': 0.0, 'warmup_steps': 500, 'log_level': -1, 'log_level_replica': -1, 'log_on_each_node': True, 'logging_dir': './runs/Feb28_09-34-39_sanchit--v100', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 1, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 1, 'save_on_each_node': False, 'no_cuda': False, 'seed': 42, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'amp', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': 'None', 'local_rank': -1, 'xpu_backend': 'None', 'tpu_num_cores': 'None', 'tpu_metrics_debug': False, 'debug': '[]', 'dataloader_drop_last': False, 'eval_steps': 500, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': './', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': 'None', 'load_best_model_at_end': False, 'metric_for_best_model': 'None', 'greater_is_better': 'None', 'ignore_data_skip': False, 'sharded_ddp': '[]', 'deepspeed': 'None', 'label_smoothing_factor': 0.0, 'optim': 'adamw_hf', 'adafactor': False, 'group_by_length': True, 'length_column_name': 'input_length', 'report_to': "['wandb']", 'ddp_find_unused_parameters': 'None', 'ddp_bucket_cap_mb': 'None', 'dataloader_pin_memory': True, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': 'None', 'hub_model_id': 'None', 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'gradient_checkpointing': True, 'fp16_backend': 'auto', 'push_to_hub_model_id': 'None', 'push_to_hub_organization': 'None', 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', '_n_gpu': 1, 'mp_parameters': '', 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': 40, 'generation_num_beams': 1, 'train_batch_size': 8, 'eval_batch_size': 8}
|
27 |
2022-02-28 09:37:06,930 INFO MainThread:219058 [wandb_watch.py:watch():43] Watching
|
28 |
+
2022-02-28 12:26:52,881 INFO MainThread:219058 [wandb_run.py:_atexit_cleanup():1797] got exitcode: 1
|
29 |
+
2022-02-28 12:26:52,884 INFO MainThread:219058 [wandb_run.py:_restore():1769] restore
|
30 |
+
2022-02-28 12:26:55,424 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
31 |
+
wandb_count: 1
|
32 |
+
}
|
33 |
+
pusher_stats {
|
34 |
+
uploaded_bytes: 2093
|
35 |
+
total_bytes: 2093
|
36 |
+
}
|
37 |
+
|
38 |
+
2022-02-28 12:26:55,543 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
39 |
+
wandb_count: 1
|
40 |
+
}
|
41 |
+
pusher_stats {
|
42 |
+
uploaded_bytes: 2093
|
43 |
+
total_bytes: 2093
|
44 |
+
}
|
45 |
+
|
46 |
+
2022-02-28 12:26:55,700 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
47 |
+
wandb_count: 1
|
48 |
+
}
|
49 |
+
pusher_stats {
|
50 |
+
uploaded_bytes: 2093
|
51 |
+
total_bytes: 2093
|
52 |
+
}
|
53 |
+
|
54 |
+
2022-02-28 12:26:56,588 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
55 |
+
wandb_count: 1
|
56 |
+
}
|
57 |
+
pusher_stats {
|
58 |
+
uploaded_bytes: 2093
|
59 |
+
total_bytes: 2093
|
60 |
+
}
|
61 |
+
|
62 |
+
2022-02-28 12:26:57,500 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
63 |
+
wandb_count: 4
|
64 |
+
}
|
65 |
+
pusher_stats {
|
66 |
+
uploaded_bytes: 2093
|
67 |
+
total_bytes: 3302624
|
68 |
+
}
|
69 |
+
|
70 |
+
2022-02-28 12:26:57,602 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
71 |
+
wandb_count: 5
|
72 |
+
}
|
73 |
+
pusher_stats {
|
74 |
+
uploaded_bytes: 2093
|
75 |
+
total_bytes: 3600788
|
76 |
+
}
|
77 |
+
|
78 |
+
2022-02-28 12:26:57,704 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
79 |
+
wandb_count: 5
|
80 |
+
}
|
81 |
+
pusher_stats {
|
82 |
+
uploaded_bytes: 3600788
|
83 |
+
total_bytes: 3600788
|
84 |
+
}
|
85 |
+
|
86 |
+
2022-02-28 12:26:57,806 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
87 |
+
wandb_count: 5
|
88 |
+
}
|
89 |
+
pusher_stats {
|
90 |
+
uploaded_bytes: 3600788
|
91 |
+
total_bytes: 3600788
|
92 |
+
}
|
93 |
+
|
94 |
+
2022-02-28 12:26:57,908 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
95 |
+
wandb_count: 5
|
96 |
+
}
|
97 |
+
pusher_stats {
|
98 |
+
uploaded_bytes: 3600788
|
99 |
+
total_bytes: 3600788
|
100 |
+
}
|
101 |
+
|
102 |
+
2022-02-28 12:26:58,010 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
103 |
+
wandb_count: 5
|
104 |
+
}
|
105 |
+
pusher_stats {
|
106 |
+
uploaded_bytes: 3600788
|
107 |
+
total_bytes: 3600788
|
108 |
+
}
|
109 |
+
|
110 |
+
2022-02-28 12:26:59,339 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: file_counts {
|
111 |
+
wandb_count: 5
|
112 |
+
}
|
113 |
+
pusher_stats {
|
114 |
+
uploaded_bytes: 3600788
|
115 |
+
total_bytes: 3600788
|
116 |
+
}
|
117 |
+
|
118 |
+
2022-02-28 12:26:59,524 INFO MainThread:219058 [wandb_run.py:_wait_for_finish():1929] got exit ret: done: true
|
119 |
+
exit_result {
|
120 |
+
}
|
121 |
+
file_counts {
|
122 |
+
wandb_count: 5
|
123 |
+
}
|
124 |
+
pusher_stats {
|
125 |
+
uploaded_bytes: 3600788
|
126 |
+
total_bytes: 3600788
|
127 |
+
}
|
128 |
+
local_info {
|
129 |
+
}
|
130 |
+
|
131 |
+
2022-02-28 12:27:00,754 INFO MainThread:219058 [wandb_run.py:_append_history():2144] rendering history
|
132 |
+
2022-02-28 12:27:00,755 INFO MainThread:219058 [wandb_run.py:_append_summary():2102] rendering summary
|
133 |
+
2022-02-28 12:27:00,756 INFO MainThread:219058 [wandb_run.py:_append_files():2194] logging synced files
|
wandb/run-20220228_093705-yn2gmwrw/run-yn2gmwrw.wandb
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a6bc21d08717049bd726ef4f5a0e14f822e9230c94fa846bdceffc4fc088816e
|
3 |
+
size 57224842
|
wandb/run-20220228_122826-3vepvy3m/files/config.yaml
ADDED
The diff for this file is too large to render.
See raw diff
|
wandb/run-20220228_122826-3vepvy3m/files/output.log
ADDED
The diff for this file is too large to render.
See raw diff
|
wandb/run-20220228_122826-3vepvy3m/files/requirements.txt
ADDED
@@ -0,0 +1,184 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
absl-py==1.0.0
|
2 |
+
aiohttp==3.8.1
|
3 |
+
aiosignal==1.2.0
|
4 |
+
anyio==3.5.0
|
5 |
+
appdirs==1.4.4
|
6 |
+
argon2-cffi-bindings==21.2.0
|
7 |
+
argon2-cffi==21.3.0
|
8 |
+
asttokens==2.0.5
|
9 |
+
async-timeout==4.0.2
|
10 |
+
attrs==21.4.0
|
11 |
+
audioread==2.1.9
|
12 |
+
babel==2.9.1
|
13 |
+
backcall==0.2.0
|
14 |
+
bitsandbytes-cuda113==0.26.0
|
15 |
+
black==22.1.0
|
16 |
+
bleach==4.1.0
|
17 |
+
cachetools==5.0.0
|
18 |
+
certifi==2021.10.8
|
19 |
+
cffi==1.15.0
|
20 |
+
charset-normalizer==2.0.11
|
21 |
+
chex==0.1.0
|
22 |
+
click==8.0.3
|
23 |
+
clldutils==3.10.1
|
24 |
+
colorlog==6.6.0
|
25 |
+
csvw==1.11.0
|
26 |
+
cycler==0.11.0
|
27 |
+
datasets==1.18.3
|
28 |
+
debugpy==1.5.1
|
29 |
+
decorator==5.1.1
|
30 |
+
defusedxml==0.7.1
|
31 |
+
dill==0.3.4
|
32 |
+
dlinfo==1.2.1
|
33 |
+
dm-tree==0.1.6
|
34 |
+
docker-pycreds==0.4.0
|
35 |
+
entrypoints==0.4
|
36 |
+
executing==0.8.2
|
37 |
+
filelock==3.4.2
|
38 |
+
flatbuffers==2.0
|
39 |
+
flax==0.4.0
|
40 |
+
fonttools==4.29.1
|
41 |
+
frozenlist==1.3.0
|
42 |
+
fsspec==2022.1.0
|
43 |
+
gitdb==4.0.9
|
44 |
+
gitpython==3.1.27
|
45 |
+
google-auth-oauthlib==0.4.6
|
46 |
+
google-auth==2.6.0
|
47 |
+
grpcio==1.43.0
|
48 |
+
huggingface-hub==0.4.0
|
49 |
+
hypothesis==6.36.1
|
50 |
+
idna==3.3
|
51 |
+
importlib-metadata==4.10.1
|
52 |
+
ipykernel==6.8.0
|
53 |
+
ipython-genutils==0.2.0
|
54 |
+
ipython==8.0.1
|
55 |
+
ipywidgets==7.6.5
|
56 |
+
isodate==0.6.1
|
57 |
+
jax==0.2.28
|
58 |
+
jaxlib==0.1.76+cuda11.cudnn82
|
59 |
+
jedi==0.18.1
|
60 |
+
jinja2==3.0.3
|
61 |
+
jiwer==2.3.0
|
62 |
+
joblib==1.1.0
|
63 |
+
json5==0.9.6
|
64 |
+
jsonschema==4.4.0
|
65 |
+
jupyter-client==7.1.2
|
66 |
+
jupyter-console==6.4.0
|
67 |
+
jupyter-core==4.9.1
|
68 |
+
jupyter-server==1.13.5
|
69 |
+
jupyter==1.0.0
|
70 |
+
jupyterlab-pygments==0.1.2
|
71 |
+
jupyterlab-server==2.10.3
|
72 |
+
jupyterlab-widgets==1.0.2
|
73 |
+
jupyterlab==3.2.9
|
74 |
+
kiwisolver==1.3.2
|
75 |
+
librosa==0.8.1
|
76 |
+
llvmlite==0.38.0
|
77 |
+
markdown==3.3.6
|
78 |
+
markupsafe==2.0.1
|
79 |
+
matplotlib-inline==0.1.3
|
80 |
+
matplotlib==3.5.1
|
81 |
+
mistune==0.8.4
|
82 |
+
msgpack==1.0.3
|
83 |
+
multidict==6.0.2
|
84 |
+
multiprocess==0.70.12.2
|
85 |
+
mypy-extensions==0.4.3
|
86 |
+
nbclassic==0.3.5
|
87 |
+
nbclient==0.5.10
|
88 |
+
nbconvert==6.4.1
|
89 |
+
nbformat==5.1.3
|
90 |
+
nest-asyncio==1.5.4
|
91 |
+
notebook==6.4.8
|
92 |
+
numba==0.55.1
|
93 |
+
numpy==1.21.5
|
94 |
+
oauthlib==3.2.0
|
95 |
+
opt-einsum==3.3.0
|
96 |
+
optax==0.1.0
|
97 |
+
packaging==21.3
|
98 |
+
pandas==1.4.0
|
99 |
+
pandocfilters==1.5.0
|
100 |
+
parso==0.8.3
|
101 |
+
pathspec==0.9.0
|
102 |
+
pathtools==0.1.2
|
103 |
+
pexpect==4.8.0
|
104 |
+
phonemizer==3.0.1
|
105 |
+
pickleshare==0.7.5
|
106 |
+
pillow==9.0.0
|
107 |
+
pip==22.0.2
|
108 |
+
pkg-resources==0.0.0
|
109 |
+
platformdirs==2.4.1
|
110 |
+
pooch==1.6.0
|
111 |
+
prometheus-client==0.13.1
|
112 |
+
promise==2.3
|
113 |
+
prompt-toolkit==3.0.26
|
114 |
+
protobuf==3.19.4
|
115 |
+
psutil==5.9.0
|
116 |
+
ptyprocess==0.7.0
|
117 |
+
pure-eval==0.2.2
|
118 |
+
pyarrow==6.0.1
|
119 |
+
pyasn1-modules==0.2.8
|
120 |
+
pyasn1==0.4.8
|
121 |
+
pycparser==2.21
|
122 |
+
pyctcdecode==0.3.0
|
123 |
+
pygments==2.11.2
|
124 |
+
pygtrie==2.4.2
|
125 |
+
pyparsing==3.0.7
|
126 |
+
pyrsistent==0.18.1
|
127 |
+
python-dateutil==2.8.2
|
128 |
+
python-levenshtein==0.12.2
|
129 |
+
pytz==2021.3
|
130 |
+
pyyaml==6.0
|
131 |
+
pyzmq==22.3.0
|
132 |
+
qtconsole==5.2.2
|
133 |
+
qtpy==2.0.1
|
134 |
+
regex==2022.1.18
|
135 |
+
requests-oauthlib==1.3.1
|
136 |
+
requests==2.27.1
|
137 |
+
resampy==0.2.2
|
138 |
+
rfc3986==2.0.0
|
139 |
+
rsa==4.8
|
140 |
+
sacremoses==0.0.47
|
141 |
+
scikit-learn==1.0.2
|
142 |
+
scipy==1.7.3
|
143 |
+
segments==2.2.0
|
144 |
+
send2trash==1.8.0
|
145 |
+
sentry-sdk==1.5.6
|
146 |
+
setuptools==44.1.1
|
147 |
+
shortuuid==1.0.8
|
148 |
+
six==1.16.0
|
149 |
+
smmap==5.0.0
|
150 |
+
sniffio==1.2.0
|
151 |
+
sortedcontainers==2.4.0
|
152 |
+
soundfile==0.10.3.post1
|
153 |
+
stack-data==0.1.4
|
154 |
+
tabulate==0.8.9
|
155 |
+
tensorboard-data-server==0.6.1
|
156 |
+
tensorboard-plugin-wit==1.8.1
|
157 |
+
tensorboard==2.8.0
|
158 |
+
termcolor==1.1.0
|
159 |
+
terminado==0.13.1
|
160 |
+
testpath==0.5.0
|
161 |
+
threadpoolctl==3.1.0
|
162 |
+
tokenizers==0.11.4
|
163 |
+
tomli==2.0.0
|
164 |
+
toolz==0.11.2
|
165 |
+
torch==1.10.2+cu113
|
166 |
+
torchaudio==0.10.2+cu113
|
167 |
+
tornado==6.1
|
168 |
+
tqdm==4.62.3
|
169 |
+
traitlets==5.1.1
|
170 |
+
transformers==4.17.0.dev0
|
171 |
+
typing-extensions==3.10.0.2
|
172 |
+
uritemplate==4.1.1
|
173 |
+
urllib3==1.26.8
|
174 |
+
wandb==0.12.10
|
175 |
+
wcwidth==0.2.5
|
176 |
+
webencodings==0.5.1
|
177 |
+
websocket-client==1.2.3
|
178 |
+
werkzeug==2.0.2
|
179 |
+
wheel==0.37.1
|
180 |
+
widgetsnbextension==3.5.2
|
181 |
+
xxhash==2.0.2
|
182 |
+
yarl==1.7.2
|
183 |
+
yaspin==2.1.0
|
184 |
+
zipp==3.7.0
|
wandb/run-20220228_122826-3vepvy3m/files/wandb-metadata.json
ADDED
@@ -0,0 +1,60 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"os": "Linux-5.11.0-1028-gcp-x86_64-with-glibc2.33",
|
3 |
+
"python": "3.9.5",
|
4 |
+
"heartbeatAt": "2022-02-28T12:28:27.636127",
|
5 |
+
"startedAt": "2022-02-28T12:28:26.498407",
|
6 |
+
"docker": null,
|
7 |
+
"gpu": "Tesla V100-SXM2-16GB",
|
8 |
+
"gpu_count": 2,
|
9 |
+
"cpu_count": 16,
|
10 |
+
"cuda": null,
|
11 |
+
"args": [
|
12 |
+
"--dataset_name=librispeech_asr",
|
13 |
+
"--model_name_or_path=./",
|
14 |
+
"--tokenizer_name=./",
|
15 |
+
"--dataset_config_name=clean",
|
16 |
+
"--train_split_name=train.100",
|
17 |
+
"--eval_split_name=validation",
|
18 |
+
"--output_dir=./",
|
19 |
+
"--preprocessing_num_workers=1",
|
20 |
+
"--length_column_name=input_length",
|
21 |
+
"--overwrite_output_dir",
|
22 |
+
"--num_train_epochs=1",
|
23 |
+
"--per_device_train_batch_size=8",
|
24 |
+
"--per_device_eval_batch_size=8",
|
25 |
+
"--gradient_accumulation_steps=4",
|
26 |
+
"--generation_max_length=40",
|
27 |
+
"--generation_num_beams=1",
|
28 |
+
"--learning_rate=1e-5",
|
29 |
+
"--warmup_steps=500",
|
30 |
+
"--evaluation_strategy=steps",
|
31 |
+
"--text_column_name=text",
|
32 |
+
"--save_steps=500",
|
33 |
+
"--eval_steps=500",
|
34 |
+
"--logging_steps=1",
|
35 |
+
"--save_total_limit=1",
|
36 |
+
"--freeze_feature_encoder",
|
37 |
+
"--gradient_checkpointing",
|
38 |
+
"--fp16",
|
39 |
+
"--group_by_length",
|
40 |
+
"--predict_with_generate",
|
41 |
+
"--do_lower_case",
|
42 |
+
"--do_train",
|
43 |
+
"--do_eval",
|
44 |
+
"--report_to=wandb",
|
45 |
+
"--push_to_hub",
|
46 |
+
"--use_auth_token"
|
47 |
+
],
|
48 |
+
"state": "running",
|
49 |
+
"program": "/home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/run_speech_recognition_seq2seq.py",
|
50 |
+
"codePath": "run_speech_recognition_seq2seq.py",
|
51 |
+
"git": {
|
52 |
+
"remote": "https://huggingface.co/sanchit-gandhi/wav2vec2-gpt2-wandb-grid-search",
|
53 |
+
"commit": "b3823b7df48df7a56dee0f8d7ecae679904666f4"
|
54 |
+
},
|
55 |
+
"email": "sanchit@huggingface.co",
|
56 |
+
"root": "/home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search",
|
57 |
+
"host": "sanchit--v100",
|
58 |
+
"username": "sanchit_huggingface_co",
|
59 |
+
"executable": "/home/sanchit_huggingface_co/gcp/bin/python"
|
60 |
+
}
|
wandb/run-20220228_122826-3vepvy3m/files/wandb-summary.json
ADDED
The diff for this file is too large to render.
See raw diff
|
wandb/run-20220228_122826-3vepvy3m/logs/debug-internal.log
ADDED
The diff for this file is too large to render.
See raw diff
|
wandb/run-20220228_122826-3vepvy3m/logs/debug.log
ADDED
@@ -0,0 +1,26 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [wandb_setup.py:_flush():75] Loading settings from /home/sanchit_huggingface_co/.config/wandb/settings
|
2 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [wandb_setup.py:_flush():75] Loading settings from /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/settings
|
3 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [wandb_setup.py:_flush():75] Loading settings from environment variables: {}
|
4 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [wandb_setup.py:_flush():75] Inferring run settings from compute environment: {'program_relpath': 'run_speech_recognition_seq2seq.py', 'program': '/home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/run_speech_recognition_seq2seq.py'}
|
5 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [wandb_init.py:_log_setup():386] Logging user logs to /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_122826-3vepvy3m/logs/debug.log
|
6 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [wandb_init.py:_log_setup():387] Logging internal logs to /home/sanchit_huggingface_co/wav2vec2-gpt2-wandb-grid-search/wandb/run-20220228_122826-3vepvy3m/logs/debug-internal.log
|
7 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [wandb_init.py:init():420] calling init triggers
|
8 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [wandb_init.py:init():425] wandb.init called with sweep_config: {}
|
9 |
+
config: {}
|
10 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [wandb_init.py:init():471] starting backend
|
11 |
+
2022-02-28 12:28:26,500 INFO MainThread:222710 [backend.py:_multiprocessing_setup():99] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
|
12 |
+
2022-02-28 12:28:26,571 INFO MainThread:222710 [backend.py:ensure_launched():219] starting backend process...
|
13 |
+
2022-02-28 12:28:26,637 INFO MainThread:222710 [backend.py:ensure_launched():224] started backend process with pid: 222811
|
14 |
+
2022-02-28 12:28:26,639 INFO MainThread:222710 [wandb_init.py:init():480] backend started and connected
|
15 |
+
2022-02-28 12:28:26,650 INFO MainThread:222710 [wandb_init.py:init():550] updated telemetry
|
16 |
+
2022-02-28 12:28:26,816 INFO MainThread:222710 [wandb_init.py:init():581] communicating current version
|
17 |
+
2022-02-28 12:28:27,530 INFO MainThread:222710 [wandb_init.py:init():586] got version response
|
18 |
+
2022-02-28 12:28:27,530 INFO MainThread:222710 [wandb_init.py:init():596] communicating run to backend with 30 second timeout
|
19 |
+
2022-02-28 12:28:27,630 INFO MainThread:222710 [wandb_init.py:init():624] starting run threads in backend
|
20 |
+
2022-02-28 12:28:27,741 INFO MainThread:222710 [wandb_run.py:_console_start():1827] atexit reg
|
21 |
+
2022-02-28 12:28:27,741 INFO MainThread:222710 [wandb_run.py:_redirect():1701] redirect: SettingsConsole.REDIRECT
|
22 |
+
2022-02-28 12:28:27,742 INFO MainThread:222710 [wandb_run.py:_redirect():1706] Redirecting console.
|
23 |
+
2022-02-28 12:28:27,744 INFO MainThread:222710 [wandb_run.py:_redirect():1762] Redirects installed.
|
24 |
+
2022-02-28 12:28:27,744 INFO MainThread:222710 [wandb_init.py:init():651] run started, returning control to user process
|
25 |
+
2022-02-28 12:28:27,746 INFO MainThread:222710 [wandb_run.py:_config_callback():966] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'torch.float32', 'use_bfloat16': False, 'pruned_heads': {}, 'tie_word_embeddings': False, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 50, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'architectures': ['SpeechEncoderDecoderModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 50256, 'eos_token_id': 50256, 'sep_token_id': None, 'decoder_start_token_id': 50256, 'task_specific_params': None, 'problem_type': None, '_name_or_path': './', 'transformers_version': None, 'decoder': {'vocab_size': 50257, 'n_positions': 1024, 'n_embd': 1024, 'n_layer': 24, 'n_head': 16, 'n_inner': None, 'activation_function': 'gelu_new', 'resid_pdrop': 0.0, 'embd_pdrop': 0.0, 'attn_pdrop': 0.0, 'layer_norm_epsilon': 1e-05, 'initializer_range': 0.02, 'summary_type': 'cls_index', 'summary_use_proj': True, 'summary_activation': None, 'summary_first_dropout': 0.0, 'summary_proj_to_labels': True, 'scale_attn_weights': True, 'use_cache': False, 'scale_attn_by_inverse_layer_idx': False, 'reorder_and_upcast_attn': False, 'bos_token_id': 50256, 'eos_token_id': 50256, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': True, 'cross_attention_hidden_size': None, 'add_cross_attention': True, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'architectures': ['GPT2LMHeadModel'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'pad_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': {'text-generation': {'do_sample': True, 'max_length': 50}}, 'problem_type': None, '_name_or_path': 'gpt2-medium', 'transformers_version': '4.17.0.dev0', 'n_ctx': 1024, 'n_special': 0, 'predict_special_tokens': True, 'model_type': 'gpt2'}, 'encoder': {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'architectures': ['Wav2Vec2ForPreTraining'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 1, 'pad_token_id': 0, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'facebook/wav2vec2-large-lv60', 'transformers_version': '4.17.0.dev0', 'feat_extract_dropout': 0.0, 'gradient_checkpointing': False, 'hidden_dropout_prob': 0.0, 'num_feat_extract_layers': 7, 'hidden_size': 1024, 'feat_extract_norm': 'layer', 'feat_extract_activation': 'gelu', 'conv_dim': [512, 512, 512, 512, 512, 512, 512], 'conv_stride': [5, 2, 2, 2, 2, 2, 2], 'conv_kernel': [10, 3, 3, 3, 3, 2, 2], 'conv_bias': True, 'num_conv_pos_embeddings': 128, 'num_conv_pos_embedding_groups': 16, 'num_hidden_layers': 24, 'intermediate_size': 4096, 'hidden_act': 'gelu', 'num_attention_heads': 16, 'hidden_dropout': 0.0, 'attention_dropout': 0.0, 'activation_dropout': 0.0, 'feat_proj_dropout': 0.0, 'final_dropout': 0.0, 'layerdrop': 0.0, 'layer_norm_eps': 1e-05, 'initializer_range': 0.02, 'vocab_size': 32, 'do_stable_layer_norm': True, 'use_weighted_layer_sum': False, 'apply_spec_augment': False, 'mask_time_prob': 0.0, 'mask_time_length': 10, 'mask_time_min_masks': 2, 'mask_feature_prob': 0.0, 'mask_feature_length': 10, 'mask_feature_min_masks': 0, 'num_codevectors_per_group': 320, 'num_codevector_groups': 2, 'contrastive_logits_temperature': 0.1, 'feat_quantizer_dropout': 0.0, 'num_negatives': 100, 'codevector_dim': 768, 'proj_codevector_dim': 768, 'diversity_loss_weight': 0.1, 'ctc_loss_reduction': 'sum', 'ctc_zero_infinity': False, 'add_adapter': True, 'adapter_kernel_size': 3, 'adapter_stride': 2, 'num_adapter_layers': 3, 'output_hidden_size': 1024, 'classifier_proj_size': 256, 'tdnn_dim': [512, 512, 512, 512, 1500], 'tdnn_kernel': [5, 3, 3, 1, 1], 'tdnn_dilation': [1, 2, 3, 1, 1], 'xvector_output_dim': 512, 'model_type': 'wav2vec2'}, 'model_type': 'speech-encoder-decoder', 'processor_class': 'Wav2Vec2Processor', 'use_cache': False, 'output_dir': './', 'overwrite_output_dir': True, 'do_train': True, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'steps', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': 'None', 'per_gpu_eval_batch_size': 'None', 'gradient_accumulation_steps': 4, 'eval_accumulation_steps': 'None', 'learning_rate': 1e-05, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 1.0, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'warmup_ratio': 0.0, 'warmup_steps': 500, 'log_level': -1, 'log_level_replica': -1, 'log_on_each_node': True, 'logging_dir': './runs/Feb28_12-27-43_sanchit--v100', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 1, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 1, 'save_on_each_node': False, 'no_cuda': False, 'seed': 42, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'amp', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': 'None', 'local_rank': -1, 'xpu_backend': 'None', 'tpu_num_cores': 'None', 'tpu_metrics_debug': False, 'debug': '[]', 'dataloader_drop_last': False, 'eval_steps': 500, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': './', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': 'None', 'load_best_model_at_end': False, 'metric_for_best_model': 'None', 'greater_is_better': 'None', 'ignore_data_skip': False, 'sharded_ddp': '[]', 'deepspeed': 'None', 'label_smoothing_factor': 0.0, 'optim': 'adamw_hf', 'adafactor': False, 'group_by_length': True, 'length_column_name': 'input_length', 'report_to': "['wandb']", 'ddp_find_unused_parameters': 'None', 'ddp_bucket_cap_mb': 'None', 'dataloader_pin_memory': True, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': 'None', 'hub_model_id': 'None', 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'gradient_checkpointing': True, 'fp16_backend': 'auto', 'push_to_hub_model_id': 'None', 'push_to_hub_organization': 'None', 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', '_n_gpu': 1, 'mp_parameters': '', 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': 40, 'generation_num_beams': 1, 'train_batch_size': 8, 'eval_batch_size': 8}
|
26 |
+
2022-02-28 12:28:27,749 INFO MainThread:222710 [wandb_watch.py:watch():43] Watching
|
wandb/run-20220228_122826-3vepvy3m/run-3vepvy3m.wandb
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8e28edafb72c99efe3c2fda2cb7f6ae9cd80eb4aa12ff2ea69acbc784e0a06bc
|
3 |
+
size 32026302
|