| 2022-05-07 17:53:32,270 INFO MainThread:21883 [internal.py:wandb_internal():92] W&B internal server running at pid: 21883, started at: 2022-05-07 17:53:32.270705 | |
| 2022-05-07 17:53:32,274 DEBUG SenderThread:21883 [sender.py:send():235] send: header | |
| 2022-05-07 17:53:32,274 INFO WriterThread:21883 [datastore.py:open_for_write():77] open: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/run-2sve22ph.wandb | |
| 2022-05-07 17:53:32,274 DEBUG SenderThread:21883 [sender.py:send():235] send: run | |
| 2022-05-07 17:53:32,355 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: check_version | |
| 2022-05-07 17:53:32,355 INFO SenderThread:21883 [dir_watcher.py:__init__():169] watching files in: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files | |
| 2022-05-07 17:53:32,355 INFO SenderThread:21883 [sender.py:_start_run_threads():812] run started: 2sve22ph with start time 1651946011 | |
| 2022-05-07 17:53:32,356 DEBUG SenderThread:21883 [sender.py:send():235] send: summary | |
| 2022-05-07 17:53:32,356 INFO SenderThread:21883 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-05-07 17:53:32,356 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: check_version | |
| 2022-05-07 17:53:32,417 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: run_start | |
| 2022-05-07 17:53:33,357 INFO Thread-7 :21883 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/wandb-summary.json | |
| 2022-05-07 17:53:34,647 DEBUG HandlerThread:21883 [meta.py:__init__():37] meta init | |
| 2022-05-07 17:53:34,647 DEBUG HandlerThread:21883 [meta.py:__init__():51] meta init done | |
| 2022-05-07 17:53:34,647 DEBUG HandlerThread:21883 [meta.py:probe():211] probe | |
| 2022-05-07 17:53:34,648 DEBUG HandlerThread:21883 [meta.py:_setup_git():201] setup git | |
| 2022-05-07 17:53:34,677 DEBUG HandlerThread:21883 [meta.py:_setup_git():208] setup git done | |
| 2022-05-07 17:53:34,677 DEBUG HandlerThread:21883 [meta.py:_save_pip():55] save pip | |
| 2022-05-07 17:53:34,678 DEBUG HandlerThread:21883 [meta.py:_save_pip():69] save pip done | |
| 2022-05-07 17:53:34,678 DEBUG HandlerThread:21883 [meta.py:probe():249] probe done | |
| 2022-05-07 17:53:34,681 DEBUG SenderThread:21883 [sender.py:send():235] send: files | |
| 2022-05-07 17:53:34,681 INFO SenderThread:21883 [sender.py:_save_file():947] saving file wandb-metadata.json with policy now | |
| 2022-05-07 17:53:34,687 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:53:34,687 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:53:34,892 DEBUG SenderThread:21883 [sender.py:send():235] send: telemetry | |
| 2022-05-07 17:53:34,942 INFO Thread-11 :21883 [upload_job.py:push():137] Uploaded file /tmp/tmpz12z6jv0wandb/39yfzh3v-wandb-metadata.json | |
| 2022-05-07 17:53:35,361 INFO Thread-7 :21883 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/wandb-metadata.json | |
| 2022-05-07 17:53:35,361 INFO Thread-7 :21883 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:53:35,361 INFO Thread-7 :21883 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/requirements.txt | |
| 2022-05-07 17:53:37,361 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:53:39,362 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:53:49,365 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:53:49,894 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:53:49,894 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:53:51,366 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:53:57,368 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:54:01,370 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:54:02,370 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/config.yaml | |
| 2022-05-07 17:54:02,728 DEBUG SenderThread:21883 [sender.py:send():235] send: stats | |
| 2022-05-07 17:54:03,370 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:54:05,371 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:54:06,284 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:54:06,285 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:54:13,373 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:54:21,415 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:54:21,415 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:54:31,379 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:54:32,799 DEBUG SenderThread:21883 [sender.py:send():235] send: stats | |
| 2022-05-07 17:54:33,380 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:54:36,450 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:54:36,450 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:54:51,483 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:54:51,483 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:55:02,873 DEBUG SenderThread:21883 [sender.py:send():235] send: stats | |
| 2022-05-07 17:55:06,536 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:55:06,536 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:55:21,583 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:55:21,584 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:55:32,946 DEBUG SenderThread:21883 [sender.py:send():235] send: stats | |
| 2022-05-07 17:55:36,616 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:55:36,617 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:55:51,708 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:55:51,709 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:56:03,017 DEBUG SenderThread:21883 [sender.py:send():235] send: stats | |
| 2022-05-07 17:56:06,743 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:56:06,744 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:56:12,707 DEBUG SenderThread:21883 [sender.py:send():235] send: telemetry | |
| 2022-05-07 17:56:12,707 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:56:13,410 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:56:14,410 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:56:14,988 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:14,988 DEBUG SenderThread:21883 [sender.py:send():235] send: exit | |
| 2022-05-07 17:56:14,988 INFO SenderThread:21883 [sender.py:send_exit():371] handling exit code: 0 | |
| 2022-05-07 17:56:14,989 INFO SenderThread:21883 [sender.py:send_exit():373] handling runtime: 162 | |
| 2022-05-07 17:56:14,989 INFO SenderThread:21883 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-05-07 17:56:14,989 INFO SenderThread:21883 [sender.py:send_exit():379] send defer | |
| 2022-05-07 17:56:14,989 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:14,990 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:14,990 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 0 | |
| 2022-05-07 17:56:14,990 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:14,990 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 0 | |
| 2022-05-07 17:56:14,990 INFO SenderThread:21883 [sender.py:transition_state():392] send defer: 1 | |
| 2022-05-07 17:56:14,990 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:14,990 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 1 | |
| 2022-05-07 17:56:15,048 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:15,048 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 1 | |
| 2022-05-07 17:56:15,048 INFO SenderThread:21883 [sender.py:transition_state():392] send defer: 2 | |
| 2022-05-07 17:56:15,048 DEBUG SenderThread:21883 [sender.py:send():235] send: stats | |
| 2022-05-07 17:56:15,048 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:15,048 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 2 | |
| 2022-05-07 17:56:15,049 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:15,049 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 2 | |
| 2022-05-07 17:56:15,049 INFO SenderThread:21883 [sender.py:transition_state():392] send defer: 3 | |
| 2022-05-07 17:56:15,049 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:15,049 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 3 | |
| 2022-05-07 17:56:15,049 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:15,049 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 3 | |
| 2022-05-07 17:56:15,049 INFO SenderThread:21883 [sender.py:transition_state():392] send defer: 4 | |
| 2022-05-07 17:56:15,049 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:15,049 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 4 | |
| 2022-05-07 17:56:15,049 DEBUG SenderThread:21883 [sender.py:send():235] send: summary | |
| 2022-05-07 17:56:15,050 INFO SenderThread:21883 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-05-07 17:56:15,050 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:15,050 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 4 | |
| 2022-05-07 17:56:15,050 INFO SenderThread:21883 [sender.py:transition_state():392] send defer: 5 | |
| 2022-05-07 17:56:15,050 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:15,050 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 5 | |
| 2022-05-07 17:56:15,050 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:15,050 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 5 | |
| 2022-05-07 17:56:15,091 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:15,099 INFO SenderThread:21883 [sender.py:transition_state():392] send defer: 6 | |
| 2022-05-07 17:56:15,099 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:15,099 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:15,099 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 6 | |
| 2022-05-07 17:56:15,099 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:15,099 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 6 | |
| 2022-05-07 17:56:15,099 INFO SenderThread:21883 [dir_watcher.py:finish():283] shutting down directory watcher | |
| 2022-05-07 17:56:15,200 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:15,411 INFO Thread-7 :21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/wandb-summary.json | |
| 2022-05-07 17:56:15,411 INFO SenderThread:21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:56:15,411 INFO SenderThread:21883 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/config.yaml | |
| 2022-05-07 17:56:15,412 INFO SenderThread:21883 [dir_watcher.py:finish():313] scan: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files | |
| 2022-05-07 17:56:15,412 INFO SenderThread:21883 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/requirements.txt requirements.txt | |
| 2022-05-07 17:56:15,412 INFO SenderThread:21883 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log output.log | |
| 2022-05-07 17:56:15,412 INFO SenderThread:21883 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/wandb-metadata.json wandb-metadata.json | |
| 2022-05-07 17:56:15,412 INFO SenderThread:21883 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/config.yaml config.yaml | |
| 2022-05-07 17:56:15,412 INFO SenderThread:21883 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/wandb-summary.json wandb-summary.json | |
| 2022-05-07 17:56:15,412 INFO SenderThread:21883 [sender.py:transition_state():392] send defer: 7 | |
| 2022-05-07 17:56:15,413 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:15,413 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:15,413 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 7 | |
| 2022-05-07 17:56:15,413 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:15,413 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 7 | |
| 2022-05-07 17:56:15,413 INFO SenderThread:21883 [file_pusher.py:finish():145] shutting down file pusher | |
| 2022-05-07 17:56:15,517 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:15,517 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:15,619 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:15,619 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:15,655 INFO Thread-14 :21883 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/config.yaml | |
| 2022-05-07 17:56:15,673 INFO Thread-12 :21883 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/requirements.txt | |
| 2022-05-07 17:56:15,687 INFO Thread-15 :21883 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/wandb-summary.json | |
| 2022-05-07 17:56:15,720 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:15,721 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:15,762 INFO Thread-13 :21883 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/files/output.log | |
| 2022-05-07 17:56:15,822 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:15,822 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:15,924 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:15,924 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:15,963 INFO Thread-6 :21883 [sender.py:transition_state():392] send defer: 8 | |
| 2022-05-07 17:56:15,963 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:15,963 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 8 | |
| 2022-05-07 17:56:15,963 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:15,964 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 8 | |
| 2022-05-07 17:56:16,025 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:16,275 INFO SenderThread:21883 [sender.py:transition_state():392] send defer: 9 | |
| 2022-05-07 17:56:16,276 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:16,276 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:16,276 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 9 | |
| 2022-05-07 17:56:16,276 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:16,276 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 9 | |
| 2022-05-07 17:56:16,276 INFO SenderThread:21883 [sender.py:transition_state():392] send defer: 10 | |
| 2022-05-07 17:56:16,277 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: defer | |
| 2022-05-07 17:56:16,277 INFO HandlerThread:21883 [handler.py:handle_request_defer():164] handle defer: 10 | |
| 2022-05-07 17:56:16,277 DEBUG SenderThread:21883 [sender.py:send():235] send: final | |
| 2022-05-07 17:56:16,277 DEBUG SenderThread:21883 [sender.py:send():235] send: footer | |
| 2022-05-07 17:56:16,277 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: defer | |
| 2022-05-07 17:56:16,277 INFO SenderThread:21883 [sender.py:send_request_defer():388] handle sender defer: 10 | |
| 2022-05-07 17:56:16,377 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-05-07 17:56:16,377 DEBUG SenderThread:21883 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-05-07 17:56:16,377 INFO SenderThread:21883 [file_pusher.py:join():150] waiting for file pusher | |
| 2022-05-07 17:56:16,534 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: sampled_history | |
| 2022-05-07 17:56:16,535 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: get_summary | |
| 2022-05-07 17:56:16,535 DEBUG HandlerThread:21883 [handler.py:handle_request():141] handle_request: shutdown | |
| 2022-05-07 17:56:16,535 INFO HandlerThread:21883 [handler.py:finish():778] shutting down handler | |
| 2022-05-07 17:56:17,277 INFO WriterThread:21883 [datastore.py:close():281] close: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175331-2sve22ph/run-2sve22ph.wandb | |
| 2022-05-07 17:56:17,433 INFO SenderThread:21883 [sender.py:finish():1078] shutting down sender | |
| 2022-05-07 17:56:17,433 INFO SenderThread:21883 [file_pusher.py:finish():145] shutting down file pusher | |
| 2022-05-07 17:56:17,433 INFO SenderThread:21883 [file_pusher.py:join():150] waiting for file pusher | |
| 2022-05-07 17:56:17,462 INFO MainThread:21883 [internal.py:handle_exit():82] Internal process exited | |