flax-wav2vec2-2-bart-large-cnn-gradient-accumulation
/
wandb
/run-20220324_110424-16xdss7m
/logs
/debug-internal.log
| 2022-03-24 11:04:25,109 INFO MainThread:98221 [internal.py:wandb_internal():92] W&B internal server running at pid: 98221, started at: 2022-03-24 11:04:25.109007 | |
| 2022-03-24 11:04:25,135 INFO WriterThread:98221 [datastore.py:open_for_write():77] open: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/run-16xdss7m.wandb | |
| 2022-03-24 11:04:25,137 DEBUG SenderThread:98221 [sender.py:send():235] send: header | |
| 2022-03-24 11:04:25,137 DEBUG SenderThread:98221 [sender.py:send():235] send: run | |
| 2022-03-24 11:04:25,327 INFO SenderThread:98221 [dir_watcher.py:__init__():169] watching files in: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files | |
| 2022-03-24 11:04:25,327 INFO SenderThread:98221 [sender.py:_start_run_threads():812] run started: 16xdss7m with start time 1648119864 | |
| 2022-03-24 11:04:25,327 DEBUG SenderThread:98221 [sender.py:send():235] send: summary | |
| 2022-03-24 11:04:25,327 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: check_version | |
| 2022-03-24 11:04:25,328 INFO SenderThread:98221 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-03-24 11:04:25,328 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: check_version | |
| 2022-03-24 11:04:25,390 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: run_start | |
| 2022-03-24 11:04:26,329 INFO Thread-7 :98221 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/wandb-summary.json | |
| 2022-03-24 11:04:27,794 DEBUG HandlerThread:98221 [meta.py:__init__():37] meta init | |
| 2022-03-24 11:04:27,794 DEBUG HandlerThread:98221 [meta.py:__init__():51] meta init done | |
| 2022-03-24 11:04:27,794 DEBUG HandlerThread:98221 [meta.py:probe():211] probe | |
| 2022-03-24 11:04:27,795 DEBUG HandlerThread:98221 [meta.py:_setup_git():201] setup git | |
| 2022-03-24 11:04:27,832 DEBUG HandlerThread:98221 [meta.py:_setup_git():208] setup git done | |
| 2022-03-24 11:04:27,832 DEBUG HandlerThread:98221 [meta.py:_save_pip():55] save pip | |
| 2022-03-24 11:04:27,833 DEBUG HandlerThread:98221 [meta.py:_save_pip():69] save pip done | |
| 2022-03-24 11:04:27,833 DEBUG HandlerThread:98221 [meta.py:probe():249] probe done | |
| 2022-03-24 11:04:27,836 DEBUG SenderThread:98221 [sender.py:send():235] send: files | |
| 2022-03-24 11:04:27,836 INFO SenderThread:98221 [sender.py:_save_file():947] saving file wandb-metadata.json with policy now | |
| 2022-03-24 11:04:27,842 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-03-24 11:04:27,842 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: stop_status | |
| 2022-03-24 11:04:28,213 DEBUG SenderThread:98221 [sender.py:send():235] send: telemetry | |
| 2022-03-24 11:04:28,297 INFO Thread-11 :98221 [upload_job.py:push():137] Uploaded file /tmp/tmpz6isbl39wandb/4ew81nnt-wandb-metadata.json | |
| 2022-03-24 11:04:28,426 INFO Thread-7 :98221 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:04:28,426 INFO Thread-7 :98221 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/wandb-metadata.json | |
| 2022-03-24 11:04:28,426 INFO Thread-7 :98221 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/requirements.txt | |
| 2022-03-24 11:04:30,427 INFO Thread-7 :98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:04:43,215 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-03-24 11:04:43,215 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: stop_status | |
| 2022-03-24 11:04:46,433 INFO Thread-7 :98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:04:50,435 INFO Thread-7 :98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:04:52,436 INFO Thread-7 :98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:04:55,437 INFO Thread-7 :98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/config.yaml | |
| 2022-03-24 11:04:55,882 DEBUG SenderThread:98221 [sender.py:send():235] send: stats | |
| 2022-03-24 11:04:56,438 INFO Thread-7 :98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:04:58,303 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-03-24 11:04:58,303 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: stop_status | |
| 2022-03-24 11:05:00,440 INFO Thread-7 :98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:05:00,906 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-03-24 11:05:00,906 DEBUG SenderThread:98221 [sender.py:send():235] send: telemetry | |
| 2022-03-24 11:05:02,440 INFO Thread-7 :98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:05:03,881 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:03,881 DEBUG SenderThread:98221 [sender.py:send():235] send: exit | |
| 2022-03-24 11:05:03,882 INFO SenderThread:98221 [sender.py:send_exit():371] handling exit code: 1 | |
| 2022-03-24 11:05:03,882 INFO SenderThread:98221 [sender.py:send_exit():373] handling runtime: 38 | |
| 2022-03-24 11:05:03,882 INFO SenderThread:98221 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-03-24 11:05:03,883 INFO SenderThread:98221 [sender.py:send_exit():379] send defer | |
| 2022-03-24 11:05:03,883 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:03,883 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:03,884 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 0 | |
| 2022-03-24 11:05:03,884 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:03,884 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 0 | |
| 2022-03-24 11:05:03,884 INFO SenderThread:98221 [sender.py:transition_state():392] send defer: 1 | |
| 2022-03-24 11:05:03,884 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:03,884 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 1 | |
| 2022-03-24 11:05:03,902 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:03,902 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 1 | |
| 2022-03-24 11:05:03,902 INFO SenderThread:98221 [sender.py:transition_state():392] send defer: 2 | |
| 2022-03-24 11:05:03,902 DEBUG SenderThread:98221 [sender.py:send():235] send: stats | |
| 2022-03-24 11:05:03,903 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:03,903 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 2 | |
| 2022-03-24 11:05:03,903 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:03,903 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 2 | |
| 2022-03-24 11:05:03,903 INFO SenderThread:98221 [sender.py:transition_state():392] send defer: 3 | |
| 2022-03-24 11:05:03,903 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:03,903 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 3 | |
| 2022-03-24 11:05:03,904 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:03,904 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 3 | |
| 2022-03-24 11:05:03,904 INFO SenderThread:98221 [sender.py:transition_state():392] send defer: 4 | |
| 2022-03-24 11:05:03,904 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:03,904 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 4 | |
| 2022-03-24 11:05:03,904 DEBUG SenderThread:98221 [sender.py:send():235] send: summary | |
| 2022-03-24 11:05:03,904 INFO SenderThread:98221 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-03-24 11:05:03,904 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:03,904 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 4 | |
| 2022-03-24 11:05:03,905 INFO SenderThread:98221 [sender.py:transition_state():392] send defer: 5 | |
| 2022-03-24 11:05:03,905 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:03,905 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 5 | |
| 2022-03-24 11:05:03,905 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:03,905 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 5 | |
| 2022-03-24 11:05:03,984 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:04,086 INFO SenderThread:98221 [sender.py:transition_state():392] send defer: 6 | |
| 2022-03-24 11:05:04,086 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:04,086 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:04,086 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 6 | |
| 2022-03-24 11:05:04,087 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:04,087 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 6 | |
| 2022-03-24 11:05:04,087 INFO SenderThread:98221 [dir_watcher.py:finish():283] shutting down directory watcher | |
| 2022-03-24 11:05:04,187 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:04,441 INFO Thread-7 :98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/config.yaml | |
| 2022-03-24 11:05:04,442 INFO SenderThread:98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:05:04,442 INFO SenderThread:98221 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/wandb-summary.json | |
| 2022-03-24 11:05:04,442 INFO SenderThread:98221 [dir_watcher.py:finish():313] scan: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files | |
| 2022-03-24 11:05:04,442 INFO SenderThread:98221 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/requirements.txt requirements.txt | |
| 2022-03-24 11:05:04,442 INFO SenderThread:98221 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log output.log | |
| 2022-03-24 11:05:04,443 INFO SenderThread:98221 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/wandb-metadata.json wandb-metadata.json | |
| 2022-03-24 11:05:04,443 INFO SenderThread:98221 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/config.yaml config.yaml | |
| 2022-03-24 11:05:04,443 INFO SenderThread:98221 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/wandb-summary.json wandb-summary.json | |
| 2022-03-24 11:05:04,448 INFO SenderThread:98221 [sender.py:transition_state():392] send defer: 7 | |
| 2022-03-24 11:05:04,448 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:04,454 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:04,455 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 7 | |
| 2022-03-24 11:05:04,455 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:04,455 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 7 | |
| 2022-03-24 11:05:04,455 INFO SenderThread:98221 [file_pusher.py:finish():145] shutting down file pusher | |
| 2022-03-24 11:05:04,550 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:04,550 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:04,652 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:04,652 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:04,730 INFO Thread-12 :98221 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/requirements.txt | |
| 2022-03-24 11:05:04,746 INFO Thread-13 :98221 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/output.log | |
| 2022-03-24 11:05:04,747 INFO Thread-14 :98221 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/config.yaml | |
| 2022-03-24 11:05:04,753 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:04,753 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:04,773 INFO Thread-15 :98221 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/files/wandb-summary.json | |
| 2022-03-24 11:05:04,855 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:04,855 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:04,956 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:04,957 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:04,973 INFO Thread-6 :98221 [sender.py:transition_state():392] send defer: 8 | |
| 2022-03-24 11:05:04,974 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:04,974 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 8 | |
| 2022-03-24 11:05:04,974 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:04,974 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 8 | |
| 2022-03-24 11:05:05,058 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:05,516 INFO SenderThread:98221 [sender.py:transition_state():392] send defer: 9 | |
| 2022-03-24 11:05:05,517 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:05,517 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:05,517 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 9 | |
| 2022-03-24 11:05:05,517 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:05,518 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 9 | |
| 2022-03-24 11:05:05,518 INFO SenderThread:98221 [sender.py:transition_state():392] send defer: 10 | |
| 2022-03-24 11:05:05,518 DEBUG SenderThread:98221 [sender.py:send():235] send: final | |
| 2022-03-24 11:05:05,518 DEBUG SenderThread:98221 [sender.py:send():235] send: footer | |
| 2022-03-24 11:05:05,518 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: defer | |
| 2022-03-24 11:05:05,518 INFO HandlerThread:98221 [handler.py:handle_request_defer():164] handle defer: 10 | |
| 2022-03-24 11:05:05,519 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: defer | |
| 2022-03-24 11:05:05,519 INFO SenderThread:98221 [sender.py:send_request_defer():388] handle sender defer: 10 | |
| 2022-03-24 11:05:05,619 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: poll_exit | |
| 2022-03-24 11:05:05,619 DEBUG SenderThread:98221 [sender.py:send_request():249] send_request: poll_exit | |
| 2022-03-24 11:05:05,619 INFO SenderThread:98221 [file_pusher.py:join():150] waiting for file pusher | |
| 2022-03-24 11:05:05,783 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: sampled_history | |
| 2022-03-24 11:05:05,784 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: get_summary | |
| 2022-03-24 11:05:05,785 DEBUG HandlerThread:98221 [handler.py:handle_request():141] handle_request: shutdown | |
| 2022-03-24 11:05:05,785 INFO HandlerThread:98221 [handler.py:finish():778] shutting down handler | |
| 2022-03-24 11:05:06,519 INFO WriterThread:98221 [datastore.py:close():281] close: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110424-16xdss7m/run-16xdss7m.wandb | |
| 2022-03-24 11:05:06,682 INFO SenderThread:98221 [sender.py:finish():1078] shutting down sender | |
| 2022-03-24 11:05:06,682 INFO SenderThread:98221 [file_pusher.py:finish():145] shutting down file pusher | |
| 2022-03-24 11:05:06,682 INFO SenderThread:98221 [file_pusher.py:join():150] waiting for file pusher | |
| 2022-03-24 11:05:06,685 INFO MainThread:98221 [internal.py:handle_exit():82] Internal process exited | |