flax-wav2vec2-2-bart-large-cnn-gradient-accumulation
/
wandb
/run-20220324_110832-1c8jfwlj
/logs
/debug-internal.log
2022-03-24 11:08:33,410 INFO MainThread:100105 [internal.py:wandb_internal():92] W&B internal server running at pid: 100105, started at: 2022-03-24 11:08:33.410220 | |
2022-03-24 11:08:33,441 INFO WriterThread:100105 [datastore.py:open_for_write():77] open: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110832-1c8jfwlj/run-1c8jfwlj.wandb | |
2022-03-24 11:08:33,443 DEBUG SenderThread:100105 [sender.py:send():235] send: header | |
2022-03-24 11:08:33,443 DEBUG SenderThread:100105 [sender.py:send():235] send: run | |
2022-03-24 11:08:33,515 DEBUG HandlerThread:100105 [handler.py:handle_request():141] handle_request: check_version | |
2022-03-24 11:08:33,516 INFO SenderThread:100105 [dir_watcher.py:__init__():169] watching files in: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110832-1c8jfwlj/files | |
2022-03-24 11:08:33,516 INFO SenderThread:100105 [sender.py:_start_run_threads():812] run started: 1c8jfwlj with start time 1648120112 | |
2022-03-24 11:08:33,516 DEBUG SenderThread:100105 [sender.py:send():235] send: summary | |
2022-03-24 11:08:33,516 INFO SenderThread:100105 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
2022-03-24 11:08:33,516 DEBUG SenderThread:100105 [sender.py:send_request():249] send_request: check_version | |
2022-03-24 11:08:33,577 DEBUG HandlerThread:100105 [handler.py:handle_request():141] handle_request: run_start | |
2022-03-24 11:08:34,519 INFO Thread-7 :100105 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110832-1c8jfwlj/files/wandb-summary.json | |
2022-03-24 11:08:35,922 DEBUG HandlerThread:100105 [meta.py:__init__():37] meta init | |
2022-03-24 11:08:35,922 DEBUG HandlerThread:100105 [meta.py:__init__():51] meta init done | |
2022-03-24 11:08:35,922 DEBUG HandlerThread:100105 [meta.py:probe():211] probe | |
2022-03-24 11:08:35,923 DEBUG HandlerThread:100105 [meta.py:_setup_git():201] setup git | |
2022-03-24 11:08:35,958 DEBUG HandlerThread:100105 [meta.py:_setup_git():208] setup git done | |
2022-03-24 11:08:35,959 DEBUG HandlerThread:100105 [meta.py:_save_pip():55] save pip | |
2022-03-24 11:08:35,959 DEBUG HandlerThread:100105 [meta.py:_save_pip():69] save pip done | |
2022-03-24 11:08:35,959 DEBUG HandlerThread:100105 [meta.py:probe():249] probe done | |
2022-03-24 11:08:35,962 DEBUG SenderThread:100105 [sender.py:send():235] send: files | |
2022-03-24 11:08:35,962 INFO SenderThread:100105 [sender.py:_save_file():947] saving file wandb-metadata.json with policy now | |
2022-03-24 11:08:35,968 DEBUG HandlerThread:100105 [handler.py:handle_request():141] handle_request: stop_status | |
2022-03-24 11:08:35,969 DEBUG SenderThread:100105 [sender.py:send_request():249] send_request: stop_status | |
2022-03-24 11:08:36,013 DEBUG SenderThread:100105 [sender.py:send():235] send: telemetry | |
2022-03-24 11:08:36,253 INFO Thread-11 :100105 [upload_job.py:push():137] Uploaded file /tmp/tmpz2wbkympwandb/7tzqaf04-wandb-metadata.json | |
2022-03-24 11:08:36,519 INFO Thread-7 :100105 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110832-1c8jfwlj/files/wandb-metadata.json | |
2022-03-24 11:08:36,519 INFO Thread-7 :100105 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110832-1c8jfwlj/files/output.log | |
2022-03-24 11:08:36,520 INFO Thread-7 :100105 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110832-1c8jfwlj/files/requirements.txt | |
2022-03-24 11:08:38,520 INFO Thread-7 :100105 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110832-1c8jfwlj/files/output.log | |
2022-03-24 11:08:43,327 WARNING MainThread:100105 [internal.py:wandb_internal():155] Internal process interrupt: 1 | |
2022-03-24 11:08:43,511 WARNING MainThread:100105 [internal.py:wandb_internal():155] Internal process interrupt: 2 | |
2022-03-24 11:08:43,512 ERROR MainThread:100105 [internal.py:wandb_internal():158] Internal process interrupted. | |
2022-03-24 11:08:43,613 INFO HandlerThread:100105 [handler.py:finish():778] shutting down handler | |
2022-03-24 11:08:43,614 INFO WriterThread:100105 [datastore.py:close():281] close: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_110832-1c8jfwlj/run-1c8jfwlj.wandb | |
2022-03-24 11:08:43,614 DEBUG SenderThread:100105 [sender.py:send():235] send: telemetry | |
2022-03-24 11:08:43,615 INFO SenderThread:100105 [sender.py:finish():1078] shutting down sender | |
2022-03-24 11:08:43,615 INFO SenderThread:100105 [dir_watcher.py:finish():283] shutting down directory watcher | |
2022-03-24 11:08:43,873 INFO MainThread:100105 [internal.py:handle_exit():82] Internal process exited | |