| 2022-05-07 17:51:21,734 INFO MainThread:19394 [internal.py:wandb_internal():92] W&B internal server running at pid: 19394, started at: 2022-05-07 17:51:21.733835 | |
| 2022-05-07 17:51:21,736 INFO WriterThread:19394 [datastore.py:open_for_write():77] open: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/run-1uz2jm5y.wandb | |
| 2022-05-07 17:51:21,737 DEBUG SenderThread:19394 [sender.py:send():235] send: header | |
| 2022-05-07 17:51:21,737 DEBUG SenderThread:19394 [sender.py:send():235] send: run | |
| 2022-05-07 17:51:22,178 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: check_version | |
| 2022-05-07 17:51:22,179 INFO SenderThread:19394 [dir_watcher.py:__init__():169] watching files in: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files | |
| 2022-05-07 17:51:22,179 INFO SenderThread:19394 [sender.py:_start_run_threads():812] run started: 1uz2jm5y with start time 1651945881 | |
| 2022-05-07 17:51:22,179 DEBUG SenderThread:19394 [sender.py:send():235] send: summary | |
| 2022-05-07 17:51:22,179 INFO SenderThread:19394 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-05-07 17:51:22,179 DEBUG SenderThread:19394 [sender.py:send_request():249] send_request: check_version | |
| 2022-05-07 17:51:22,240 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: run_start | |
| 2022-05-07 17:51:23,216 INFO Thread-7 :19394 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/wandb-summary.json | |
| 2022-05-07 17:51:24,333 DEBUG HandlerThread:19394 [meta.py:__init__():37] meta init | |
| 2022-05-07 17:51:24,333 DEBUG HandlerThread:19394 [meta.py:__init__():51] meta init done | |
| 2022-05-07 17:51:24,333 DEBUG HandlerThread:19394 [meta.py:probe():211] probe | |
| 2022-05-07 17:51:24,334 DEBUG HandlerThread:19394 [meta.py:_setup_git():201] setup git | |
| 2022-05-07 17:51:24,364 DEBUG HandlerThread:19394 [meta.py:_setup_git():208] setup git done | |
| 2022-05-07 17:51:24,364 DEBUG HandlerThread:19394 [meta.py:_save_pip():55] save pip | |
| 2022-05-07 17:51:24,364 DEBUG HandlerThread:19394 [meta.py:_save_pip():69] save pip done | |
| 2022-05-07 17:51:24,364 DEBUG HandlerThread:19394 [meta.py:probe():249] probe done | |
| 2022-05-07 17:51:24,367 DEBUG SenderThread:19394 [sender.py:send():235] send: files | |
| 2022-05-07 17:51:24,368 INFO SenderThread:19394 [sender.py:_save_file():947] saving file wandb-metadata.json with policy now | |
| 2022-05-07 17:51:24,373 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:51:24,373 DEBUG SenderThread:19394 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:51:24,490 DEBUG SenderThread:19394 [sender.py:send():235] send: telemetry | |
| 2022-05-07 17:51:24,699 INFO Thread-11 :19394 [upload_job.py:push():137] Uploaded file /tmp/tmpn7r3a1vpwandb/4jmsuamg-wandb-metadata.json | |
| 2022-05-07 17:51:25,245 INFO Thread-7 :19394 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:51:25,245 INFO Thread-7 :19394 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/requirements.txt | |
| 2022-05-07 17:51:25,245 INFO Thread-7 :19394 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/wandb-metadata.json | |
| 2022-05-07 17:51:27,246 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:51:29,247 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:51:39,251 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:51:39,532 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:51:39,532 DEBUG SenderThread:19394 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:51:41,252 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:51:52,418 DEBUG SenderThread:19394 [sender.py:send():235] send: stats | |
| 2022-05-07 17:51:53,257 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/config.yaml | |
| 2022-05-07 17:51:54,578 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:51:54,578 DEBUG SenderThread:19394 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:52:05,262 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:52:09,684 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:52:09,684 DEBUG SenderThread:19394 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:52:22,495 DEBUG SenderThread:19394 [sender.py:send():235] send: stats | |
| 2022-05-07 17:52:24,719 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:52:24,719 DEBUG SenderThread:19394 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:52:26,749 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:26,851 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:28,125 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:28,127 DEBUG SenderThread:19394 [sender.py:send():235] send: history | |
| 2022-05-07 17:52:28,128 DEBUG SenderThread:19394 [sender.py:send():235] send: summary | |
| 2022-05-07 17:52:28,129 INFO SenderThread:19394 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-05-07 17:52:28,204 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:28,270 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/wandb-summary.json | |
| 2022-05-07 17:52:29,271 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:29,271 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:52:29,273 DEBUG SenderThread:19394 [sender.py:send():235] send: history | |
| 2022-05-07 17:52:29,275 DEBUG SenderThread:19394 [sender.py:send():235] send: summary | |
| 2022-05-07 17:52:29,276 INFO SenderThread:19394 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-05-07 17:52:29,340 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:30,271 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/wandb-summary.json | |
| 2022-05-07 17:52:30,489 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:30,491 DEBUG SenderThread:19394 [sender.py:send():235] send: history | |
| 2022-05-07 17:52:30,491 DEBUG SenderThread:19394 [sender.py:send():235] send: summary | |
| 2022-05-07 17:52:30,492 INFO SenderThread:19394 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-05-07 17:52:30,576 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:31,272 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:52:31,272 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/wandb-summary.json | |
| 2022-05-07 17:52:31,697 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:31,699 DEBUG SenderThread:19394 [sender.py:send():235] send: history | |
| 2022-05-07 17:52:31,699 DEBUG SenderThread:19394 [sender.py:send():235] send: summary | |
| 2022-05-07 17:52:31,700 INFO SenderThread:19394 [sender.py:_save_file():947] saving file wandb-summary.json with policy end | |
| 2022-05-07 17:52:31,776 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: partial_history | |
| 2022-05-07 17:52:32,272 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/wandb-summary.json | |
| 2022-05-07 17:52:33,273 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:52:39,754 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:52:39,755 DEBUG SenderThread:19394 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:52:52,572 DEBUG SenderThread:19394 [sender.py:send():235] send: stats | |
| 2022-05-07 17:52:54,814 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:52:54,814 DEBUG SenderThread:19394 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:53:00,284 INFO Thread-7 :19394 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log | |
| 2022-05-07 17:53:09,905 DEBUG HandlerThread:19394 [handler.py:handle_request():141] handle_request: stop_status | |
| 2022-05-07 17:53:09,905 DEBUG SenderThread:19394 [sender.py:send_request():249] send_request: stop_status | |
| 2022-05-07 17:53:11,784 WARNING MainThread:19394 [internal.py:wandb_internal():155] Internal process interrupt: 1 | |
| 2022-05-07 17:53:11,946 WARNING MainThread:19394 [internal.py:wandb_internal():155] Internal process interrupt: 2 | |
| 2022-05-07 17:53:11,946 ERROR MainThread:19394 [internal.py:wandb_internal():158] Internal process interrupted. | |
| 2022-05-07 17:53:11,955 INFO SenderThread:19394 [sender.py:finish():1078] shutting down sender | |
| 2022-05-07 17:53:11,956 INFO SenderThread:19394 [dir_watcher.py:finish():283] shutting down directory watcher | |
| 2022-05-07 17:53:11,957 INFO HandlerThread:19394 [handler.py:finish():778] shutting down handler | |
| 2022-05-07 17:53:12,288 INFO SenderThread:19394 [dir_watcher.py:finish():313] scan: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files | |
| 2022-05-07 17:53:12,288 INFO SenderThread:19394 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/requirements.txt requirements.txt | |
| 2022-05-07 17:53:12,288 INFO SenderThread:19394 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/output.log output.log | |
| 2022-05-07 17:53:12,288 INFO SenderThread:19394 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/wandb-metadata.json wandb-metadata.json | |
| 2022-05-07 17:53:12,289 INFO SenderThread:19394 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/config.yaml config.yaml | |
| 2022-05-07 17:53:12,289 INFO SenderThread:19394 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-dummy/wandb/run-20220507_175120-1uz2jm5y/files/wandb-summary.json wandb-summary.json | |
| 2022-05-07 17:53:12,292 INFO SenderThread:19394 [file_pusher.py:finish():145] shutting down file pusher | |
| 2022-05-07 17:53:12,292 INFO SenderThread:19394 [file_pusher.py:join():150] waiting for file pusher | |
| 2022-05-07 17:53:12,321 INFO MainThread:19394 [internal.py:handle_exit():82] Internal process exited | |