2022-05-05 17:32:14,392 INFO    MainThread:73923 [internal.py:wandb_internal():89] W&B internal server running at pid: 73923, started at: 2022-05-05 17:32:14.392410
2022-05-05 17:32:14,396 DEBUG   HandlerThread:73923 [handler.py:handle_request():131] handle_request: check_version
2022-05-05 17:32:14,396 INFO    WriterThread:73923 [datastore.py:open_for_write():77] open: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/run-ykkm1chu.wandb
2022-05-05 17:32:14,396 DEBUG   SenderThread:73923 [sender.py:send():235] send: header
2022-05-05 17:32:14,396 DEBUG   SenderThread:73923 [sender.py:send_request():249] send_request: check_version
2022-05-05 17:32:14,467 DEBUG   SenderThread:73923 [sender.py:send():235] send: run
2022-05-05 17:32:14,567 INFO    SenderThread:73923 [dir_watcher.py:__init__():169] watching files in: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files
2022-05-05 17:32:14,568 INFO    SenderThread:73923 [sender.py:_start_run_threads():809] run started: ykkm1chu with start time 1651771933
2022-05-05 17:32:14,568 DEBUG   SenderThread:73923 [sender.py:send():235] send: summary
2022-05-05 17:32:14,568 INFO    SenderThread:73923 [sender.py:_save_file():944] saving file wandb-summary.json with policy end
2022-05-05 17:32:14,569 DEBUG   HandlerThread:73923 [handler.py:handle_request():131] handle_request: run_start
2022-05-05 17:32:15,569 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/wandb-summary.json
2022-05-05 17:32:17,002 DEBUG   HandlerThread:73923 [meta.py:__init__():36] meta init
2022-05-05 17:32:17,002 DEBUG   HandlerThread:73923 [meta.py:__init__():50] meta init done
2022-05-05 17:32:17,002 DEBUG   HandlerThread:73923 [meta.py:probe():210] probe
2022-05-05 17:32:17,008 DEBUG   HandlerThread:73923 [meta.py:_setup_git():200] setup git
2022-05-05 17:32:17,043 DEBUG   HandlerThread:73923 [meta.py:_setup_git():207] setup git done
2022-05-05 17:32:17,043 DEBUG   HandlerThread:73923 [meta.py:_save_pip():54] save pip
2022-05-05 17:32:17,044 DEBUG   HandlerThread:73923 [meta.py:_save_pip():68] save pip done
2022-05-05 17:32:17,044 DEBUG   HandlerThread:73923 [meta.py:probe():248] probe done
2022-05-05 17:32:17,048 DEBUG   SenderThread:73923 [sender.py:send():235] send: files
2022-05-05 17:32:17,048 INFO    SenderThread:73923 [sender.py:_save_file():944] saving file wandb-metadata.json with policy now
2022-05-05 17:32:17,055 DEBUG   HandlerThread:73923 [handler.py:handle_request():131] handle_request: stop_status
2022-05-05 17:32:17,055 DEBUG   SenderThread:73923 [sender.py:send_request():249] send_request: stop_status
2022-05-05 17:32:17,099 DEBUG   SenderThread:73923 [sender.py:send():235] send: config
2022-05-05 17:32:17,100 DEBUG   SenderThread:73923 [sender.py:send():235] send: metric
2022-05-05 17:32:17,100 DEBUG   SenderThread:73923 [sender.py:send():235] send: metric
2022-05-05 17:32:17,100 WARNING SenderThread:73923 [sender.py:send_metric():902] Seen metric with glob (shouldnt happen)
2022-05-05 17:32:17,571 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/requirements.txt
2022-05-05 17:32:17,572 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/wandb-metadata.json
2022-05-05 17:32:17,572 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/output.log
2022-05-05 17:32:17,892 INFO    Thread-11 :73923 [upload_job.py:push():137] Uploaded file /tmp/tmpqkr07o8awandb/2ridycox-wandb-metadata.json
2022-05-05 17:32:19,572 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/output.log
2022-05-05 17:32:21,452 DEBUG   SenderThread:73923 [sender.py:send():235] send: metric
2022-05-05 17:32:21,453 DEBUG   SenderThread:73923 [sender.py:send():235] send: metric
2022-05-05 17:32:21,453 DEBUG   SenderThread:73923 [sender.py:send():235] send: metric
2022-05-05 17:32:21,453 DEBUG   SenderThread:73923 [sender.py:send():235] send: metric
2022-05-05 17:32:21,453 DEBUG   SenderThread:73923 [sender.py:send():235] send: metric
2022-05-05 17:32:21,453 DEBUG   SenderThread:73923 [sender.py:send():235] send: metric
2022-05-05 17:32:21,453 DEBUG   SenderThread:73923 [sender.py:send():235] send: history
2022-05-05 17:32:21,453 DEBUG   SenderThread:73923 [sender.py:send():235] send: summary
2022-05-05 17:32:21,455 INFO    SenderThread:73923 [sender.py:_save_file():944] saving file wandb-summary.json with policy end
2022-05-05 17:32:21,573 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/wandb-summary.json
2022-05-05 17:32:23,574 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/output.log
2022-05-05 17:32:32,106 DEBUG   HandlerThread:73923 [handler.py:handle_request():131] handle_request: stop_status
2022-05-05 17:32:32,106 DEBUG   SenderThread:73923 [sender.py:send_request():249] send_request: stop_status
2022-05-05 17:32:35,578 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/output.log
2022-05-05 17:32:45,443 DEBUG   SenderThread:73923 [sender.py:send():235] send: stats
2022-05-05 17:32:45,582 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/config.yaml
2022-05-05 17:32:47,138 DEBUG   HandlerThread:73923 [handler.py:handle_request():131] handle_request: stop_status
2022-05-05 17:32:47,139 DEBUG   SenderThread:73923 [sender.py:send_request():249] send_request: stop_status
2022-05-05 17:32:55,585 INFO    Thread-8  :73923 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/output.log
2022-05-05 17:33:02,172 DEBUG   HandlerThread:73923 [handler.py:handle_request():131] handle_request: stop_status
2022-05-05 17:33:02,172 DEBUG   SenderThread:73923 [sender.py:send_request():249] send_request: stop_status
2022-05-05 17:33:15,850 DEBUG   SenderThread:73923 [sender.py:send():235] send: stats
2022-05-05 17:33:17,208 DEBUG   HandlerThread:73923 [handler.py:handle_request():131] handle_request: stop_status
2022-05-05 17:33:17,209 DEBUG   SenderThread:73923 [sender.py:send_request():249] send_request: stop_status
2022-05-05 17:33:27,473 WARNING MainThread:73923 [internal.py:is_dead():380] Internal process exiting, parent pid 73744 disappeared
2022-05-05 17:33:27,473 ERROR   MainThread:73923 [internal.py:wandb_internal():148] Internal process shutdown.
2022-05-05 17:33:27,853 INFO    WriterThread:73923 [datastore.py:close():281] close: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/run-ykkm1chu.wandb
2022-05-05 17:33:28,248 INFO    SenderThread:73923 [sender.py:finish():1075] shutting down sender
2022-05-05 17:33:28,248 INFO    SenderThread:73923 [dir_watcher.py:finish():283] shutting down directory watcher
2022-05-05 17:33:28,253 INFO    HandlerThread:73923 [handler.py:finish():739] shutting down handler
2022-05-05 17:33:28,592 INFO    SenderThread:73923 [dir_watcher.py:finish():313] scan: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files
2022-05-05 17:33:28,592 INFO    SenderThread:73923 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/wandb-metadata.json wandb-metadata.json
2022-05-05 17:33:28,592 INFO    SenderThread:73923 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/output.log output.log
2022-05-05 17:33:28,593 INFO    SenderThread:73923 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/wandb-summary.json wandb-summary.json
2022-05-05 17:33:28,593 INFO    SenderThread:73923 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/requirements.txt requirements.txt
2022-05-05 17:33:28,597 INFO    SenderThread:73923 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/config.yaml config.yaml
2022-05-05 17:33:28,603 INFO    SenderThread:73923 [file_pusher.py:finish():177] shutting down file pusher
2022-05-05 17:33:28,603 INFO    SenderThread:73923 [file_pusher.py:join():182] waiting for file pusher
2022-05-05 17:33:28,861 INFO    Thread-12 :73923 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/output.log
2022-05-05 17:33:28,870 INFO    Thread-14 :73923 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/requirements.txt
2022-05-05 17:33:28,882 INFO    Thread-13 :73923 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/wandb-summary.json
2022-05-05 17:33:28,884 INFO    Thread-15 :73923 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en/wandb/run-20220505_173213-ykkm1chu/files/config.yaml
2022-05-05 17:33:29,163 INFO    MainThread:73923 [internal.py:handle_exit():79] Internal process exited