2022-03-24 09:55:47,867 INFO MainThread:87427 [internal.py:wandb_internal():92] W&B internal server running at pid: 87427, started at: 2022-03-24 09:55:47.867499 2022-03-24 09:55:47,897 INFO WriterThread:87427 [datastore.py:open_for_write():77] open: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/run-z3jyd0uo.wandb 2022-03-24 09:55:47,898 DEBUG SenderThread:87427 [sender.py:send():235] send: header 2022-03-24 09:55:47,898 DEBUG SenderThread:87427 [sender.py:send():235] send: run 2022-03-24 09:55:48,000 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: check_version 2022-03-24 09:55:48,000 INFO SenderThread:87427 [dir_watcher.py:__init__():169] watching files in: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files 2022-03-24 09:55:48,000 INFO SenderThread:87427 [sender.py:_start_run_threads():812] run started: z3jyd0uo with start time 1648115747 2022-03-24 09:55:48,000 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 09:55:48,001 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 09:55:48,001 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: check_version 2022-03-24 09:55:48,060 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: run_start 2022-03-24 09:55:49,003 INFO Thread-7 :87427 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 09:55:50,471 DEBUG HandlerThread:87427 [meta.py:__init__():37] meta init 2022-03-24 09:55:50,471 DEBUG HandlerThread:87427 [meta.py:__init__():51] meta init done 2022-03-24 09:55:50,471 DEBUG HandlerThread:87427 [meta.py:probe():211] probe 2022-03-24 09:55:50,472 DEBUG HandlerThread:87427 [meta.py:_setup_git():201] setup git 2022-03-24 09:55:50,507 DEBUG HandlerThread:87427 [meta.py:_setup_git():208] setup git done 2022-03-24 09:55:50,507 DEBUG HandlerThread:87427 [meta.py:_save_pip():55] save pip 2022-03-24 09:55:50,508 DEBUG HandlerThread:87427 [meta.py:_save_pip():69] save pip done 2022-03-24 09:55:50,508 DEBUG HandlerThread:87427 [meta.py:probe():249] probe done 2022-03-24 09:55:50,511 DEBUG SenderThread:87427 [sender.py:send():235] send: files 2022-03-24 09:55:50,512 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-metadata.json with policy now 2022-03-24 09:55:50,518 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:55:50,518 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:55:50,553 DEBUG SenderThread:87427 [sender.py:send():235] send: telemetry 2022-03-24 09:55:50,766 INFO Thread-11 :87427 [upload_job.py:push():137] Uploaded file /tmp/tmppd8tubbowandb/jfa8dqwk-wandb-metadata.json 2022-03-24 09:55:51,007 INFO Thread-7 :87427 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:55:51,007 INFO Thread-7 :87427 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/requirements.txt 2022-03-24 09:55:51,007 INFO Thread-7 :87427 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-metadata.json 2022-03-24 09:55:53,007 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:56:05,555 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:56:05,556 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:56:09,014 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:56:13,015 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:56:15,016 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:56:17,017 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:56:18,550 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 09:56:19,018 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:56:19,019 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/config.yaml 2022-03-24 09:56:20,609 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:56:20,610 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:56:23,020 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:56:35,662 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:56:35,662 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:56:48,621 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 09:56:50,784 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:56:50,785 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:57:05,832 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:57:05,833 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:57:18,694 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 09:57:20,920 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:57:20,920 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:57:35,970 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:57:35,970 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:57:48,766 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 09:57:51,042 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:57:51,043 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:58:06,083 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:58:06,083 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:58:18,842 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 09:58:21,147 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:58:21,148 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:58:36,205 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:58:36,205 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:58:48,927 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 09:58:51,242 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:58:51,242 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:59:06,281 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:59:06,281 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:59:19,007 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 09:59:21,322 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:59:21,323 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:59:36,360 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:59:36,361 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:59:49,087 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 09:59:50,114 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:59:51,453 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 09:59:51,453 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 09:59:52,115 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:59:56,117 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 09:59:58,117 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:00,119 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:04,120 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:06,121 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:06,544 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:00:06,544 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:00:08,122 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:10,123 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:14,125 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:16,126 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:19,158 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:00:20,127 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:21,610 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:00:21,610 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:00:22,128 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:24,129 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:28,131 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:30,132 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:32,132 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:36,134 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:36,732 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:00:36,732 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:00:38,135 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:40,136 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:45,139 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:47,140 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:49,232 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:00:51,141 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:51,840 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:00:51,841 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:00:53,143 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:55,144 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:56,969 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:00:56,975 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:00:58,145 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:00:59,145 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:01,146 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:03,147 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:06,993 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:01:06,994 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:01:07,149 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:09,150 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:13,151 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:15,152 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:17,153 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:19,306 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:01:21,155 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:22,241 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:01:22,241 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:01:23,156 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:27,158 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:29,159 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:31,160 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:35,161 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:37,162 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:37,281 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:01:37,281 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:01:39,163 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:43,165 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:45,166 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:48,167 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:49,380 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:01:50,168 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:52,363 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:01:52,363 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:01:54,169 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:01:56,170 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:00,172 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:02,173 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:04,174 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:06,507 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:02:06,508 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:02:06,509 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:02:06,509 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:02:06,512 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:02:07,175 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:07,176 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:02:07,461 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:02:07,461 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:02:08,176 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:10,177 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:14,178 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:16,179 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:18,180 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:19,453 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:02:22,182 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:22,545 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:02:22,546 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:02:24,183 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:26,184 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:30,185 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:32,186 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:36,188 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:37,741 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:02:37,742 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:02:38,189 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:40,190 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:44,191 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:46,192 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:48,193 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:49,526 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:02:52,195 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:52,810 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:02:52,810 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:02:54,196 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:02:58,197 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:00,198 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:02,199 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:07,201 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:07,869 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:03:07,869 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:03:09,202 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:11,203 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:15,204 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:16,203 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:03:16,204 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:03:16,204 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:03:16,205 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:03:16,205 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:03:16,208 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:03:18,206 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:19,207 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:19,599 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:03:21,207 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:23,070 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:03:23,070 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:03:23,208 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:25,210 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:29,211 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:31,212 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:33,213 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:37,215 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:38,345 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:03:38,346 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:03:39,216 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:43,217 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:45,218 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:47,219 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:49,220 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:49,672 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:03:53,222 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:53,410 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:03:53,411 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:03:55,223 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:03:59,224 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:01,225 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:03,226 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:07,228 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:08,534 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:04:08,534 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:04:10,229 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:12,230 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:16,231 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:18,232 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:19,747 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:04:20,233 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:23,620 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:04:23,620 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:04:24,235 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:24,929 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:04:24,931 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:04:24,931 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:04:24,931 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:04:24,935 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:04:25,236 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:04:26,236 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:27,236 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:30,238 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:32,238 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:34,239 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:38,241 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:39,194 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:04:39,195 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:04:40,241 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:42,242 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:46,244 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:48,245 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:49,820 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:04:52,247 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:54,248 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:04:54,291 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:04:54,291 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:04:56,249 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:00,250 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:02,251 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:04,252 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:08,254 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:09,384 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:05:09,384 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:05:10,255 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:12,256 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:14,257 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:18,258 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:19,895 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:05:21,260 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:24,478 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:05:24,478 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:05:25,261 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:27,262 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:29,263 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:31,264 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:32,990 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:05:32,992 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:05:32,992 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:05:32,992 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:05:32,997 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:05:33,265 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:05:34,265 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:35,266 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:37,266 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:39,738 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:05:39,738 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:05:41,268 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:43,269 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:45,270 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:49,271 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:49,970 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:05:51,273 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:53,273 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:54,833 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:05:54,834 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:05:57,275 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:05:59,276 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:03,278 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:05,279 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:09,280 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:09,978 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:06:09,978 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:06:11,281 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:13,282 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:15,283 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:19,285 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:20,045 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:06:21,286 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:25,059 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:06:25,059 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:06:25,287 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:27,288 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:30,289 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:32,290 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:36,292 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:38,292 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:40,148 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:06:40,149 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:06:42,294 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:42,572 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:06:42,573 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:06:42,574 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:06:42,574 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:06:42,578 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:06:43,294 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:06:44,295 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:45,295 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:46,296 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:50,114 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:06:50,297 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:52,298 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:55,290 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:06:55,291 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:06:56,300 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:06:58,301 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:00,302 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:02,302 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:06,304 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:08,305 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:10,381 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:07:10,381 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:07:12,307 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:14,308 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:16,309 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:20,182 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:07:20,310 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:22,311 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:25,461 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:07:25,461 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:07:26,313 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:28,314 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:30,315 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:34,316 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:36,317 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:38,318 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:40,500 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:07:40,500 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:07:43,320 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:45,321 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:47,322 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:50,248 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:07:51,323 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:52,105 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:07:52,107 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:07:52,107 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:07:52,108 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:07:52,111 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:07:52,324 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:07:53,324 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:54,325 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:55,325 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:07:55,565 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:07:55,565 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:07:59,327 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:01,327 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:05,329 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:07,330 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:09,331 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:10,621 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:08:10,621 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:08:11,332 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:15,333 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:17,334 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:20,315 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:08:21,336 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:23,337 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:25,338 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:25,696 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:08:25,697 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:08:29,339 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:31,340 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:33,341 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:37,343 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:39,344 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:40,736 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:08:40,736 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:08:41,345 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:45,347 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:47,348 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:49,348 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:50,388 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:08:53,350 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:55,351 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:08:55,798 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:08:55,798 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:08:59,353 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:00,221 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:09:00,222 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:09:00,223 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:09:00,223 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:09:00,227 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:09:00,353 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:09:02,354 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:03,355 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:04,355 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:06,356 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:10,357 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:10,868 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:09:10,868 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:09:12,358 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:16,360 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:18,361 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:20,362 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:20,461 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:09:24,364 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:25,939 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:09:25,939 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:09:26,365 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:30,366 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:32,367 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:34,368 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:38,370 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:40,371 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:41,016 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:09:41,016 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:09:42,372 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:46,374 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:48,375 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:50,376 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:50,534 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:09:52,377 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:56,109 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:09:56,109 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:09:56,378 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:09:58,379 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:00,380 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:05,382 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:07,383 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:08,122 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:10:08,124 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:10:08,125 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:10:08,125 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:10:08,128 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:10:08,384 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:10:09,384 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:11,237 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:10:11,237 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:10:11,385 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:15,386 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:17,387 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:20,608 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:10:21,389 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:23,390 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:25,390 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:26,556 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:10:26,556 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:10:29,392 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:31,393 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:33,393 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:35,394 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:39,396 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:41,397 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:41,640 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:10:41,640 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:10:43,398 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:47,400 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:49,401 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:50,680 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:10:52,402 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:56,404 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:10:56,729 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:10:56,729 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:10:58,405 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:02,406 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:04,407 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:06,408 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:10,411 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:11,832 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:11:11,833 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:11:12,412 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:14,413 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:16,386 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:11:16,388 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:11:16,388 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:11:16,389 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:11:16,392 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:11:16,413 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:11:18,414 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:20,415 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:20,752 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:11:22,416 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:26,418 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:26,903 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:11:26,903 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:11:28,418 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:32,420 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:34,421 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:36,422 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:38,423 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:40,424 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:41,961 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:11:41,961 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:11:44,425 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:46,426 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:50,826 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:11:51,428 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:53,429 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:55,430 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:11:57,058 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:11:57,058 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:11:59,431 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:01,432 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:03,433 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:07,435 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:09,436 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:11,437 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:15,439 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:17,075 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:12:17,075 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:12:17,439 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:19,440 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:20,899 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:12:23,442 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:24,214 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:12:24,215 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:12:24,215 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:12:24,216 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:12:24,220 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:12:24,442 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:12:25,443 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:27,443 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:31,445 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:32,251 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:12:32,251 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:12:33,446 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:35,447 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:37,448 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:41,449 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:44,451 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:47,332 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:12:47,332 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:12:48,452 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:50,453 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:50,973 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:12:52,454 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:56,456 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:12:58,456 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:00,457 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:02,435 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:13:02,435 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:13:02,458 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:06,460 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:08,461 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:12,463 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:14,464 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:16,464 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:17,518 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:13:17,519 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:13:18,465 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:21,046 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:13:22,467 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:24,467 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:28,469 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:30,470 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:31,863 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:13:31,865 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:13:31,865 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:13:31,866 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:13:31,869 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:13:32,471 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:32,471 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:13:32,582 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:13:32,582 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:13:36,472 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:38,473 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:40,474 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:44,476 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:46,476 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:47,667 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:13:47,667 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:13:48,477 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:51,119 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:13:53,479 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:55,480 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:13:59,482 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:01,483 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:02,787 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:14:02,787 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:14:03,484 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:05,485 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:09,486 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:11,487 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:15,489 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:17,490 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:17,854 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:14:17,855 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:14:19,490 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:21,191 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:14:23,492 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:25,493 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:29,495 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:31,495 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:32,963 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:14:32,963 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:14:33,496 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:37,498 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:39,499 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:40,812 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:14:40,814 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:14:40,814 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:14:40,814 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:14:40,818 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:14:41,500 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:41,500 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:14:43,501 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:47,502 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:48,059 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:14:48,059 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:14:49,503 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:51,265 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:14:53,504 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:55,505 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:14:58,506 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:00,507 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:03,186 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:15:03,186 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:15:04,509 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:06,510 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:10,511 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:12,512 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:14,513 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:18,256 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:15:18,257 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:15:18,515 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:20,515 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:21,334 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:15:22,516 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:24,517 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:28,519 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:30,519 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:32,520 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:33,362 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:15:33,362 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:15:36,522 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:38,522 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:40,523 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:44,525 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:46,526 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:47,772 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:15:47,774 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:15:47,774 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:15:47,775 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:15:47,779 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:15:48,435 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:15:48,435 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:15:48,527 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:48,527 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:15:51,410 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:15:52,528 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:54,529 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:15:57,530 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:01,532 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:03,533 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:03,826 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:16:03,826 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:16:05,534 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:09,535 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:11,536 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:13,537 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:17,539 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:18,942 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:16:18,942 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:16:19,539 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:21,485 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:16:21,540 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:25,542 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:27,543 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:29,544 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:33,546 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:34,032 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:16:34,032 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:16:35,546 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:37,547 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:41,549 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:43,550 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:48,551 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:49,137 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:16:49,137 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:16:50,552 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:51,557 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:16:52,553 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:54,554 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:56,612 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:16:56,613 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:16:56,614 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:16:56,614 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:16:56,618 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:16:57,555 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:16:57,555 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:16:58,555 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:00,556 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:04,264 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:17:04,264 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:17:04,557 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:06,558 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:08,559 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:12,561 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:14,561 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:16,562 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:19,312 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:17:19,313 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:17:20,564 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:21,628 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:17:22,564 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:26,566 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:28,567 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:30,567 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:32,568 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:34,395 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:17:34,395 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:17:36,569 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:38,570 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:40,571 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:44,573 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:46,573 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:48,574 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:49,466 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:17:49,467 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:17:50,575 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:51,701 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:17:55,577 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:17:57,578 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:01,579 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:03,580 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:04,562 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:18:04,562 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:18:04,703 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:18:04,704 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:18:04,704 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:18:04,705 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:18:04,709 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:18:05,581 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:18:06,581 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:07,582 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:09,582 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:11,583 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:13,584 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:17,585 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:19,586 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:19,609 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:18:19,609 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:18:21,587 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:21,773 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:18:23,588 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:27,589 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:29,590 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:33,592 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:34,686 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:18:34,686 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:18:35,593 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:37,593 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:41,595 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:43,596 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:45,597 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:49,598 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:49,839 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:18:49,839 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:18:51,599 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:51,844 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:18:54,601 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:18:58,603 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:00,604 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:02,605 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:04,972 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:19:04,973 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:19:06,606 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:08,607 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:10,608 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:12,327 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:19:12,328 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:19:12,328 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:19:12,329 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:19:12,333 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:19:12,609 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:19:14,610 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:16,611 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:18,612 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:20,026 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:19:20,026 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:19:21,917 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:19:22,614 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:24,615 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:26,615 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:30,617 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:32,618 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:34,619 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:35,190 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:19:35,190 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:19:36,620 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:40,622 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:42,623 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:46,625 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:48,625 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:50,306 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:19:50,307 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:19:50,626 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:51,991 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:19:54,628 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:57,630 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:19:59,631 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:03,632 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:05,390 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:20:05,390 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:20:05,633 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:07,634 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:11,636 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:13,637 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:17,639 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:19,640 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:20,546 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:20:20,546 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:20:20,770 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:20:20,771 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:20:20,772 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:20:20,772 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:20:20,776 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:20:21,641 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:21,641 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:20:22,064 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:20:23,642 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:25,642 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:27,643 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:29,644 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:31,645 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:35,615 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:20:35,615 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:20:35,647 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:37,648 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:39,649 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:43,650 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:45,651 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:49,653 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:50,758 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:20:50,758 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:20:51,654 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:52,137 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:20:53,655 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:55,656 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:20:59,657 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:03,659 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:05,660 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:05,832 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:21:05,833 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:21:07,661 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:11,663 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:13,664 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:15,665 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:20,667 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:20,944 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:21:20,944 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:21:22,213 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:21:22,668 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:24,669 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:26,670 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:28,705 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:21:28,706 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:21:28,706 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:21:28,707 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:21:28,710 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:21:29,671 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:21:30,671 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:32,672 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:36,046 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:21:36,046 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:21:36,674 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:38,675 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:40,677 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:42,677 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:46,679 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:48,680 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:50,681 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:51,111 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:21:51,111 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:21:52,283 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:21:54,682 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:21:56,683 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:00,685 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:02,686 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:04,687 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:06,237 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:22:06,237 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:22:06,688 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:10,689 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:12,690 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:14,691 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:16,692 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:20,694 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:21,325 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:22:21,326 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:22:22,358 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:22:22,695 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:24,696 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:28,697 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:31,699 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:33,699 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:35,844 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:22:35,845 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:22:35,845 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:22:35,845 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:22:35,850 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:22:36,447 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:22:36,447 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:22:36,701 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:22:37,701 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:39,702 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:43,704 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:45,705 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:47,706 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:51,523 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:22:51,523 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:22:51,708 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:52,431 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:22:53,709 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:55,710 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:22:59,712 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:01,713 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:03,713 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:06,576 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:23:06,576 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:23:07,715 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:09,716 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:11,717 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:15,719 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:17,720 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:19,721 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:21,637 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:23:21,637 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:23:22,503 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:23:23,723 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:25,724 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:28,725 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:30,726 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:34,728 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:36,712 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:23:36,712 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:23:36,728 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:38,729 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:42,731 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:42,788 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:23:42,789 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:23:42,790 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:23:42,790 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:23:42,794 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:23:43,731 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:43,732 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:23:44,732 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:46,733 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:48,734 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:51,795 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:23:51,795 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:23:52,576 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:23:52,735 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:54,736 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:23:56,737 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:00,739 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:02,740 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:06,742 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:06,869 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:24:06,870 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:24:08,742 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:10,743 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:14,745 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:16,746 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:18,747 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:21,934 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:24:21,935 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:24:22,649 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:24:22,748 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:24,749 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:26,750 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:30,751 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:32,752 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:34,753 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:36,976 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:24:36,977 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:24:39,755 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:41,756 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:45,757 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:47,758 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:49,759 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:50,838 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:24:50,839 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:24:50,840 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:24:50,840 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:24:50,844 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:24:51,760 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:51,760 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:24:52,038 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:24:52,038 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:24:52,720 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:24:52,761 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:55,762 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:57,763 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:24:59,764 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:03,765 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:05,766 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:07,132 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:25:07,132 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:25:07,767 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:11,769 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:13,770 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:17,772 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:19,773 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:21,774 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:22,233 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:25:22,234 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:25:22,791 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:25:23,775 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:27,777 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:29,778 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:33,779 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:35,780 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:37,303 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:25:37,304 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:25:37,781 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:41,783 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:43,783 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:48,785 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:50,786 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:52,446 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:25:52,446 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:25:52,787 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:52,864 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:25:56,789 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:58,790 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:25:59,826 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:25:59,827 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:25:59,827 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:25:59,828 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:25:59,832 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:26:00,791 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:00,791 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:26:01,791 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:04,792 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:06,793 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:07,540 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:26:07,541 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:26:08,794 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:10,795 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:14,797 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:16,797 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:20,799 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:22,648 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:26:22,649 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:26:22,800 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:22,939 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:26:24,801 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:28,802 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:30,803 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:32,804 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:36,806 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:37,757 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:26:37,757 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:26:38,806 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:40,807 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:44,809 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:46,810 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:48,810 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:52,806 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:26:52,807 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:26:52,812 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:53,012 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:26:55,813 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:57,814 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:26:59,815 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:03,816 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:05,817 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:07,253 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:27:07,254 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:27:07,254 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:27:07,255 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:27:07,259 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:27:07,818 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:27:07,925 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:27:07,925 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:27:09,819 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:11,820 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:13,821 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:15,822 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:19,824 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:21,825 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:22,986 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:27:22,986 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:27:23,088 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:27:23,825 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:27,827 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:29,828 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:33,829 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:35,830 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:37,831 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:38,046 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:27:38,046 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:27:41,833 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:43,834 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:45,835 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:47,836 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:52,838 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:53,138 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:27:53,139 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:27:53,180 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:27:54,839 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:56,839 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:27:58,840 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:02,842 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:04,842 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:06,843 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:08,209 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:28:08,209 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:28:10,845 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:12,846 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:14,162 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:28:14,163 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:28:14,163 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:28:14,164 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:28:14,167 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:28:14,846 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:28:15,847 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:16,847 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:18,848 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:20,849 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:22,850 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:23,223 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:28:23,286 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: stop_status 2022-03-24 10:28:23,286 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: stop_status 2022-03-24 10:28:26,851 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:28,852 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:29,506 DEBUG SenderThread:87427 [sender.py:send():235] send: telemetry 2022-03-24 10:28:29,507 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: partial_history 2022-03-24 10:28:29,508 DEBUG SenderThread:87427 [sender.py:send():235] send: history 2022-03-24 10:28:29,508 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:28:29,509 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:28:29,852 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:28:30,853 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:31,735 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: poll_exit 2022-03-24 10:28:31,735 DEBUG SenderThread:87427 [sender.py:send():235] send: exit 2022-03-24 10:28:31,735 INFO SenderThread:87427 [sender.py:send_exit():371] handling exit code: 1 2022-03-24 10:28:31,737 INFO SenderThread:87427 [sender.py:send_exit():373] handling runtime: 1963 2022-03-24 10:28:31,737 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:28:31,737 INFO SenderThread:87427 [sender.py:send_exit():379] send defer 2022-03-24 10:28:31,738 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: poll_exit 2022-03-24 10:28:31,738 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:31,738 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 0 2022-03-24 10:28:31,739 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:31,739 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 0 2022-03-24 10:28:31,739 INFO SenderThread:87427 [sender.py:transition_state():392] send defer: 1 2022-03-24 10:28:31,739 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:31,739 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 1 2022-03-24 10:28:31,743 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:31,744 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 1 2022-03-24 10:28:31,744 INFO SenderThread:87427 [sender.py:transition_state():392] send defer: 2 2022-03-24 10:28:31,744 DEBUG SenderThread:87427 [sender.py:send():235] send: stats 2022-03-24 10:28:31,744 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:31,744 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 2 2022-03-24 10:28:31,745 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:31,745 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 2 2022-03-24 10:28:31,745 INFO SenderThread:87427 [sender.py:transition_state():392] send defer: 3 2022-03-24 10:28:31,745 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:31,745 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 3 2022-03-24 10:28:31,745 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:31,745 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 3 2022-03-24 10:28:31,745 INFO SenderThread:87427 [sender.py:transition_state():392] send defer: 4 2022-03-24 10:28:31,745 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:31,745 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 4 2022-03-24 10:28:31,746 DEBUG SenderThread:87427 [sender.py:send():235] send: summary 2022-03-24 10:28:31,746 INFO SenderThread:87427 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-03-24 10:28:31,746 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:31,746 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 4 2022-03-24 10:28:31,746 INFO SenderThread:87427 [sender.py:transition_state():392] send defer: 5 2022-03-24 10:28:31,746 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:31,747 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 5 2022-03-24 10:28:31,747 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:31,747 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 5 2022-03-24 10:28:31,840 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: poll_exit 2022-03-24 10:28:31,856 INFO SenderThread:87427 [sender.py:transition_state():392] send defer: 6 2022-03-24 10:28:31,856 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: poll_exit 2022-03-24 10:28:31,857 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:31,857 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:31,857 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 6 2022-03-24 10:28:31,857 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:28:31,857 INFO Thread-7 :87427 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/config.yaml 2022-03-24 10:28:31,857 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:31,857 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 6 2022-03-24 10:28:31,857 INFO SenderThread:87427 [dir_watcher.py:finish():283] shutting down directory watcher 2022-03-24 10:28:31,858 INFO SenderThread:87427 [dir_watcher.py:finish():313] scan: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files 2022-03-24 10:28:31,858 INFO SenderThread:87427 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/requirements.txt requirements.txt 2022-03-24 10:28:31,858 INFO SenderThread:87427 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log output.log 2022-03-24 10:28:31,858 INFO SenderThread:87427 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-metadata.json wandb-metadata.json 2022-03-24 10:28:31,859 INFO SenderThread:87427 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/config.yaml config.yaml 2022-03-24 10:28:31,859 INFO SenderThread:87427 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json wandb-summary.json 2022-03-24 10:28:31,859 INFO SenderThread:87427 [sender.py:transition_state():392] send defer: 7 2022-03-24 10:28:31,860 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:31,860 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 7 2022-03-24 10:28:31,862 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:31,862 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 7 2022-03-24 10:28:31,862 INFO SenderThread:87427 [file_pusher.py:finish():145] shutting down file pusher 2022-03-24 10:28:31,958 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: poll_exit 2022-03-24 10:28:31,958 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: poll_exit 2022-03-24 10:28:32,059 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: poll_exit 2022-03-24 10:28:32,060 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: poll_exit 2022-03-24 10:28:32,145 INFO Thread-12 :87427 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/requirements.txt 2022-03-24 10:28:32,161 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: poll_exit 2022-03-24 10:28:32,162 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: poll_exit 2022-03-24 10:28:32,183 INFO Thread-13 :87427 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/output.log 2022-03-24 10:28:32,197 INFO Thread-14 :87427 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/config.yaml 2022-03-24 10:28:32,232 INFO Thread-15 :87427 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/files/wandb-summary.json 2022-03-24 10:28:32,263 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: poll_exit 2022-03-24 10:28:32,263 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: poll_exit 2022-03-24 10:28:32,365 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: poll_exit 2022-03-24 10:28:32,365 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: poll_exit 2022-03-24 10:28:32,432 INFO Thread-6 :87427 [sender.py:transition_state():392] send defer: 8 2022-03-24 10:28:32,433 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:32,433 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 8 2022-03-24 10:28:32,433 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:32,433 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 8 2022-03-24 10:28:32,466 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: poll_exit 2022-03-24 10:28:32,614 INFO SenderThread:87427 [sender.py:transition_state():392] send defer: 9 2022-03-24 10:28:32,615 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: poll_exit 2022-03-24 10:28:32,615 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:32,615 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 9 2022-03-24 10:28:32,615 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:32,616 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 9 2022-03-24 10:28:32,616 INFO SenderThread:87427 [sender.py:transition_state():392] send defer: 10 2022-03-24 10:28:32,616 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: defer 2022-03-24 10:28:32,616 INFO HandlerThread:87427 [handler.py:handle_request_defer():164] handle defer: 10 2022-03-24 10:28:32,616 DEBUG SenderThread:87427 [sender.py:send():235] send: final 2022-03-24 10:28:32,616 DEBUG SenderThread:87427 [sender.py:send():235] send: footer 2022-03-24 10:28:32,617 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: defer 2022-03-24 10:28:32,617 INFO SenderThread:87427 [sender.py:send_request_defer():388] handle sender defer: 10 2022-03-24 10:28:32,716 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: poll_exit 2022-03-24 10:28:32,717 DEBUG SenderThread:87427 [sender.py:send_request():249] send_request: poll_exit 2022-03-24 10:28:32,717 INFO SenderThread:87427 [file_pusher.py:join():150] waiting for file pusher 2022-03-24 10:28:32,980 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: sampled_history 2022-03-24 10:28:32,982 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: get_summary 2022-03-24 10:28:32,983 DEBUG HandlerThread:87427 [handler.py:handle_request():141] handle_request: shutdown 2022-03-24 10:28:32,984 INFO HandlerThread:87427 [handler.py:finish():778] shutting down handler 2022-03-24 10:28:33,617 INFO WriterThread:87427 [datastore.py:close():281] close: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220324_095547-z3jyd0uo/run-z3jyd0uo.wandb 2022-03-24 10:28:33,879 INFO SenderThread:87427 [sender.py:finish():1078] shutting down sender 2022-03-24 10:28:33,879 INFO SenderThread:87427 [file_pusher.py:finish():145] shutting down file pusher 2022-03-24 10:28:33,879 INFO SenderThread:87427 [file_pusher.py:join():150] waiting for file pusher 2022-03-24 10:28:33,883 INFO MainThread:87427 [internal.py:handle_exit():82] Internal process exited