2022-01-09 22:02:41,394 INFO MainThread:31514 [internal.py:wandb_internal():86] W&B internal server running at pid: 31514, started at: 2022-01-09 22:02:41.394521 2022-01-09 22:02:41,396 INFO WriterThread:31514 [datastore.py:open_for_write():77] open: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/run-1g372i3v.wandb 2022-01-09 22:02:41,396 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: check_version 2022-01-09 22:02:41,397 DEBUG SenderThread:31514 [sender.py:send():182] send: header 2022-01-09 22:02:41,398 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: check_version 2022-01-09 22:02:41,465 DEBUG SenderThread:31514 [sender.py:send():182] send: run 2022-01-09 22:02:41,634 INFO SenderThread:31514 [dir_watcher.py:__init__():169] watching files in: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files 2022-01-09 22:02:41,634 INFO SenderThread:31514 [sender.py:_start_run_threads():740] run started: 1g372i3v with start time 1641765761 2022-01-09 22:02:41,634 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:02:41,635 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: run_start 2022-01-09 22:02:41,635 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:02:42,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_created():217] file/dir created: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:02:42,756 DEBUG HandlerThread:31514 [meta.py:__init__():40] meta init 2022-01-09 22:02:42,756 DEBUG HandlerThread:31514 [meta.py:__init__():54] meta init done 2022-01-09 22:02:42,756 DEBUG HandlerThread:31514 [meta.py:probe():211] probe 2022-01-09 22:02:42,762 DEBUG HandlerThread:31514 [meta.py:_setup_git():201] setup git 2022-01-09 22:02:42,776 DEBUG HandlerThread:31514 [meta.py:_setup_git():208] setup git done 2022-01-09 22:02:42,776 DEBUG HandlerThread:31514 [meta.py:_save_pip():58] save pip 2022-01-09 22:02:42,777 DEBUG HandlerThread:31514 [meta.py:_save_pip():72] save pip done 2022-01-09 22:02:42,777 DEBUG HandlerThread:31514 [meta.py:_save_conda():79] save conda 2022-01-09 22:02:43,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_created():217] file/dir created: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/requirements.txt 2022-01-09 22:02:43,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_created():217] file/dir created: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/conda-environment.yaml 2022-01-09 22:02:46,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_created():217] file/dir created: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:02:48,640 DEBUG HandlerThread:31514 [meta.py:_save_conda():87] save conda done 2022-01-09 22:02:48,640 DEBUG HandlerThread:31514 [meta.py:probe():249] probe done 2022-01-09 22:02:48,642 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:02:48,643 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:02:48,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:02:48,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/conda-environment.yaml 2022-01-09 22:02:48,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_created():217] file/dir created: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-metadata.json 2022-01-09 22:02:48,977 DEBUG SenderThread:31514 [sender.py:send():182] send: config 2022-01-09 22:02:48,978 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:02:48,978 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:02:48,978 WARNING SenderThread:31514 [sender.py:send_metric():831] Seen metric with glob (shouldnt happen) 2022-01-09 22:02:48,978 DEBUG SenderThread:31514 [sender.py:send():182] send: files 2022-01-09 22:02:48,978 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-metadata.json with policy now 2022-01-09 22:02:49,340 INFO Thread-11 :31514 [upload_job.py:push():137] Uploaded file /tmp/tmprowoajefwandb/1igcepor-wandb-metadata.json 2022-01-09 22:02:50,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:02:53,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:02:55,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:02:57,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:02:59,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:01,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:03,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:04,007 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:03:04,008 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:03:05,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:07,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:09,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:11,008 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:03:11,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:12,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/config.yaml 2022-01-09 22:03:13,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:15,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:17,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:19,080 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:03:19,080 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:03:19,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:21,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:23,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:25,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:27,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:29,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:31,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:33,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:34,241 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:03:34,241 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:03:35,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:37,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:39,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:41,236 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:03:41,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:43,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:45,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:47,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:49,311 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:03:49,311 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:03:49,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:51,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:53,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:55,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:57,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:03:59,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:01,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:03,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:04,377 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:04:04,378 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:04:05,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:07,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:09,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:11,452 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:04:11,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:13,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:15,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:17,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:19,442 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:04:19,443 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:04:19,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:21,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:23,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:25,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:27,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:29,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:31,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:33,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:34,510 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:04:34,510 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:04:35,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:37,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:39,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:41,679 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:04:41,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:43,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:45,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:47,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:49,594 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:04:49,594 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:04:49,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:50,307 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,312 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,317 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,323 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,323 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,323 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,323 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,323 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,324 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,334 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,339 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,339 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,344 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,345 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,346 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,347 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,348 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,349 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,350 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,351 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,352 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,353 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,354 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,355 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,356 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,357 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,358 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,359 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,360 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,361 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,362 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,363 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,364 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,365 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,366 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,367 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,368 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,369 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,370 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,371 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,372 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,373 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,374 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,376 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,377 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,378 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,379 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,380 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,381 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,382 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,383 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,384 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,385 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,386 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,387 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,388 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,389 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,390 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,391 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,392 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,393 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:04:50,393 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:04:50,414 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:04:50,436 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:04:50,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:04:51,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:53,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:55,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:57,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:04:59,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:01,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:03,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:04,662 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:05:04,662 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:05:05,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:07,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:09,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:11,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:11,909 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:05:13,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:13,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/config.yaml 2022-01-09 22:05:15,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:17,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:19,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:19,769 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:05:19,769 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:05:21,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:23,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:25,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:28,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:30,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:32,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:34,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:34,885 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:05:34,885 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:05:36,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:38,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:40,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:42,150 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:05:42,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:44,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:46,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:48,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:49,979 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:05:49,979 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:05:50,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:52,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:54,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:56,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:05:58,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:00,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:02,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:04,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:05,238 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:06:05,238 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:06:06,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:08,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:10,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:12,373 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:06:12,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:14,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:16,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:18,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:20,342 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:06:20,342 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:06:20,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:22,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:24,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:26,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:28,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:30,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:32,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:34,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:35,411 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:06:35,412 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:06:36,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:38,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:40,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:42,598 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:06:42,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:44,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:46,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:48,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:50,509 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:06:50,509 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:06:50,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:52,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:54,642 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:06:54,693 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:06:54,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:06:54,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:54,721 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:06:55,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:56,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:06:58,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:00,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:02,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:04,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:05,611 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:07:05,611 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:07:06,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:08,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:10,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:12,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:12,868 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:07:14,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:16,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:18,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:20,687 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:07:20,687 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:07:20,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:22,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:24,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:26,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:28,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:30,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:32,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:34,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:35,783 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:07:35,783 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:07:36,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:38,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:40,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:42,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:43,099 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:07:44,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:46,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:48,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:50,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:50,857 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:07:50,857 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:07:52,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:54,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:56,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:07:58,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:00,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:02,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:04,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:05,951 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:08:05,951 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:08:06,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:09,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:11,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:13,326 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:08:13,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:15,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:17,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:19,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:21,040 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:08:21,041 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:08:21,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:23,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:25,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:27,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:31,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:33,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:35,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:36,205 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:08:36,206 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:08:37,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:39,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:41,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:43,540 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:08:43,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:45,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:47,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:49,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:51,287 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:08:51,287 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:08:51,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:53,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:55,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:57,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:08:57,822 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:08:57,869 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:08:57,892 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:08:58,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:08:59,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:00,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:01,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:03,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:05,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:06,366 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:09:06,367 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:09:07,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:09,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:11,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:13,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:13,783 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:09:15,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:17,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:19,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:21,446 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:09:21,446 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:09:21,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:23,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:25,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:27,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:29,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:31,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:33,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:35,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:36,584 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:09:36,585 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:09:37,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:39,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:41,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:43,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:44,007 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:09:45,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:47,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:49,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:51,661 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:09:51,661 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:09:51,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:53,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:55,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:57,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:09:59,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:01,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:03,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:05,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:06,759 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:10:06,759 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:10:08,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:10,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:12,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:14,233 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:10:14,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:16,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:18,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:20,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:21,950 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:10:21,950 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:10:22,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:24,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:26,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:28,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:30,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:32,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:34,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:36,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:37,061 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:10:37,061 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:10:38,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:40,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:42,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:44,456 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:10:44,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:46,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:48,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:50,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:52,132 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:10:52,132 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:10:52,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:54,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:56,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:10:58,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:00,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:02,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:03,689 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:11:03,730 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:11:03,754 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:11:03,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:11:04,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:06,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:07,228 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:11:07,228 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:11:08,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:10,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:12,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:14,676 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:11:14,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:16,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:18,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:20,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:22,316 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:11:22,316 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:11:22,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:24,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:26,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:28,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:30,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:32,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:34,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:36,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:37,412 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:11:37,412 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:11:38,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:40,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:42,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:44,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:44,903 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:11:46,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:48,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:50,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:52,490 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:11:52,490 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:11:52,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:54,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:56,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:11:58,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:00,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:02,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:05,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:07,568 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:12:07,568 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:12:07,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:09,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:11,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:13,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:15,125 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:12:15,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:17,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:19,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:21,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:22,636 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:12:22,636 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:12:23,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:25,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:27,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:29,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:31,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:33,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:35,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:37,728 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:12:37,728 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:12:37,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:39,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:41,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:43,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:45,344 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:12:45,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:47,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:49,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:51,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:52,844 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:12:52,844 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:12:53,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:55,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:57,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:12:59,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:01,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:03,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:05,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:07,127 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:13:07,172 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:13:07,195 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:13:07,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:13:07,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:07,939 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:13:07,939 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:13:09,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:11,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:13,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:15,584 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:13:15,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:17,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:19,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:21,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:23,050 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:13:23,051 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:13:23,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:25,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:27,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:29,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:31,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:33,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:35,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:37,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:38,144 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:13:38,144 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:13:39,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:41,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:44,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:45,828 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:13:46,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:48,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:50,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:52,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:53,225 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:13:53,225 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:13:54,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:56,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:13:58,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:00,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:02,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:04,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:06,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:08,317 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:14:08,317 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:14:08,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:10,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:12,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:14,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:16,068 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:14:16,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:18,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:20,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:22,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:23,408 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:14:23,408 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:14:24,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:26,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:28,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:30,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:32,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:34,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:36,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:38,528 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:14:38,528 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:14:38,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:40,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:42,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:44,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:46,310 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:14:46,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:48,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:50,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:52,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:53,603 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:14:53,603 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:14:54,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:56,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:14:58,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:00,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:02,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:04,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:06,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:08,674 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:15:08,674 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:15:08,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:10,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:12,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:14,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:16,549 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:15:16,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:18,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:20,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:22,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:23,783 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:15:23,783 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:15:24,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:26,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:28,332 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:15:28,332 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:15:28,337 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:15:28,337 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:15:28,338 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-09 22:15:28,338 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:15:28,349 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:15:28,379 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:15:28,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:15:28,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:29,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:30,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:32,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:38,892 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:15:38,893 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:15:42,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:44,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:46,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:46,811 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:15:48,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:49,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/config.yaml 2022-01-09 22:15:50,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:52,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:53,989 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:15:53,990 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:15:54,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:56,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:15:58,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:00,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:02,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:04,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:07,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:09,087 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:16:09,087 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:16:09,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:11,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:13,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:15,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:17,121 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:16:17,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:19,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:21,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:23,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:24,370 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:16:24,499 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:16:25,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:27,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:29,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:31,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:33,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:35,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:37,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:39,617 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:16:39,617 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:16:39,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:41,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:43,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:45,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:47,366 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:16:47,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:49,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:51,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:53,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:54,695 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:16:54,695 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:16:55,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:57,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:16:59,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:01,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:03,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:05,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:07,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:09,812 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:17:09,812 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:17:09,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:11,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:13,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:15,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:17,604 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:17:17,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:19,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:21,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:23,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:24,898 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:17:24,898 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:17:25,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:27,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:29,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:31,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:33,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:35,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:37,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:39,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:39,975 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:17:39,975 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:17:41,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:43,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:45,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:46,069 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:17:46,124 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:17:46,147 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:17:46,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:17:47,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:47,854 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:17:48,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:49,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:51,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:53,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:55,093 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:17:55,093 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:17:55,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:57,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:17:59,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:01,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:03,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:05,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:07,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:09,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:10,194 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:18:10,194 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:18:11,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:13,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:15,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:17,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:18,093 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:18:19,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:22,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:24,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:25,265 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:18:25,266 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:18:26,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:28,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:30,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:32,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:34,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:36,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:38,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:40,336 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:18:40,337 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:18:40,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:42,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:44,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:46,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:48,343 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:18:48,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:50,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:52,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:54,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:55,531 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:18:55,532 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:18:56,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:18:58,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:00,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:02,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:04,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:06,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:08,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:10,610 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:19:10,610 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:19:10,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:12,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:14,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:16,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:18,599 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:19:18,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:20,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:22,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:24,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:25,679 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:19:25,679 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:19:26,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:28,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:30,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:32,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:34,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:38,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:40,769 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:19:40,769 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:19:40,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:42,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:44,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:46,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:48,845 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:19:48,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:50,142 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:19:50,189 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:19:50,219 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:19:50,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:19:50,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:52,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:54,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:55,842 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:19:55,843 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:19:56,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:19:58,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:00,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:02,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:04,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:06,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:08,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:10,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:10,950 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:20:10,951 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:20:12,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:14,854 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:16,854 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:18,854 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:19,101 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:20:20,855 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:22,855 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:24,855 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:26,027 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:20:26,028 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:20:26,855 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:28,856 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:30,856 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:32,856 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:34,857 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:37,857 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:41,148 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:20:41,148 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:20:41,858 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:43,858 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:45,858 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:47,859 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:49,332 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:20:49,859 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:51,859 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:53,860 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:55,860 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:56,253 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:20:56,253 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:20:57,861 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:20:59,861 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:01,861 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:03,861 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:05,862 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:07,862 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:09,862 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:11,327 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:21:11,327 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:21:11,863 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:13,863 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:15,863 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:17,864 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:19,572 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:21:19,864 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:21,864 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:23,865 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:25,865 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:26,397 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:21:26,398 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:21:27,865 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:29,866 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:31,866 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:33,866 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:35,867 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:37,867 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:39,867 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:41,536 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:21:41,536 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:21:41,868 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:43,868 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:45,868 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:47,868 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:49,815 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:21:49,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:51,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:53,406 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:21:53,453 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:21:53,481 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:21:53,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:21:53,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:55,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:56,731 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:21:56,731 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:21:57,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:21:59,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:01,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:03,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:05,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:07,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:09,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:11,806 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:22:11,806 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:22:11,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:13,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:15,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:17,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:19,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:20,058 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:22:21,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:23,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:25,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:26,881 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:22:26,881 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:22:27,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:29,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:31,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:33,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:35,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:37,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:39,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:41,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:41,953 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:22:41,953 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:22:43,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:45,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:48,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:50,307 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:22:50,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:52,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:54,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:56,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:22:57,051 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:22:57,052 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:22:58,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:00,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:02,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:04,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:06,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:08,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:10,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:12,162 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:23:12,162 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:23:12,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:14,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:16,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:18,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:20,555 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:23:20,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:22,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:24,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:26,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:27,312 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:23:27,312 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:23:28,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:30,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:32,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:34,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:36,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:38,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:40,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:42,384 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:23:42,384 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:23:42,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:46,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:48,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:50,799 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:23:50,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:52,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:54,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:56,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:57,455 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:23:57,455 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:23:57,547 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:23:57,577 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:23:57,602 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:23:57,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:23:58,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:23:59,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:00,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:02,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:04,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:06,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:08,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:10,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:12,565 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:24:12,565 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:24:12,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:14,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:16,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:18,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:20,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:21,047 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:24:22,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:24,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:26,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:27,657 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:24:27,658 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:24:28,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:30,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:32,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:34,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:36,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:38,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:40,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:42,765 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:24:42,765 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:24:42,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:44,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:46,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:48,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:50,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:51,303 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:24:52,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:54,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:56,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:24:57,833 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:24:57,833 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:24:58,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:00,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:02,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:05,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:07,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:09,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:11,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:12,905 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:25:12,905 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:25:13,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:15,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:17,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:19,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:21,538 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:25:21,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:23,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:25,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:27,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:27,977 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:25:27,977 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:25:29,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:31,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:33,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:35,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:37,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:39,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:41,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:43,054 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:25:43,054 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:25:43,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:45,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:47,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:51,771 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:25:51,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:53,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:55,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:57,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:25:58,149 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:25:58,149 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:25:59,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:01,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:02,157 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:26:02,205 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:26:02,231 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:26:02,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:26:03,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:05,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:07,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:09,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:11,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:13,338 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:26:13,338 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:26:13,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:15,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:17,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:19,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:21,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:22,020 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:26:23,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:25,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:27,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:28,425 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:26:28,425 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:26:29,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:31,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:33,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:35,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:37,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:39,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:41,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:43,501 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:26:43,501 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:26:43,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:45,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:47,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:49,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:51,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:52,272 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:26:53,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:55,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:57,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:26:58,610 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:26:58,610 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:26:59,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:01,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:04,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:06,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:08,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:10,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:12,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:13,742 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:27:13,742 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:27:14,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:16,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:18,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:20,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:22,519 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:27:22,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:24,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:26,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:28,825 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:27:28,826 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:27:28,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:30,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:32,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:34,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:36,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:38,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:40,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:42,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:43,911 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:27:43,911 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:27:44,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:46,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:48,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:50,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:52,761 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:27:52,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:54,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:56,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:58,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:27:58,979 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:27:58,979 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:28:00,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:02,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:04,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:06,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:08,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:10,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:12,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:14,072 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:28:14,072 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:28:14,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:16,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:18,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:20,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:22,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:23,009 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:28:24,500 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:28:24,516 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:28:24,544 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:28:24,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:28:24,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:26,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:29,512 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:28:29,512 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:28:44,590 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:28:44,590 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:28:53,344 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:28:56,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:28:59,668 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:28:59,668 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:29:14,744 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:29:14,745 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:29:23,634 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:29:28,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:29,857 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:29:29,857 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:29:30,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:32,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:34,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:36,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:38,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:40,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:42,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:44,926 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:29:44,927 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:29:44,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:46,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:48,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:50,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:52,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:53,904 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:29:54,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:56,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:29:58,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:00,002 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:30:00,002 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:30:01,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:03,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:05,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:07,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:09,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:11,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:13,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:15,080 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:30:15,080 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:30:15,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:17,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:19,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:21,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:23,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:24,160 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:30:25,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:27,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:29,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:30,239 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:30:30,239 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:30:31,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:33,967 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:35,967 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:37,967 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:39,968 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:41,968 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:43,968 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:45,319 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:30:45,319 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:30:45,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:47,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:49,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:51,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:53,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:54,407 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:30:55,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:57,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:30:59,971 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:00,391 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:31:00,391 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:31:01,971 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:03,971 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:05,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:07,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:09,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:11,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:13,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:15,470 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:31:15,471 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:31:15,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:17,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:19,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:21,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:23,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:24,656 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:31:25,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:27,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:29,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:30,558 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:31:30,558 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:31:31,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:33,488 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:31:33,537 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:31:33,561 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:31:33,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:31:33,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:35,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:37,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:39,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:41,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:43,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:45,695 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:31:45,696 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:31:45,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:47,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:49,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:51,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:53,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:54,910 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:31:55,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:57,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:31:59,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:00,790 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:32:00,791 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:32:01,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:03,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:05,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:07,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:10,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:12,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:14,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:15,875 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:32:15,875 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:32:16,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:18,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:20,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:22,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:24,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:25,155 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:32:26,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:28,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:30,959 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:32:30,959 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:32:30,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:32,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:34,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:36,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:38,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:40,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:42,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:44,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:46,075 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:32:46,075 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:32:46,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:48,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:50,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:52,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:54,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:55,396 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:32:56,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:32:58,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:00,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:01,181 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:33:01,181 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:33:02,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:04,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:06,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:08,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:10,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:12,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:14,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:16,308 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:33:16,309 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:33:16,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:18,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:20,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:22,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:24,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:25,614 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:33:26,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:28,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:30,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:31,453 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:33:31,453 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:33:32,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:34,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:36,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:38,455 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:33:38,508 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:33:38,530 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:33:38,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:33:38,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:39,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:40,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:42,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:44,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:46,569 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:33:46,570 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:33:46,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:48,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:50,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:53,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:55,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:55,840 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:33:57,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:33:59,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:01,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:01,661 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:34:01,661 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:34:03,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:05,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:07,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:09,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:11,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:13,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:15,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:16,823 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:34:16,823 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:34:17,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:19,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:21,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:23,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:25,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:26,068 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:34:28,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:30,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:31,937 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:34:31,937 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:34:32,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:34,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:36,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:38,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:40,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:42,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:44,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:46,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:47,007 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:34:47,007 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:34:48,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:50,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:52,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:54,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:56,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:34:56,290 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:34:58,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:00,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:02,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:02,086 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:35:02,086 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:35:04,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:06,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:08,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:10,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:12,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:14,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:16,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:17,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:35:17,175 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:35:18,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:20,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:22,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:24,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:26,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:26,518 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:35:28,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:30,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:32,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:32,258 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:35:32,258 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:35:34,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:36,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:38,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:40,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:42,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:42,207 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:35:42,250 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:35:42,272 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:35:43,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:35:44,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:46,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:47,333 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:35:47,333 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:35:48,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:50,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:54,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:56,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:35:56,739 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:35:58,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:00,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:02,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:02,406 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:36:02,406 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:36:04,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:06,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:08,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:10,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:12,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:14,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:16,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:17,492 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:36:17,493 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:36:18,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:20,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:22,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:24,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:26,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:26,963 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:36:28,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:30,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:32,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:32,569 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:36:32,569 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:36:34,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:36,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:38,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:40,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:42,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:44,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:46,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:47,673 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:36:47,673 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:36:48,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:50,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:52,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:55,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:57,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:36:57,190 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:36:59,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:01,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:02,771 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:37:02,771 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:37:03,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:05,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:07,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:09,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:11,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:13,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:15,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:17,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:17,881 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:37:17,881 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:37:19,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:21,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:23,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:25,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:27,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:27,415 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:37:29,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:31,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:32,964 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:37:32,965 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:37:33,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:35,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:37,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:39,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:41,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:43,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:45,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:45,875 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:37:45,918 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:37:45,942 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:37:46,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:37:47,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:48,120 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:37:48,121 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:37:49,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:51,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:53,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:55,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:57,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:37:57,642 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:37:59,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:01,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:03,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:03,201 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:38:03,201 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:38:05,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:07,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:09,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:11,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:13,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:15,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:17,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:18,302 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:38:18,302 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:38:19,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:21,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:23,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:25,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:27,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:27,872 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:38:29,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:31,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:33,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:33,422 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:38:33,422 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:38:35,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:37,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:39,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:41,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:43,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:45,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:47,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:48,495 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:38:48,495 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:38:49,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:51,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:53,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:55,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:57,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:38:58,083 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:38:59,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:01,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:03,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:03,578 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:39:03,579 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:39:06,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:08,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:10,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:12,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:14,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:16,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:18,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:18,681 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:39:18,682 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:39:20,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:22,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:24,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:26,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:28,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:28,303 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:39:30,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:32,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:33,777 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:39:33,777 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:39:34,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:36,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:38,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:40,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:42,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:44,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:46,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:48,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:48,869 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:39:48,869 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:39:49,455 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:39:49,497 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:39:49,519 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:39:50,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:39:50,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:51,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:52,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:54,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:56,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:58,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:39:58,535 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:40:00,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:02,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:03,943 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:40:03,943 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:40:04,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:06,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:08,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:10,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:12,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:14,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:16,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:18,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:19,039 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:40:19,039 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:40:20,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:22,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:24,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:26,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:28,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:28,773 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:40:30,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:32,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:34,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:34,136 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:40:34,136 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:40:36,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:38,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:40,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:42,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:44,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:46,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:48,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:49,257 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:40:49,257 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:40:50,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:52,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:54,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:56,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:58,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:40:59,004 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:41:00,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:02,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:04,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:04,413 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:41:04,413 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:41:06,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:08,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:10,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:12,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:15,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:17,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:19,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:19,528 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:41:19,528 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:41:21,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:23,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:25,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:27,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:29,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:29,240 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:41:31,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:33,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:34,634 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:41:34,634 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:41:35,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:37,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:39,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:41,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:43,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:45,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:47,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:49,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:49,709 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:41:49,709 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:41:51,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:53,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:55,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:57,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:59,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:41:59,481 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:42:01,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:03,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:04,846 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:42:04,846 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:42:05,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:07,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:09,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:11,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:11,408 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:42:11,421 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:42:11,442 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:42:12,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:42:12,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:13,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:15,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:19,920 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:42:19,921 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:42:29,768 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:42:34,999 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:42:34,999 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:42:47,094 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:42:50,080 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:42:50,080 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:43:00,077 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:43:05,154 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:43:05,155 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:43:19,102 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:20,229 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:43:20,229 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:43:21,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:23,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:25,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:27,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:29,104 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:30,337 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:43:31,104 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:33,104 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:35,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:35,309 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:43:35,309 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:43:37,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:39,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:41,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:43,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:45,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:47,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:49,107 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:50,498 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:43:50,498 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:43:51,107 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:53,108 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:55,108 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:57,108 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:43:59,109 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:00,569 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:44:01,109 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:03,109 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:05,110 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:05,667 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:44:05,668 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:44:07,110 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:09,110 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:11,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:13,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:16,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:18,112 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:20,112 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:20,737 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:44:20,737 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:44:22,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:24,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:26,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:28,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:30,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:30,798 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:44:32,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:34,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:35,804 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:44:35,804 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:44:36,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:38,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:40,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:42,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:44,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:46,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:48,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:50,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:50,991 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:44:50,991 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:44:52,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:54,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:56,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:44:58,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:00,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:01,043 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:45:02,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:04,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:06,101 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:45:06,101 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:45:06,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:08,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:10,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:12,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:14,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:16,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:18,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:20,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:20,896 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:45:20,940 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:45:20,970 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:45:21,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:45:21,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:45:21,175 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:45:22,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:24,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:26,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:28,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:30,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:31,282 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:45:32,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:34,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:36,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:36,270 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:45:36,270 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:45:38,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:40,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:42,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:44,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:46,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:48,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:50,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:51,337 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:45:51,337 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:45:53,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:55,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:57,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:45:59,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:01,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:01,519 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:46:03,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:05,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:06,448 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:46:06,448 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:46:07,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:09,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:11,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:13,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:15,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:17,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:19,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:21,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:21,557 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:46:21,557 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:46:23,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:25,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:29,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:31,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:31,760 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:46:33,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:35,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:36,647 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:46:36,647 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:46:37,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:39,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:41,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:43,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:45,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:47,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:49,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:51,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:51,770 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:46:51,770 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:46:53,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:55,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:57,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:46:59,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:01,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:01,996 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:47:03,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:05,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:06,879 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:47:06,879 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:47:07,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:09,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:11,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:13,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:15,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:17,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:19,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:21,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:21,964 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:47:21,964 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:47:23,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:25,087 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:47:25,129 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:47:25,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:47:25,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:25,153 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:47:27,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:29,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:31,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:32,231 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:47:33,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:35,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:37,043 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:47:37,044 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:47:37,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:39,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:41,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:43,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:45,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:47,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:49,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:52,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:52,297 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:47:52,297 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:47:54,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:56,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:47:58,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:00,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:02,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:02,467 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:48:04,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:06,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:07,454 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:48:07,454 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:48:08,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:10,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:12,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:14,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:16,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:18,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:20,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:22,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:22,529 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:48:22,529 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:48:24,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:26,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:28,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:30,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:32,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:32,698 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:48:34,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:36,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:37,644 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:48:37,645 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:48:38,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:40,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:42,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:44,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:46,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:48,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:50,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:52,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:52,714 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:48:52,714 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:48:54,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:56,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:48:58,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:00,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:02,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:02,921 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:49:04,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:06,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:07,789 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:49:07,789 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:49:08,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:11,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:13,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:15,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:17,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:19,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:21,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:22,906 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:49:22,906 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:49:23,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:25,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:27,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:29,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:31,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:31,564 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:49:31,612 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:49:31,634 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:49:32,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:49:33,157 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:49:33,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:35,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:37,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:38,027 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:49:38,027 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:49:39,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:41,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:43,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:45,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:47,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:49,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:51,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:53,116 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:49:53,116 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:49:53,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:55,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:57,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:49:59,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:01,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:03,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:03,392 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:50:05,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:07,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:08,209 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:50:08,209 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:50:09,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:11,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:13,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:15,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:17,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:19,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:21,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:23,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:23,315 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:50:23,315 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:50:25,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:27,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:29,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:31,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:33,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:33,624 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:50:35,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:37,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:38,393 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:50:38,393 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:50:39,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:41,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:43,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:45,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:47,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:49,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:51,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:53,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:53,479 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:50:53,479 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:50:55,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:57,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:50:59,186 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:01,186 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:03,186 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:03,858 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:51:05,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:07,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:08,559 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:51:08,559 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:51:09,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:11,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:13,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:15,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:18,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:20,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:22,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:23,631 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:51:23,631 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:51:24,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:26,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:28,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:30,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:32,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:34,084 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:51:34,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:35,340 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:51:35,381 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:51:35,403 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:51:36,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:51:36,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:37,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:38,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:38,727 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:51:38,728 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:51:40,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:42,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:44,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:46,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:48,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:50,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:52,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:53,823 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:51:53,823 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:51:54,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:56,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:51:58,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:00,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:02,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:04,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:04,315 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:52:06,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:08,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:08,927 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:52:08,927 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:52:10,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:12,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:14,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:16,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:18,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:20,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:22,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:24,035 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:52:24,035 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:52:24,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:26,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:28,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:30,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:32,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:34,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:34,545 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:52:36,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:38,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:39,117 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:52:39,117 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:52:40,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:42,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:44,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:46,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:48,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:50,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:52,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:54,203 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:52:54,203 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:52:54,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:56,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:52:58,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:00,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:02,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:04,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:04,774 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:53:06,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:08,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:09,276 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:53:09,276 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:53:10,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:12,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:14,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:16,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:18,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:20,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:22,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:24,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:24,375 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:53:24,375 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:53:27,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:29,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:31,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:33,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:35,003 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:53:35,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:37,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:39,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:39,484 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:53:39,485 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:53:39,618 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:53:39,659 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:53:39,681 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:53:40,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:53:41,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:42,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:43,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:45,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:47,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:49,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:51,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:53,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:54,612 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:53:54,612 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:53:55,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:57,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:53:59,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:01,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:03,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:05,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:05,236 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:54:07,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:09,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:09,686 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:54:09,686 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:54:11,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:13,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:15,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:17,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:19,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:21,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:23,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:25,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:25,796 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:54:25,796 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:54:27,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:29,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:31,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:34,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:35,488 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:54:36,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:38,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:40,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:40,949 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:54:40,949 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:54:42,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:44,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:46,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:48,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:50,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:52,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:54,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:56,023 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:54:56,023 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:54:56,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:54:58,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:00,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:02,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:04,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:05,732 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:55:06,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:08,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:10,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:11,167 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:55:11,168 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:55:12,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:14,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:16,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:18,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:20,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:22,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:24,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:26,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:26,239 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:55:26,239 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:55:28,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:30,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:32,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:34,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:35,978 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:55:36,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:38,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:40,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:41,724 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:55:41,724 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:55:42,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:44,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:46,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:48,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:50,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:52,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:54,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:56,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:55:56,797 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:55:56,798 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:55:58,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:00,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:01,632 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:56:01,649 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:56:01,678 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:56:02,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:56:02,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:04,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:06,221 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:56:11,920 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:56:11,921 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:56:14,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:27,032 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:56:27,032 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:56:36,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:36,504 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:56:42,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:56:42,176 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:56:46,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:48,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:50,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:52,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:54,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:56,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:56:57,250 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:56:57,250 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:56:58,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:01,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:03,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:05,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:06,755 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:57:07,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:09,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:11,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:12,403 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:57:12,403 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:57:13,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:15,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:17,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:19,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:21,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:23,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:25,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:27,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:27,508 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:57:27,508 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:57:29,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:31,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:33,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:35,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:37,009 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:57:37,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:39,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:41,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:42,614 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:57:42,614 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:57:43,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:45,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:47,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:49,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:51,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:53,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:55,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:57,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:57:57,734 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:57:57,734 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:57:59,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:01,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:03,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:05,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:07,259 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:58:07,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:09,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:11,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:12,854 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:58:12,854 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:58:13,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:15,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:17,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:19,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:21,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:23,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:25,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:27,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:27,990 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:58:27,990 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:58:29,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:31,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:33,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:35,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:37,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:37,515 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:58:39,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:41,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:43,083 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:58:43,083 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:58:43,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:45,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:47,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:47,928 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 22:58:47,969 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 22:58:47,990 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 22:58:48,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 22:58:49,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:51,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:53,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:55,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:57,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:58:58,189 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:58:58,190 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:58:59,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:01,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:03,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:05,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:07,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:07,753 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:59:09,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:11,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:13,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:13,292 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:59:13,292 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:59:15,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:17,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:19,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:21,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:23,276 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:25,276 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:27,276 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:28,386 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:59:28,386 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:59:29,277 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:31,277 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:33,277 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:35,277 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:37,278 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:38,001 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 22:59:40,278 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:42,279 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:43,472 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:59:43,472 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 22:59:44,279 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:46,279 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:48,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:50,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:52,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:54,281 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:56,281 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:58,281 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 22:59:58,572 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 22:59:58,572 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:00:00,282 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:02,282 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:04,282 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:06,283 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:08,252 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:00:08,283 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:10,283 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:12,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:13,699 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:00:13,699 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:00:14,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:16,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:18,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:20,285 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:22,285 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:24,285 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:26,286 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:28,286 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:28,803 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:00:28,803 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:00:30,286 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:32,287 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:34,287 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:36,287 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:38,288 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:38,496 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:00:40,288 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:42,288 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:43,885 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:00:43,886 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:00:44,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:46,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:48,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:50,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:51,740 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:00:51,781 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:00:51,803 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:00:52,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:00:52,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:53,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:54,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:56,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:58,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:00:58,987 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:00:58,987 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:01:00,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:02,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:04,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:06,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:08,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:08,753 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:01:10,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:12,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:14,076 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:01:14,076 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:01:14,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:16,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:18,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:20,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:22,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:24,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:26,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:28,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:29,149 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:01:29,150 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:01:30,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:32,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:34,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:36,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:38,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:39,000 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:01:40,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:42,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:44,251 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:01:44,251 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:01:44,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:46,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:48,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:50,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:52,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:54,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:56,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:58,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:01:59,326 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:01:59,326 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:02:00,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:02,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:04,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:06,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:08,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:09,246 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:02:10,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:12,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:14,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:14,479 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:02:14,479 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:02:17,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:19,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:21,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:23,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:25,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:27,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:29,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:29,550 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:02:29,551 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:02:31,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:33,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:35,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:37,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:39,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:39,487 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:02:41,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:43,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:44,620 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:02:44,620 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:02:45,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:47,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:49,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:51,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:53,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:55,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:55,657 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:02:55,698 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:02:55,720 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:02:56,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:02:57,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:58,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:59,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:02:59,757 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:02:59,757 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:03:01,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:03,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:05,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:07,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:09,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:09,734 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:03:11,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:13,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:15,235 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:03:15,235 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:03:15,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:17,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:19,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:21,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:23,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:25,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:27,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:29,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:30,310 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:03:30,310 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:03:31,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:33,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:35,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:37,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:39,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:39,985 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:03:41,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:43,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:45,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:45,380 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:03:45,380 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:03:47,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:49,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:51,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:53,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:55,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:57,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:03:59,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:00,570 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:04:00,570 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:04:01,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:03,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:05,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:07,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:09,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:10,219 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:04:11,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:13,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:15,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:15,649 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:04:15,650 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:04:17,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:19,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:21,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:23,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:25,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:27,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:29,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:30,773 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:04:30,773 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:04:31,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:33,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:35,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:37,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:39,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:40,451 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:04:41,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:44,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:46,016 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:04:46,016 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:04:46,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:48,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:50,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:52,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:54,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:56,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:58,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:04:59,077 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:04:59,118 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:04:59,140 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:04:59,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:05:00,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:01,146 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:05:01,147 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:05:02,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:04,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:06,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:08,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:10,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:10,713 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:05:14,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:16,263 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:05:16,263 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:05:16,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:18,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:20,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:22,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:24,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:26,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:28,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:30,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:31,328 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:05:31,328 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:05:32,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:34,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:36,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:38,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:40,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:40,968 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:05:42,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:44,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:46,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:46,422 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:05:46,423 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:05:48,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:50,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:52,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:54,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:56,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:05:58,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:00,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:01,524 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:06:01,524 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:06:02,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:04,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:06,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:08,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:10,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:11,209 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:06:12,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:14,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:16,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:16,620 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:06:16,620 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:06:18,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:20,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:22,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:24,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:26,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:28,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:30,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:31,703 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:06:31,703 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:06:32,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:34,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:36,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:38,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:40,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:41,446 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:06:42,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:44,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:46,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:46,788 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:06:46,788 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:06:48,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:50,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:52,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:54,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:56,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:06:58,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:00,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:01,863 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:07:01,863 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:07:02,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:04,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:04,798 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:07:04,839 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:07:04,861 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:07:05,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:07:06,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:07,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:09,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:11,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:11,687 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:07:13,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:15,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:16,935 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:07:16,936 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:07:17,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:19,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:21,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:23,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:25,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:27,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:29,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:31,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:32,073 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:07:32,073 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:07:33,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:35,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:37,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:39,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:41,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:41,939 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:07:43,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:45,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:47,234 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:07:47,234 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:07:47,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:49,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:51,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:53,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:55,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:57,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:07:59,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:01,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:02,357 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:08:02,357 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:08:03,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:05,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:07,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:09,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:11,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:12,194 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:08:13,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:15,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:17,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:17,436 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:08:17,436 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:08:19,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:21,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:23,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:25,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:27,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:29,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:31,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:32,518 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:08:32,518 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:08:33,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:35,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:37,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:39,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:41,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:42,443 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:08:43,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:45,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:47,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:47,621 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:08:47,621 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:08:49,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:51,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:54,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:56,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:08:58,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:00,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:02,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:02,822 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:09:02,822 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:09:04,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:06,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:08,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:10,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:12,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:12,697 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:09:14,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:16,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:17,890 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:09:17,890 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:09:18,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:20,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:22,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:24,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:26,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:26,405 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:09:26,425 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:09:26,453 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:09:27,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:09:27,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:28,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:09:32,959 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:09:32,960 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:09:42,984 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:09:48,054 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:09:48,054 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:09:48,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:03,135 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:10:03,136 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:10:13,272 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:10:18,241 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:10:18,241 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:10:20,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:22,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:24,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:26,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:28,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:30,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:32,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:33,337 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:10:33,337 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:10:34,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:36,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:38,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:40,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:42,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:43,516 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:10:44,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:46,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:48,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:48,412 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:10:48,412 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:10:50,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:52,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:54,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:56,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:10:58,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:00,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:02,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:03,489 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:11:03,489 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:11:04,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:06,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:08,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:10,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:12,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:13,754 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:11:14,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:16,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:18,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:18,620 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:11:18,620 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:11:20,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:22,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:25,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:27,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:29,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:31,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:33,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:33,689 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:11:33,689 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:11:35,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:37,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:39,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:41,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:43,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:43,985 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:11:45,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:47,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:48,783 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:11:48,783 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:11:49,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:51,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:53,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:55,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:57,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:11:59,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:01,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:03,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:03,926 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:12:03,926 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:12:05,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:07,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:09,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:11,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:13,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:14,218 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:12:15,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:17,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:19,073 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:12:19,073 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:12:19,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:21,070 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:12:21,109 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:12:21,130 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:12:21,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:12:21,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:23,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:25,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:27,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:29,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:31,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:33,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:34,194 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:12:34,194 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:12:35,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:37,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:39,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:41,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:43,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:44,449 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:12:45,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:47,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:49,267 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:12:49,267 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:12:49,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:51,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:53,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:55,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:57,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:12:59,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:01,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:03,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:04,374 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:13:04,374 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:13:05,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:07,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:09,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:11,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:13,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:14,686 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:13:15,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:17,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:19,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:19,526 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:13:19,526 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:13:21,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:23,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:25,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:27,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:29,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:31,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:33,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:34,599 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:13:34,599 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:13:35,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:37,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:39,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:41,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:43,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:44,927 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:13:45,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:47,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:49,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:49,702 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:13:49,702 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:13:51,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:53,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:55,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:57,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:13:59,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:01,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:03,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:04,782 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:14:04,782 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:14:05,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:07,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:09,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:11,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:13,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:15,152 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:14:15,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:17,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:19,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:19,852 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:14:19,852 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:14:21,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:23,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:25,102 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:14:25,144 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:14:25,165 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:14:25,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:14:25,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:26,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:27,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:29,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:31,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:33,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:34,935 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:14:34,936 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:14:35,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:37,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:39,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:41,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:43,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:45,382 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:14:45,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:47,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:50,009 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:14:50,009 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:14:50,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:52,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:54,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:56,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:14:58,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:00,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:02,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:04,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:05,378 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:15:05,378 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:15:06,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:08,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:10,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:12,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:14,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:15,613 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:15:16,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:18,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:20,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:20,519 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:15:20,519 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:15:22,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:24,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:26,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:28,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:30,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:32,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:34,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:35,609 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:15:35,609 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:15:36,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:38,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:40,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:42,443 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:44,443 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:45,832 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:15:46,443 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:48,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:50,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:50,714 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:15:50,714 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:15:52,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:54,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:56,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:15:58,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:00,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:02,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:04,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:05,819 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:16:05,819 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:16:06,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:08,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:10,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:12,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:14,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:16,057 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:16:16,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:18,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:20,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:20,941 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:16:20,941 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:16:22,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:24,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:26,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:28,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:29,655 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:16:29,704 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:16:29,729 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:16:30,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:16:30,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:32,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:34,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:36,020 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:16:36,020 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:16:36,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:38,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:40,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:42,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:44,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:46,282 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:16:46,453 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:48,453 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:50,453 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:51,104 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:16:51,104 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:16:52,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:54,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:56,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:16:58,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:00,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:02,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:04,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:06,177 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:17:06,177 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:17:06,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:08,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:10,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:12,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:14,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:16,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:16,521 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:17:18,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:20,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:21,349 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:17:21,349 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:17:22,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:24,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:26,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:28,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:30,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:32,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:34,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:36,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:36,481 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:17:36,481 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:17:38,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:40,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:42,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:45,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:46,766 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:17:47,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:49,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:51,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:51,594 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:17:51,595 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:17:53,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:55,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:57,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:17:59,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:01,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:03,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:05,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:06,693 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:18:06,693 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:18:09,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:11,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:13,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:15,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:17,022 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:18:17,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:19,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:21,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:21,771 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:18:21,771 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:18:23,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:25,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:27,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:29,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:31,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:33,417 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:18:33,459 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:18:33,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:33,481 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:18:34,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:18:35,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:36,844 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:18:36,844 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:18:37,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:39,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:41,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:43,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:45,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:47,262 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:18:47,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:49,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:51,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:51,943 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:18:51,943 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:18:53,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:55,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:57,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:18:59,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:01,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:03,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:05,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:07,019 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:19:07,019 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:19:07,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:09,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:11,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:13,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:15,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:17,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:17,503 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:19:19,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:21,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:22,105 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:19:22,105 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:19:23,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:25,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:27,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:29,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:31,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:33,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:35,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:37,243 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:19:37,243 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:19:37,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:39,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:41,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:43,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:45,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:47,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:47,743 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:19:49,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:51,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:52,398 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:19:52,398 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:19:53,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:55,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:57,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:19:59,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:01,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:03,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:05,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:07,475 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:20:07,475 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:20:07,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:10,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:12,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:14,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:16,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:17,981 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:20:18,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:20,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:22,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:22,592 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:20:22,592 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:20:24,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:26,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:28,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:30,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:32,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:34,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:36,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:37,107 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:20:37,150 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:20:37,172 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:20:37,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:20:37,665 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:20:37,666 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:20:38,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:39,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:40,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:42,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:44,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:46,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:48,248 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:20:48,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:50,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:52,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:52,785 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:20:52,786 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:20:54,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:56,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:20:58,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:00,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:02,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:04,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:06,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:07,872 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:21:07,872 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:21:08,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:10,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:12,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:14,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:16,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:18,498 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:21:18,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:20,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:22,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:22,982 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:21:22,983 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:21:24,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:26,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:28,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:30,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:32,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:34,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:36,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:38,068 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:21:38,069 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:21:38,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:40,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:42,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:44,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:46,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:48,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:48,760 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:21:50,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:52,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:53,195 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:21:53,195 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:21:54,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:56,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:21:58,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:00,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:02,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:04,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:06,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:08,270 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:22:08,270 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:22:08,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:10,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:12,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:15,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:17,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:19,010 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:22:19,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:21,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:23,394 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:22:23,394 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:22:23,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:25,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:27,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:29,518 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:31,518 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:33,518 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:35,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:37,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:38,506 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:22:38,508 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:22:39,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:41,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:43,520 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:45,520 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:47,520 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:49,261 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:22:49,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:51,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:53,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:53,615 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:22:53,615 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:22:55,522 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:57,522 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:22:58,694 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:22:58,714 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:22:58,743 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:22:59,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:22:59,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:23:00,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:23:01,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:23:08,689 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:23:08,689 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:23:19,568 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:23:23,765 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:23:23,765 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:23:38,835 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:23:38,835 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:23:39,539 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:23:49,880 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:23:53,915 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:23:53,915 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:24:08,993 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:24:08,993 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:24:11,547 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:13,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:15,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:17,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:19,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:20,140 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:24:21,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:23,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:24,078 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:24:24,078 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:24:25,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:27,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:29,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:31,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:33,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:35,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:37,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:39,160 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:24:39,160 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:24:39,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:41,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:43,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:45,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:47,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:49,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:50,375 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:24:51,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:53,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:54,236 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:24:54,236 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:24:55,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:57,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:24:59,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:01,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:03,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:05,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:07,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:09,334 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:25:09,334 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:25:09,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:11,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:13,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:15,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:17,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:19,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:20,607 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:25:21,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:23,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:24,446 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:25:24,446 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:25:25,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:27,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:29,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:31,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:33,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:35,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:37,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:39,519 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:25:39,519 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:25:40,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:42,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:44,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:46,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:48,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:50,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:50,834 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:25:52,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:54,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:54,644 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:25:54,644 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:25:56,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:25:58,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:00,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:02,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:04,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:06,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:08,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:09,802 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:26:09,802 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:26:12,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:14,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:14,679 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:26:14,726 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:26:14,748 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:26:15,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:26:16,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:18,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:20,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:21,095 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:26:22,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:24,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:24,936 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:26:24,936 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:26:26,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:28,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:30,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:32,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:34,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:36,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:38,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:40,004 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:26:40,005 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:26:40,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:42,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:44,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:46,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:48,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:50,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:51,334 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:26:52,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:54,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:55,075 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:26:55,075 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:26:56,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:26:58,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:00,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:02,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:04,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:06,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:08,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:10,330 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:27:10,330 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:27:10,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:12,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:14,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:16,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:18,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:20,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:21,561 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:27:22,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:24,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:25,437 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:27:25,437 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:27:26,579 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:28,579 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:30,579 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:32,580 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:34,580 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:36,580 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:38,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:40,535 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:27:40,535 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:27:40,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:42,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:44,582 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:46,582 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:49,583 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:51,583 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:51,788 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:27:53,583 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:55,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:55,607 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:27:55,607 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:27:57,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:27:59,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:01,585 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:03,585 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:05,585 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:07,586 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:09,586 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:10,706 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:28:10,706 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:28:11,586 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:13,587 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:15,587 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:17,587 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:19,335 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:28:19,383 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:28:19,405 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:28:19,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:28:19,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:21,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:22,022 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:28:23,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:25,589 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:25,788 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:28:25,788 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:28:27,589 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:29,589 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:31,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:33,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:35,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:37,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:39,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:40,859 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:28:40,859 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:28:41,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:43,592 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:45,592 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:47,592 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:49,593 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:51,593 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:52,249 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:28:53,593 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:55,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:55,955 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:28:55,955 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:28:57,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:28:59,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:01,595 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:03,595 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:05,595 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:07,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:09,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:11,109 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:29:11,110 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:29:11,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:13,597 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:15,597 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:17,597 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:19,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:22,472 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:29:22,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:24,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:26,204 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:29:26,204 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:29:26,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:28,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:30,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:32,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:34,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:36,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:38,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:40,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:41,283 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:29:41,283 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:29:42,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:44,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:46,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:48,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:50,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:52,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:52,700 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:29:54,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:56,358 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:29:56,359 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:29:56,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:29:58,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:00,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:02,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:04,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:06,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:08,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:10,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:11,428 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:30:11,428 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:30:12,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:14,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:16,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:18,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:20,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:22,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:22,931 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:30:23,103 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:30:23,139 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:30:23,161 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:30:23,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:30:24,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:25,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:26,559 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:30:26,559 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:30:26,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:28,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:30,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:32,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:34,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:36,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:38,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:40,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:41,652 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:30:41,652 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:30:42,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:44,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:46,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:48,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:50,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:52,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:53,154 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:30:54,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:56,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:30:56,744 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:30:56,744 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:30:58,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:00,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:02,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:04,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:06,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:08,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:10,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:11,864 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:31:11,864 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:31:12,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:14,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:16,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:18,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:20,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:22,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:23,393 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:31:24,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:26,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:26,962 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:31:26,962 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:31:28,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:30,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:32,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:34,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:37,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:39,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:41,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:42,061 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:31:42,061 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:31:43,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:45,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:47,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:49,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:51,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:53,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:53,624 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:31:55,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:57,184 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:31:57,184 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:31:57,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:31:59,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:01,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:03,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:05,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:07,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:09,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:11,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:12,269 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:32:12,270 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:32:13,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:15,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:17,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:19,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:21,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:23,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:23,854 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:32:25,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:26,354 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:32:26,402 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:32:26,424 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:32:26,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:32:27,379 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:32:27,379 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:32:27,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:29,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:31,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:33,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:35,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:37,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:39,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:41,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:42,460 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:32:42,460 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:32:43,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:45,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:47,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:49,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:51,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:53,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:54,081 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:32:55,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:57,533 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:32:57,533 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:32:57,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:32:59,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:01,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:03,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:05,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:07,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:09,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:11,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:12,607 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:33:12,607 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:33:13,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:16,635 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:20,635 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:22,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:24,308 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:33:24,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:26,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:27,707 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:33:27,707 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:33:28,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:30,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:32,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:34,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:36,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:38,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:40,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:42,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:42,801 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:33:42,801 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:33:44,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:46,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:48,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:50,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:52,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:54,537 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:33:54,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:56,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:33:57,890 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:33:57,890 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:33:58,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:00,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:02,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:04,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:06,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:08,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:10,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:12,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:12,961 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:34:12,961 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:34:14,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:16,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:18,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:20,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:22,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:24,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:24,759 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:34:26,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:28,079 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:34:28,079 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:34:28,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:30,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:31,388 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:34:31,429 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:34:31,451 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:34:31,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:34:32,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:34,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:36,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:38,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:40,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:42,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:43,162 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:34:43,163 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:34:44,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:46,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:48,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:50,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:52,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:54,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:54,988 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:34:56,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:34:58,312 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:34:58,312 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:34:58,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:00,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:02,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:04,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:07,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:09,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:11,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:13,412 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:35:13,412 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:35:13,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:15,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:17,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:19,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:21,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:23,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:25,223 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:35:25,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:27,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:28,554 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:35:28,554 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:35:29,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:31,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:33,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:35,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:37,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:39,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:41,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:43,625 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:35:43,625 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:35:43,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:45,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:47,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:49,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:51,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:53,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:55,466 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:35:55,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:57,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:35:58,731 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:35:58,733 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:35:59,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:01,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:03,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:05,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:07,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:09,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:11,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:13,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:13,832 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:36:13,832 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:36:15,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:17,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:19,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:21,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:23,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:25,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:25,704 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:36:27,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:28,941 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:36:28,941 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:36:29,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:31,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:33,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:35,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:38,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:40,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:42,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:44,072 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:36:44,072 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:36:44,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:46,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:48,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:50,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:52,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:53,713 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:36:53,728 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:36:53,755 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:36:54,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:36:54,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:55,937 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:36:56,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:36:59,144 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:36:59,145 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:37:14,415 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:37:14,415 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:37:26,271 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:37:28,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:37:29,484 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:37:29,484 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:37:44,582 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:37:44,582 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:37:56,552 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:37:59,659 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:37:59,659 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:38:00,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:02,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:04,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:06,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:08,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:10,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:12,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:14,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:14,749 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:38:14,915 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:38:16,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:18,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:20,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:22,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:24,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:26,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:26,808 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:38:28,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:29,982 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:38:29,982 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:38:30,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:32,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:34,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:36,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:38,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:40,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:42,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:44,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:45,079 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:38:45,080 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:38:46,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:48,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:50,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:52,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:54,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:56,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:38:57,060 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:38:58,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:00,193 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:39:00,193 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:39:00,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:02,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:04,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:06,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:08,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:10,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:12,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:14,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:15,315 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:39:15,315 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:39:16,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:18,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:20,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:22,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:24,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:26,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:27,301 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:39:28,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:30,384 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:39:30,384 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:39:30,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:32,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:34,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:36,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:38,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:40,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:42,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:44,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:45,641 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:39:45,641 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:39:46,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:48,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:51,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:53,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:55,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:57,552 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:39:57,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:39:59,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:00,745 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:40:00,746 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:40:01,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:03,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:04,043 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:40:04,099 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:40:04,122 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:40:04,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:40:05,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:07,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:09,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:11,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:13,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:15,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:15,816 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:40:15,816 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:40:17,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:19,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:21,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:23,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:25,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:27,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:27,806 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:40:29,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:30,936 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:40:30,936 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:40:31,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:33,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:35,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:37,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:39,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:41,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:43,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:45,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:46,027 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:40:46,027 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:40:47,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:49,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:51,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:53,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:55,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:57,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:40:58,057 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:40:59,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:01,130 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:41:01,130 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:41:01,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:03,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:05,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:07,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:09,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:11,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:13,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:15,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:16,265 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:41:16,265 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:41:17,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:19,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:21,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:23,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:27,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:28,300 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:41:29,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:31,435 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:41:31,435 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:41:31,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:33,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:35,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:37,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:39,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:41,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:43,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:45,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:46,556 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:41:46,556 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:41:47,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:49,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:51,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:53,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:55,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:57,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:41:58,536 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:41:59,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:01,643 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:42:01,643 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:42:01,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:03,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:05,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:07,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:07,788 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:42:07,832 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:42:07,854 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:42:08,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:42:09,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:11,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:13,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:15,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:16,739 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:42:16,739 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:42:17,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:19,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:21,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:23,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:25,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:28,777 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:42:29,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:31,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:31,820 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:42:31,820 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:42:33,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:36,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:38,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:40,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:42,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:44,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:46,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:46,923 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:42:46,923 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:42:48,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:50,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:52,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:54,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:56,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:58,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:42:59,017 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:43:00,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:02,028 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:43:02,028 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:43:02,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:04,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:06,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:08,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:10,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:12,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:14,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:16,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:17,109 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:43:17,109 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:43:18,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:20,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:22,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:24,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:26,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:28,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:29,257 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:43:30,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:32,186 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:43:32,187 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:43:32,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:34,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:36,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:38,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:40,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:42,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:44,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:46,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:47,282 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:43:47,282 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:43:48,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:50,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:52,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:54,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:56,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:58,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:43:59,494 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:44:00,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:02,450 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:44:02,450 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:44:02,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:04,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:06,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:08,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:10,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:12,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:13,276 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:44:13,329 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:44:13,352 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:44:13,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:44:14,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:16,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:17,523 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:44:17,523 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:44:18,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:20,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:22,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:24,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:26,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:28,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:29,747 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:44:30,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:32,621 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:44:32,621 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:44:32,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:34,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:36,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:38,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:40,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:42,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:44,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:46,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:47,720 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:44:47,720 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:44:48,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:50,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:52,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:54,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:56,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:58,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:44:59,986 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:45:01,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:02,816 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:45:02,816 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:45:03,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:05,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:07,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:09,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:11,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:13,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:15,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:17,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:17,901 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:45:17,901 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:45:19,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:21,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:23,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:25,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:27,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:29,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:30,238 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:45:31,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:33,040 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:45:33,040 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:45:33,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:35,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:37,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:39,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:41,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:43,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:45,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:47,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:48,148 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:45:48,148 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:45:49,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:51,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:53,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:55,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:57,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:45:59,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:00,484 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:46:01,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:03,223 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:46:03,223 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:46:03,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:05,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:07,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:09,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:11,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:13,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:15,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:17,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:18,060 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:46:18,103 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:46:18,126 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:46:18,295 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:46:18,295 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:46:18,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:46:18,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:19,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:21,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:23,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:25,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:27,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:29,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:30,740 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:46:31,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:33,417 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:46:33,418 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:46:33,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:35,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:37,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:39,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:41,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:43,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:45,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:47,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:48,511 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:46:48,511 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:46:49,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:51,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:53,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:55,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:57,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:46:59,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:00,976 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:47:02,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:03,611 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:47:03,611 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:47:04,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:06,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:08,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:10,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:12,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:14,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:16,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:18,703 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:47:18,703 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:47:18,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:20,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:22,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:24,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:26,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:28,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:30,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:31,214 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:47:32,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:33,792 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:47:33,792 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:47:34,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:36,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:38,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:40,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:42,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:44,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:46,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:48,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:48,919 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:47:48,920 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:47:50,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:52,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:54,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:56,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:47:58,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:00,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:01,450 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:48:04,006 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:48:04,006 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:48:04,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:06,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:08,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:10,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:12,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:14,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:16,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:18,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:19,103 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:48:19,104 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:48:20,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:21,911 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:48:21,953 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:48:21,975 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:48:22,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:48:22,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:24,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:26,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:28,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:30,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:31,701 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:48:32,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:34,182 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:48:34,183 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:48:34,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:36,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:39,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:41,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:43,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:45,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:47,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:49,291 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:48:49,291 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:48:49,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:51,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:53,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:55,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:57,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:48:59,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:01,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:01,965 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:49:03,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:04,464 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:49:04,464 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:49:05,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:07,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:09,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:11,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:13,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:15,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:17,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:19,551 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:49:19,551 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:49:19,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:21,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:23,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:25,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:27,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:29,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:31,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:32,227 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:49:33,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:34,651 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:49:34,651 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:49:35,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:37,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:39,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:41,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:43,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:45,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:47,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:49,786 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:49:49,786 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:49:49,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:51,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:53,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:55,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:57,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:49:59,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:01,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:02,481 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:50:03,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:04,859 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:50:04,859 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:50:05,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:07,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:09,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:12,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:14,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:16,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:18,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:20,011 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:50:20,011 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:50:20,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:22,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:24,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:26,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:28,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:30,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:32,738 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:50:32,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:34,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:35,111 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:50:35,112 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:50:36,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:38,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:40,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:42,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:44,792 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:50:44,808 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:50:44,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:50:44,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:44,831 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:50:45,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:46,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:50:50,188 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:50:50,188 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:51:03,056 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:51:05,273 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:51:05,274 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:51:20,358 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:51:20,359 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:51:22,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:51:33,372 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:51:35,439 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:51:35,440 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:51:50,533 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:51:50,533 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:51:54,855 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:51:56,855 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:51:58,856 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:00,856 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:02,857 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:03,641 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:52:04,857 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:05,634 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:52:05,634 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:52:06,858 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:08,858 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:10,858 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:12,859 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:14,859 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:16,859 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:18,860 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:20,713 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:52:20,713 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:52:20,860 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:22,860 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:24,861 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:26,861 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:28,861 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:30,862 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:32,862 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:33,863 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:52:34,862 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:35,819 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:52:35,819 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:52:36,863 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:38,863 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:40,864 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:42,864 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:44,864 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:46,865 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:48,865 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:50,865 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:50,970 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:52:50,970 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:52:52,866 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:54,866 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:56,866 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:52:58,867 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:00,867 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:02,867 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:04,086 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:53:04,868 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:06,060 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:53:06,060 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:53:06,868 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:08,868 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:11,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:13,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:15,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:17,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:19,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:21,156 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:53:21,156 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:53:21,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:23,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:25,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:27,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:29,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:31,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:33,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:34,316 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:53:35,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:36,230 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:53:36,230 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:53:37,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:39,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:41,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:43,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:45,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:47,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:49,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:51,310 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:53:51,310 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:53:51,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:53,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:55,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:56,561 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:53:56,604 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:53:56,627 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:53:56,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:53:57,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:53:59,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:01,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:03,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:04,548 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:54:05,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:06,476 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:54:06,476 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:54:07,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:09,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:11,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:13,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:15,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:17,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:19,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:21,592 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:54:21,592 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:54:21,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:23,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:25,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:27,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:29,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:31,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:33,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:34,779 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:54:35,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:36,702 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:54:36,702 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:54:37,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:39,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:41,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:43,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:45,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:47,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:49,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:51,880 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:54:51,880 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:54:51,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:53,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:55,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:57,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:54:59,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:01,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:03,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:05,023 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:55:05,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:06,952 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:55:06,952 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:55:07,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:09,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:11,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:13,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:15,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:17,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:19,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:21,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:22,085 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:55:22,085 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:55:23,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:25,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:27,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:30,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:32,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:34,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:35,273 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:55:36,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:37,242 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:55:37,242 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:55:38,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:40,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:42,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:44,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:46,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:48,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:50,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:52,317 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:55:52,317 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:55:52,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:54,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:56,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:55:58,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:00,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:01,757 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:56:01,799 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:56:01,821 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:56:01,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:56:02,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:04,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:05,526 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:56:06,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:07,389 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:56:07,389 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:56:08,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:10,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:12,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:14,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:16,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:18,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:20,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:22,501 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:56:22,501 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:56:22,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:24,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:26,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:28,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:30,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:32,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:34,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:35,760 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:56:36,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:37,690 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:56:37,691 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:56:38,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:40,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:42,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:44,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:46,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:48,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:50,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:52,774 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:56:52,774 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:56:52,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:54,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:56,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:56:58,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:00,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:02,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:04,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:06,007 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:57:06,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:07,876 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:57:07,877 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:57:08,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:10,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:12,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:14,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:16,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:18,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:20,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:22,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:23,029 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:57:23,029 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:57:24,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:26,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:28,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:30,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:32,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:34,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:36,250 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:57:36,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:38,147 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:57:38,148 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:57:38,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:40,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:43,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:45,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:47,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:49,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:51,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:53,299 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:57:53,299 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:57:53,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:55,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:57,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:57:59,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:01,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:03,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:05,537 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-09 23:58:05,581 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-09 23:58:05,603 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-09 23:58:05,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-09 23:58:05,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:06,512 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:58:06,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:07,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:08,378 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:58:08,378 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:58:09,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:11,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:13,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:15,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:17,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:19,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:21,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:23,508 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:58:23,508 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:58:23,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:25,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:27,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:29,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:31,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:33,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:35,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:36,760 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:58:37,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:38,616 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:58:38,616 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:58:39,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:41,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:43,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:45,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:47,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:49,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:51,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:53,701 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:58:53,701 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:58:53,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:55,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:57,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:58:59,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:01,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:03,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:05,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:07,002 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:59:07,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:08,806 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:59:08,806 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:59:09,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:11,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:13,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:15,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:17,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:19,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:21,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:23,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:23,928 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:59:23,928 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:59:25,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:27,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:29,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:31,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:33,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:35,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:37,249 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-09 23:59:37,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:39,041 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:59:39,042 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:59:39,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:41,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:43,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:45,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:47,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:49,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:51,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:53,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:54,117 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-09 23:59:54,117 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-09 23:59:55,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:57,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-09 23:59:59,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:01,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:03,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:05,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:07,495 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:00:07,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:08,702 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:00:08,760 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:00:08,782 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:00:08,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:00:09,228 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:00:09,228 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:00:09,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:10,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:12,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:14,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:16,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:18,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:20,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:22,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:24,319 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:00:24,320 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:00:24,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:26,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:28,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:30,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:32,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:34,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:36,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:37,751 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:00:38,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:39,426 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:00:39,426 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:00:40,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:42,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:44,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:46,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:48,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:50,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:52,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:54,499 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:00:54,499 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:00:54,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:56,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:00:58,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:00,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:02,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:04,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:06,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:07,998 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:01:08,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:09,600 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:01:09,600 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:01:10,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:12,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:14,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:16,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:18,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:20,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:22,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:24,761 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:01:24,761 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:01:24,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:26,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:28,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:30,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:32,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:34,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:36,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:38,223 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:01:38,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:39,881 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:01:39,881 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:01:40,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:42,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:44,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:46,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:48,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:50,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:52,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:54,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:54,983 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:01:54,983 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:01:56,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:01:58,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:00,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:02,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:04,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:06,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:08,454 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:02:08,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:10,058 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:02:10,058 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:02:10,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:12,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:13,361 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:02:13,405 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:02:13,427 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:02:13,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:02:14,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:15,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:16,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:18,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:20,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:22,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:24,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:25,240 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:02:25,241 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:02:26,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:28,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:31,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:33,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:35,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:37,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:38,692 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:02:39,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:40,341 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:02:40,341 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:02:41,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:43,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:45,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:47,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:49,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:51,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:53,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:55,413 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:02:55,413 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:02:55,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:57,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:02:59,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:01,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:03,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:05,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:07,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:08,924 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:03:09,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:10,526 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:03:10,526 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:03:11,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:13,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:15,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:17,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:19,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:21,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:23,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:25,728 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:03:25,728 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:03:25,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:27,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:29,967 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:31,967 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:33,967 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:35,968 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:37,968 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:39,163 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:03:39,968 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:40,808 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:03:40,808 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:03:41,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:43,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:45,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:47,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:49,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:51,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:53,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:55,911 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:03:55,911 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:03:55,971 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:57,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:03:59,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:01,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:03,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:05,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:07,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:09,399 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:04:09,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:11,032 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:04:11,032 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:04:11,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:13,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:15,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:18,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:20,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:22,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:24,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:26,194 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:04:26,194 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:04:26,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:28,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:30,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:32,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:34,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:35,583 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:04:35,597 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:04:35,625 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:04:35,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:04:36,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:38,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:39,688 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:04:41,287 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:04:41,288 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:04:48,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:04:56,554 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:04:56,555 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:05:09,979 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:05:11,632 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:05:11,633 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:05:20,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:22,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:24,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:26,715 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:05:26,715 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:05:26,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:28,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:30,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:32,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:34,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:36,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:38,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:40,222 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:05:40,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:41,850 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:05:41,851 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:05:42,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:44,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:46,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:48,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:50,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:52,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:54,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:56,964 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:05:56,964 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:05:56,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:05:59,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:01,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:03,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:05,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:07,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:09,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:10,450 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:06:11,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:12,057 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:06:12,057 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:06:13,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:15,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:17,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:19,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:21,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:23,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:25,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:27,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:27,136 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:06:27,136 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:06:29,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:31,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:33,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:35,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:37,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:39,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:40,670 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:06:42,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:42,235 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:06:42,235 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:06:44,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:46,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:48,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:50,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:52,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:54,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:56,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:06:57,312 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:06:57,312 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:06:58,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:00,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:02,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:04,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:06,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:08,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:10,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:10,899 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:07:12,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:12,396 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:07:12,396 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:07:14,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:16,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:18,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:20,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:22,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:23,580 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:07:23,629 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:07:23,664 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:07:24,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:07:24,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:25,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:26,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:27,498 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:07:27,498 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:07:28,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:30,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:32,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:34,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:36,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:38,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:40,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:41,137 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:07:42,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:42,600 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:07:42,600 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:07:44,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:46,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:48,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:50,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:52,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:54,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:56,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:07:57,677 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:07:57,677 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:07:58,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:00,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:02,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:04,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:06,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:08,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:10,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:11,379 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:08:12,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:12,812 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:08:12,813 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:08:14,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:16,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:18,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:20,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:22,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:24,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:26,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:27,916 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:08:27,916 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:08:28,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:30,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:32,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:34,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:36,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:38,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:40,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:41,624 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:08:42,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:42,992 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:08:42,992 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:08:44,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:46,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:48,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:50,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:52,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:54,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:56,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:58,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:08:58,114 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:08:58,115 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:09:00,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:02,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:04,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:07,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:09,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:11,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:11,860 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:09:13,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:13,229 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:09:13,229 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:09:15,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:17,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:19,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:21,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:23,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:25,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:27,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:28,049 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:09:28,095 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:09:28,118 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:09:28,381 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:09:28,381 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:09:29,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:09:29,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:31,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:33,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:35,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:37,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:39,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:41,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:42,088 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:09:43,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:43,537 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:09:43,537 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:09:45,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:47,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:49,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:51,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:53,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:55,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:57,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:09:58,924 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:09:58,924 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:09:59,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:01,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:03,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:05,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:07,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:09,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:11,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:12,320 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:10:13,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:14,000 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:10:14,001 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:10:15,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:17,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:19,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:21,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:23,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:25,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:27,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:29,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:29,132 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:10:29,132 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:10:31,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:33,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:35,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:37,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:39,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:41,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:42,540 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:10:43,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:44,244 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:10:44,245 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:10:45,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:47,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:49,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:51,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:53,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:55,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:57,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:59,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:10:59,426 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:10:59,426 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:11:01,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:03,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:05,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:07,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:09,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:11,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:12,749 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:11:13,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:14,532 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:11:14,532 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:11:15,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:17,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:19,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:21,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:23,145 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:25,145 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:27,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:29,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:29,605 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:11:29,606 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:11:31,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:32,355 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:11:32,409 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:11:32,432 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:11:33,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:11:33,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:34,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:35,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:37,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:39,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:41,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:42,984 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:11:43,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:44,823 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:11:44,824 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:11:45,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:47,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:49,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:51,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:53,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:55,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:57,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:59,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:11:59,900 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:11:59,900 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:12:01,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:04,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:06,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:08,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:10,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:12,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:13,209 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:12:14,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:15,018 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:12:15,018 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:12:16,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:18,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:20,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:22,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:24,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:26,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:28,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:30,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:30,281 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:12:30,281 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:12:32,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:34,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:36,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:38,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:40,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:42,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:43,429 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:12:44,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:45,397 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:12:45,398 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:12:46,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:48,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:50,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:52,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:54,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:56,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:12:58,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:00,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:00,715 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:13:00,715 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:13:02,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:04,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:06,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:08,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:10,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:12,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:13,652 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:13:14,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:15,808 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:13:15,808 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:13:16,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:18,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:20,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:22,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:24,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:26,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:28,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:30,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:30,926 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:13:30,926 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:13:32,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:34,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:36,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:37,372 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:13:37,418 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:13:37,446 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:13:38,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:13:38,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:40,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:42,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:43,880 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:13:44,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:46,001 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:13:46,002 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:13:46,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:48,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:50,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:52,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:54,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:56,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:13:58,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:00,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:01,100 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:14:01,100 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:14:02,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:04,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:06,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:08,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:10,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:12,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:14,097 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:14:14,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:16,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:16,218 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:14:16,218 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:14:19,186 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:21,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:23,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:25,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:27,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:29,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:31,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:31,296 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:14:31,296 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:14:33,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:35,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:37,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:39,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:41,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:43,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:44,326 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:14:45,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:46,436 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:14:46,437 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:14:47,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:49,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:51,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:53,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:55,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:57,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:14:59,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:01,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:01,517 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:15:01,517 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:15:03,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:05,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:07,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:09,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:11,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:13,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:14,542 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:15:15,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:16,593 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:15:16,593 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:15:17,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:19,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:21,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:23,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:25,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:27,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:29,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:31,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:31,719 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:15:31,719 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:15:33,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:35,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:37,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:39,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:41,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:41,710 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:15:41,754 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:15:41,777 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:15:42,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:15:43,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:44,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:44,763 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:15:45,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:46,805 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:15:46,806 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:15:47,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:49,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:51,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:53,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:55,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:57,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:15:59,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:01,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:01,933 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:16:01,933 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:16:03,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:05,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:08,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:10,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:12,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:14,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:15,009 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:16:16,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:17,016 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:16:17,016 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:16:18,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:20,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:22,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:24,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:26,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:28,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:30,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:32,120 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:16:32,121 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:16:32,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:34,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:36,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:38,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:40,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:42,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:44,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:45,251 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:16:46,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:47,246 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:16:47,246 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:16:48,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:50,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:52,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:54,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:56,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:16:58,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:00,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:02,365 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:17:02,365 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:17:03,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:05,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:07,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:09,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:11,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:13,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:15,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:15,488 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:17:17,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:17,450 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:17:17,450 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:17:19,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:21,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:23,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:25,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:27,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:29,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:31,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:32,601 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:17:32,601 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:17:33,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:35,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:37,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:39,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:41,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:43,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:45,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:45,724 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:17:47,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:47,761 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:17:47,761 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:17:49,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:51,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:53,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:55,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:57,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:17:59,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:18:01,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:18:02,894 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:18:02,894 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:18:03,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:18:04,875 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:18:04,893 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:18:04,916 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:18:05,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:18:05,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:18:07,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:18:15,975 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:18:17,966 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:18:17,966 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:18:33,044 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:18:33,044 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:18:39,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:18:46,301 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:18:48,120 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:18:48,121 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:19:03,199 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:19:03,200 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:19:11,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:13,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:15,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:16,571 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:19:17,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:18,362 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:19:18,362 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:19:19,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:21,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:23,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:25,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:27,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:29,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:31,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:33,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:33,449 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:19:33,449 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:19:35,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:37,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:39,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:41,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:43,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:45,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:46,805 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:19:47,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:48,526 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:19:48,527 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:19:50,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:52,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:54,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:56,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:19:58,276 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:00,276 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:02,277 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:03,622 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:20:03,622 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:20:04,277 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:06,278 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:08,278 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:10,278 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:12,279 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:14,279 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:16,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:17,039 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:20:18,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:18,776 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:20:18,777 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:20:20,281 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:22,281 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:24,282 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:26,282 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:28,283 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:30,283 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:32,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:33,868 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:20:33,868 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:20:34,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:36,285 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:38,285 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:40,286 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:42,286 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:44,287 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:46,287 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:47,280 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:20:48,288 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:48,985 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:20:48,985 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:20:50,288 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:52,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:54,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:56,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:20:58,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:00,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:02,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:04,112 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:21:04,112 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:21:04,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:06,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:08,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:10,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:12,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:14,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:14,620 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:21:14,663 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:21:14,685 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:21:15,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:21:15,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:16,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:17,526 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:21:18,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:19,225 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:21:19,226 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:21:20,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:22,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:24,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:26,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:28,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:30,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:32,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:34,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:34,362 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:21:34,362 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:21:37,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:39,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:41,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:43,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:45,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:47,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:47,752 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:21:49,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:49,466 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:21:49,466 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:21:51,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:53,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:55,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:57,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:21:59,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:01,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:03,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:04,571 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:22:04,571 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:22:05,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:07,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:09,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:11,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:13,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:15,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:17,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:17,980 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:22:19,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:19,687 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:22:19,688 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:22:21,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:23,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:25,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:27,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:29,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:33,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:34,805 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:22:34,805 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:22:35,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:37,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:39,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:41,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:43,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:45,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:47,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:48,210 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:22:49,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:49,936 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:22:49,936 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:22:51,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:53,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:55,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:57,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:22:59,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:01,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:03,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:05,016 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:23:05,016 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:23:05,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:07,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:09,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:11,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:13,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:15,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:17,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:18,440 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:23:19,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:20,087 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:23:20,087 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:23:20,184 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:23:20,210 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:23:20,237 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:23:20,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:23:21,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:22,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:23,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:25,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:27,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:29,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:31,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:34,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:35,250 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:23:35,251 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:23:36,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:38,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:40,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:42,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:44,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:46,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:48,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:48,662 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:23:50,321 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:23:50,321 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:23:50,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:52,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:54,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:56,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:23:58,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:00,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:02,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:04,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:05,477 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:24:05,477 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:24:06,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:08,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:10,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:12,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:14,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:16,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:18,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:18,880 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:24:20,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:20,553 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:24:20,553 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:24:22,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:24,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:26,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:28,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:30,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:32,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:34,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:35,632 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:24:35,632 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:24:36,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:38,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:40,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:42,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:44,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:46,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:48,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:49,105 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:24:50,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:50,704 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:24:50,704 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:24:52,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:54,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:56,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:24:58,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:00,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:02,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:04,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:05,775 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:25:05,775 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:25:06,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:08,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:10,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:12,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:14,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:16,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:19,328 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:25:19,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:20,850 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:25:20,850 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:25:21,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:23,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:24,782 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:25:24,825 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:25:24,847 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:25:25,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:25:25,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:26,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:27,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:29,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:31,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:33,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:35,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:36,005 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:25:36,005 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:25:37,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:39,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:41,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:43,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:45,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:47,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:49,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:49,558 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:25:51,077 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:25:51,078 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:25:51,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:53,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:55,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:57,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:25:59,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:01,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:03,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:05,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:06,165 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:26:06,166 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:26:07,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:09,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:11,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:13,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:15,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:17,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:19,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:19,783 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:26:21,242 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:26:21,242 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:26:21,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:23,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:25,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:27,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:29,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:31,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:33,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:35,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:36,373 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:26:36,373 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:26:37,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:39,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:41,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:43,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:45,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:47,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:49,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:50,000 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:26:51,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:51,473 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:26:51,473 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:26:53,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:55,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:57,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:26:59,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:01,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:03,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:05,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:06,544 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:27:06,544 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:27:07,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:09,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:11,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:13,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:16,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:18,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:20,223 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:27:20,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:21,679 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:27:21,679 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:27:22,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:24,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:26,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:28,231 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:27:28,272 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:27:28,294 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:27:28,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:27:28,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:29,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:30,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:32,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:34,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:36,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:36,755 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:27:36,755 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:27:38,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:40,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:42,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:44,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:46,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:48,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:50,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:50,471 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:27:51,833 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:27:51,833 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:27:52,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:54,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:56,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:27:58,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:00,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:02,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:04,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:06,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:06,904 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:28:06,904 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:28:08,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:10,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:12,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:14,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:16,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:18,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:20,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:20,706 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:28:22,246 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:28:22,246 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:28:22,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:24,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:26,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:28,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:30,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:32,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:34,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:36,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:37,317 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:28:37,318 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:28:38,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:40,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:42,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:44,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:46,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:48,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:50,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:50,928 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:28:52,388 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:28:52,388 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:28:52,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:54,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:56,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:28:58,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:00,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:02,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:05,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:07,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:07,491 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:29:07,491 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:29:09,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:11,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:13,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:15,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:17,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:19,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:21,157 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:29:21,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:22,621 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:29:22,621 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:29:23,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:25,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:27,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:29,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:31,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:31,438 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:29:31,475 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:29:31,497 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:29:32,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:29:33,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:35,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:37,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:37,693 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:29:37,693 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:29:39,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:41,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:43,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:45,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:47,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:49,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:51,394 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:29:51,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:52,820 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:29:52,820 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:29:53,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:55,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:57,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:29:59,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:01,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:03,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:05,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:07,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:07,923 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:30:07,923 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:30:09,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:11,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:13,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:15,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:17,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:19,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:21,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:21,632 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:30:23,020 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:30:23,021 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:30:23,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:25,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:27,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:30,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:32,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:34,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:36,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:38,093 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:30:38,093 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:30:38,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:40,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:42,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:44,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:46,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:48,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:50,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:51,872 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:30:52,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:53,246 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:30:53,246 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:30:54,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:56,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:30:58,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:00,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:02,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:04,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:06,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:08,346 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:31:08,346 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:31:08,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:10,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:12,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:14,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:16,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:18,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:20,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:22,102 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:31:22,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:23,424 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:31:23,424 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:31:24,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:26,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:28,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:30,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:32,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:34,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:36,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:38,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:38,504 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:31:38,504 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:31:40,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:43,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:45,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:47,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:49,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:51,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:52,344 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:31:53,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:53,611 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:31:53,611 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:31:54,094 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:31:54,112 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:31:54,139 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:31:54,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:31:55,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:56,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:31:57,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:32:08,721 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:32:08,721 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:32:22,668 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:32:23,798 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:32:23,798 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:32:27,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:32:38,875 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:32:38,875 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:32:52,958 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:32:53,947 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:32:53,947 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:33:01,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:03,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:05,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:07,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:09,024 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:33:09,024 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:33:09,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:11,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:13,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:15,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:17,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:19,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:21,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:23,207 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:33:23,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:24,350 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:33:24,350 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:33:25,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:27,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:29,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:31,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:33,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:35,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:37,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:39,445 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:33:39,445 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:33:39,453 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:41,453 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:43,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:45,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:47,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:49,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:51,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:53,442 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:33:53,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:54,522 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:33:54,523 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:33:55,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:57,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:33:59,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:01,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:03,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:05,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:07,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:09,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:09,599 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:34:09,599 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:34:11,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:13,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:15,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:17,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:20,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:22,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:23,680 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:34:24,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:24,712 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:34:24,712 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:34:26,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:28,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:30,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:32,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:34,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:36,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:38,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:39,782 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:34:39,782 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:34:40,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:42,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:44,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:46,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:48,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:50,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:52,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:53,916 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:34:54,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:54,859 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:34:54,860 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:34:56,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:34:58,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:00,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:02,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:04,483 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:35:04,536 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:35:04,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:04,558 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:35:05,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:35:06,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:08,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:09,940 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:35:09,941 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:35:10,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:12,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:14,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:16,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:18,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:20,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:22,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:24,150 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:35:24,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:25,153 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:35:25,154 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:35:26,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:28,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:30,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:32,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:34,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:36,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:38,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:40,226 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:35:40,226 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:35:40,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:42,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:44,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:46,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:48,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:50,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:52,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:54,381 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:35:54,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:55,297 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:35:55,297 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:35:56,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:35:58,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:00,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:02,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:04,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:06,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:08,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:10,455 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:36:10,455 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:36:10,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:12,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:14,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:16,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:18,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:20,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:22,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:24,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:24,616 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:36:25,626 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:36:25,627 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:36:27,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:29,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:31,579 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:33,579 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:35,580 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:37,580 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:39,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:40,765 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:36:40,765 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:36:41,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:43,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:45,582 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:47,582 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:49,583 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:51,583 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:53,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:54,847 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:36:55,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:55,883 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:36:55,883 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:36:57,585 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:36:59,585 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:01,586 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:03,586 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:05,587 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:07,587 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:07,764 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:37:07,811 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:37:07,832 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:37:08,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:37:08,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:09,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:11,021 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:37:11,022 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:37:11,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:13,589 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:15,589 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:17,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:19,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:21,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:23,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:25,078 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:37:25,592 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:26,124 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:37:26,124 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:37:27,592 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:29,593 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:31,593 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:33,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:35,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:37,595 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:39,595 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:41,198 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:37:41,198 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:37:41,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:43,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:45,597 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:47,597 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:49,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:51,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:53,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:55,304 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:37:55,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:56,280 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:37:56,281 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:37:57,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:37:59,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:01,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:03,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:05,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:07,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:09,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:11,396 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:38:11,396 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:38:11,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:13,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:15,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:17,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:19,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:21,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:23,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:25,535 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:38:25,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:26,517 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:38:26,517 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:38:27,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:30,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:32,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:34,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:36,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:38,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:40,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:41,614 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:38:41,614 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:38:42,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:44,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:46,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:48,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:50,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:52,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:54,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:55,760 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:38:56,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:38:56,721 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:38:56,721 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:38:58,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:00,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:02,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:04,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:06,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:08,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:10,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:11,833 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:39:11,833 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:39:12,117 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:39:12,160 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:39:12,183 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:39:12,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:39:12,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:13,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:14,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:16,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:18,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:20,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:22,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:24,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:25,990 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:39:26,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:26,904 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:39:26,904 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:39:28,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:30,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:32,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:34,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:36,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:38,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:40,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:42,009 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:39:42,009 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:39:42,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:44,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:46,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:48,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:50,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:52,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:54,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:56,223 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:39:56,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:39:57,165 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:39:57,165 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:39:58,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:00,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:02,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:04,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:06,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:08,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:10,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:12,236 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:40:12,236 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:40:12,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:16,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:18,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:20,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:22,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:24,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:26,447 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:40:26,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:27,311 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:40:27,311 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:40:28,635 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:30,635 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:32,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:34,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:36,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:38,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:41,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:42,418 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:40:42,419 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:40:43,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:45,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:47,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:49,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:51,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:53,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:55,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:56,675 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:40:57,490 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:40:57,490 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:40:57,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:40:59,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:01,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:03,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:05,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:07,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:09,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:11,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:12,583 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:41:12,583 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:41:13,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:15,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:18,352 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:41:18,404 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:41:18,428 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:41:18,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:41:19,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:21,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:23,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:25,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:26,906 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:41:27,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:27,654 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:41:27,654 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:41:29,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:31,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:33,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:35,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:37,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:39,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:41,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:42,747 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:41:42,747 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:41:43,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:45,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:47,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:49,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:51,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:53,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:55,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:57,148 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:41:57,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:41:57,822 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:41:57,822 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:41:59,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:01,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:03,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:05,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:07,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:09,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:11,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:12,940 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:42:12,940 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:42:13,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:15,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:17,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:19,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:21,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:23,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:25,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:27,374 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:42:27,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:28,013 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:42:28,013 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:42:29,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:31,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:33,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:35,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:37,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:39,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:41,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:43,097 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:42:43,097 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:42:43,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:45,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:47,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:49,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:51,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:53,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:55,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:57,596 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:42:57,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:42:58,222 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:42:58,222 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:42:59,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:02,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:04,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:06,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:08,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:10,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:12,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:13,293 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:43:13,293 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:43:14,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:16,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:18,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:20,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:21,943 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:43:21,985 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:43:22,007 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:43:22,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:43:22,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:24,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:26,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:27,839 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:43:28,410 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:43:28,410 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:43:28,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:30,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:32,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:34,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:36,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:38,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:40,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:42,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:43,569 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:43:43,570 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:43:44,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:46,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:48,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:50,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:52,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:54,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:56,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:43:58,082 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:43:58,681 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:43:58,681 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:43:58,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:00,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:02,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:04,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:06,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:08,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:10,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:12,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:13,813 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:44:13,814 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:44:14,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:16,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:18,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:20,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:23,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:25,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:27,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:28,323 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:44:28,887 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:44:28,887 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:44:29,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:31,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:33,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:35,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:37,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:39,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:41,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:43,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:44,030 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:44:44,030 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:44:45,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:47,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:49,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:51,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:53,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:55,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:57,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:44:58,558 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:44:59,164 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:44:59,164 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:44:59,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:01,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:03,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:05,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:07,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:09,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:11,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:13,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:14,321 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:45:14,321 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:45:15,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:17,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:19,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:21,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:23,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:25,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:27,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:28,801 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:45:29,420 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:45:29,420 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:45:29,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:31,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:33,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:35,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:37,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:39,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:41,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:43,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:44,515 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:45:44,515 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:45:44,969 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:45:44,990 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:45:45,012 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:45:45,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:45:45,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:46,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:47,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:45:59,073 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:45:59,631 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:45:59,631 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:46:14,714 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:46:14,714 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:46:20,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:46:29,387 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:46:29,797 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:46:29,798 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:46:44,873 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:46:44,873 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:46:52,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:46:54,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:46:56,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:46:58,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:46:59,655 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:46:59,997 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:46:59,997 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:47:00,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:02,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:04,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:06,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:08,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:10,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:12,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:14,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:15,070 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:47:15,070 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:47:16,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:18,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:20,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:22,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:24,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:26,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:28,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:29,884 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:47:30,164 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:47:30,165 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:47:30,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:32,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:34,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:36,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:38,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:40,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:42,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:44,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:45,275 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:47:45,276 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:47:46,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:48,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:50,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:52,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:54,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:56,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:47:58,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:00,114 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:48:00,346 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:48:00,346 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:48:00,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:02,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:04,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:06,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:08,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:10,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:12,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:14,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:15,445 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:48:15,445 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:48:16,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:18,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:20,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:22,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:24,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:27,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:29,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:30,351 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:48:30,516 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:48:30,516 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:48:31,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:33,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:35,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:37,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:39,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:41,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:43,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:45,605 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:48:45,605 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:48:45,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:47,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:49,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:51,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:53,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:54,365 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:48:54,413 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:48:54,441 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:48:54,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:48:55,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:57,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:48:59,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:00,583 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:49:00,703 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:49:00,703 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:49:01,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:03,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:05,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:07,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:09,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:11,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:13,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:15,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:15,810 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:49:15,810 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:49:17,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:19,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:21,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:23,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:25,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:27,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:29,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:30,810 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:49:30,891 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:49:30,891 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:49:31,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:33,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:35,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:37,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:39,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:41,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:43,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:45,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:46,002 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:49:46,002 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:49:47,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:49,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:51,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:53,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:55,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:57,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:49:59,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:01,043 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:50:01,093 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:50:01,094 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:50:01,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:03,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:05,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:07,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:09,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:11,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:13,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:15,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:16,193 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:50:16,193 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:50:17,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:19,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:21,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:23,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:25,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:27,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:29,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:31,272 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:50:31,278 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:50:31,278 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:50:31,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:33,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:35,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:37,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:39,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:41,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:43,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:45,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:46,381 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:50:46,381 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:50:47,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:49,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:52,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:54,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:56,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:58,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:50:59,517 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:50:59,560 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:50:59,582 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:50:59,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:51:00,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:01,452 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:51:01,452 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:51:01,571 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:51:01,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:02,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:04,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:06,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:08,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:10,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:12,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:14,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:16,572 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:51:16,572 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:51:16,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:18,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:20,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:22,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:24,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:26,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:28,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:30,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:31,675 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:51:31,675 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:51:31,753 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:51:32,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:34,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:36,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:38,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:40,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:42,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:44,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:46,754 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:51:46,754 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:51:46,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:48,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:50,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:52,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:54,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:56,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:51:58,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:00,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:01,870 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:52:01,870 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:52:01,960 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:52:02,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:04,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:06,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:08,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:10,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:12,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:14,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:16,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:16,945 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:52:16,946 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:52:18,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:20,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:22,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:24,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:26,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:28,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:30,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:32,039 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:52:32,039 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:52:32,181 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:52:32,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:34,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:36,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:38,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:41,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:43,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:45,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:47,113 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:52:47,113 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:52:47,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:49,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:51,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:53,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:55,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:57,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:52:59,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:01,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:02,185 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:53:02,185 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:53:02,397 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:53:03,141 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:53:03,184 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:53:03,206 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:53:03,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:53:03,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:04,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:05,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:07,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:09,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:11,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:13,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:15,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:17,316 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:53:17,316 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:53:17,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:19,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:21,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:23,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:25,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:27,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:29,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:31,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:32,438 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:53:32,438 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:53:32,644 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:53:33,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:35,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:37,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:39,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:41,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:43,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:45,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:47,534 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:53:47,534 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:53:47,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:49,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:51,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:53,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:55,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:57,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:53:59,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:01,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:02,629 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:54:02,629 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:54:02,882 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:54:03,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:05,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:07,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:09,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:11,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:13,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:15,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:17,713 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:54:17,713 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:54:17,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:19,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:21,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:23,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:25,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:27,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:29,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:31,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:32,800 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:54:32,801 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:54:33,120 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:54:33,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:35,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:37,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:39,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:41,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:43,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:45,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:47,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:47,922 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:54:47,922 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:54:49,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:51,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:53,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:55,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:54:57,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:00,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:02,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:03,005 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:55:03,005 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:55:03,360 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:55:04,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:06,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:08,199 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:55:08,247 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:55:08,270 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:55:08,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:55:08,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:10,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:12,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:14,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:16,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:18,126 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:55:18,126 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:55:18,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:20,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:22,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:24,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:26,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:28,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:30,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:32,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:33,216 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:55:33,216 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:55:33,587 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:55:34,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:36,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:38,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:40,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:42,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:44,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:46,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:48,299 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:55:48,299 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:55:48,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:50,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:52,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:54,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:56,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:55:58,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:00,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:02,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:03,485 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:56:03,485 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:56:03,800 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:56:04,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:06,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:08,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:10,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:12,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:14,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:16,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:18,602 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:56:18,602 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:56:18,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:20,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:22,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:24,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:26,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:28,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:30,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:32,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:33,673 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:56:33,673 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:56:34,028 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:56:34,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:36,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:38,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:40,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:42,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:44,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:46,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:48,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:48,980 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:56:48,980 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:56:50,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:52,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:54,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:56,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:56:58,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:00,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:02,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:04,100 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:57:04,101 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:57:04,255 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:57:04,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:06,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:08,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:10,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:11,756 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:57:11,799 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:57:11,822 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:57:11,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:57:12,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:14,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:16,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:18,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:19,212 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:57:19,212 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:57:20,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:22,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:24,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:26,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:29,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:31,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:33,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:34,355 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:57:34,356 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:57:34,498 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:57:35,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:37,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:39,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:41,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:43,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:45,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:47,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:49,444 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:57:49,444 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:57:49,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:51,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:53,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:55,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:57,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:57:59,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:01,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:03,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:04,550 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:58:04,551 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:58:04,745 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:58:05,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:07,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:09,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:11,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:13,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:15,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:17,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:19,676 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:58:19,676 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:58:19,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:21,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:23,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:25,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:27,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:29,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:31,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:33,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:34,800 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:58:34,800 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:58:34,980 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:58:35,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:37,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:39,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:41,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:43,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:45,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:47,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:49,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:49,932 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:58:49,933 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:58:51,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:53,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:55,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:58:57,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:00,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:02,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:04,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:05,036 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:59:05,037 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:59:05,218 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:59:06,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:08,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:10,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:12,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:14,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:16,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:18,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:20,106 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:59:20,107 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:59:20,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:22,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:24,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:26,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:28,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:30,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:32,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:33,803 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 00:59:33,821 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 00:59:33,852 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 00:59:33,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 00:59:34,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:35,195 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:59:35,195 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:59:35,476 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 00:59:35,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:36,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 00:59:50,267 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 00:59:50,267 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 00:59:58,861 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:05,345 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:00:05,345 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:00:05,799 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:00:20,419 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:00:20,419 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:00:30,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:32,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:34,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:35,514 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:00:35,514 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:00:36,077 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:00:36,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:38,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:40,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:42,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:44,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:46,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:48,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:50,687 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:00:50,687 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:00:50,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:52,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:54,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:56,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:00:58,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:00,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:02,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:04,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:05,781 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:01:05,781 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:01:06,313 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:01:06,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:08,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:10,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:12,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:14,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:16,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:18,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:20,867 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:01:20,867 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:01:20,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:22,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:24,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:26,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:28,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:30,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:32,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:34,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:35,935 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:01:35,935 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:01:36,552 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:01:36,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:38,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:40,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:42,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:44,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:46,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:48,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:50,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:51,034 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:01:51,035 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:01:52,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:54,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:56,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:01:58,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:00,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:02,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:04,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:06,106 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:02:06,106 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:02:06,796 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:02:06,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:09,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:11,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:13,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:15,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:17,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:19,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:21,249 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:02:21,249 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:02:21,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:23,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:25,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:27,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:29,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:31,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:33,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:34,645 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:02:34,687 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:02:34,710 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:02:34,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:02:35,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:36,321 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:02:36,321 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:02:36,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:37,049 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:02:37,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:39,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:41,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:43,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:45,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:47,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:49,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:51,453 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:02:51,453 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:02:51,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:53,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:55,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:57,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:02:59,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:01,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:03,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:05,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:06,551 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:03:06,551 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:03:07,287 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:03:07,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:09,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:11,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:13,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:15,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:17,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:19,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:21,646 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:03:21,647 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:03:21,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:23,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:25,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:27,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:29,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:31,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:33,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:35,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:36,742 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:03:36,742 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:03:37,520 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:03:37,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:39,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:41,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:43,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:45,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:47,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:49,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:51,826 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:03:51,826 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:03:51,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:53,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:55,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:57,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:03:59,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:01,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:03,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:05,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:06,904 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:04:06,904 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:04:07,759 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:04:07,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:09,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:11,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:13,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:15,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:17,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:19,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:21,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:21,995 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:04:21,995 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:04:23,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:25,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:27,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:29,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:31,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:33,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:35,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:37,098 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:04:37,099 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:04:37,994 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:04:38,247 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:04:38,307 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:04:38,334 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:04:38,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:04:38,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:40,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:42,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:44,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:46,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:48,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:50,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:52,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:04:52,175 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:04:52,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:54,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:56,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:04:58,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:00,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:02,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:04,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:06,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:07,293 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:05:07,293 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:05:08,233 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:05:08,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:10,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:12,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:14,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:16,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:18,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:20,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:22,364 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:05:22,365 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:05:22,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:24,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:26,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:28,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:30,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:32,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:34,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:36,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:37,443 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:05:37,443 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:05:38,463 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:05:38,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:40,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:42,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:44,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:46,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:48,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:50,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:52,512 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:05:52,512 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:05:52,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:54,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:56,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:05:58,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:00,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:02,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:04,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:06,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:07,723 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:06:07,724 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:06:08,691 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:06:08,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:10,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:12,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:14,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:16,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:18,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:21,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:22,836 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:06:22,836 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:06:23,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:25,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:27,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:29,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:31,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:33,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:35,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:37,923 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:06:37,923 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:06:37,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:38,917 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:06:39,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:41,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:42,789 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:06:42,834 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:06:42,856 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:06:42,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:06:43,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:44,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:45,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:47,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:49,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:51,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:53,020 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:06:53,020 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:06:53,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:55,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:57,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:06:59,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:01,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:03,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:05,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:07,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:08,120 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:07:08,120 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:07:09,155 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:07:09,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:11,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:13,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:15,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:17,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:19,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:21,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:23,216 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:07:23,216 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:07:23,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:25,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:27,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:29,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:31,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:33,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:35,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:37,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:38,322 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:07:38,322 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:07:39,390 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:07:39,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:41,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:43,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:45,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:47,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:49,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:51,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:53,407 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:07:53,407 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:07:53,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:55,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:57,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:07:59,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:01,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:03,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:06,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:08,486 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:08:08,486 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:08:08,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:09,615 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:08:10,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:12,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:14,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:16,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:18,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:20,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:22,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:23,558 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:08:23,558 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:08:26,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:28,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:30,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:32,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:34,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:36,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:38,676 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:08:38,676 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:08:38,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:39,833 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:08:40,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:42,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:44,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:46,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:48,119 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:08:48,162 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:08:48,188 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:08:48,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:08:48,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:49,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:50,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:52,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:53,804 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:08:53,804 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:08:54,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:56,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:08:58,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:00,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:02,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:04,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:06,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:08,913 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:09:08,913 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:09:08,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:10,059 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:09:10,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:12,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:14,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:16,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:18,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:20,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:22,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:23,986 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:09:23,986 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:09:24,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:26,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:28,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:30,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:32,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:34,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:36,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:38,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:39,097 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:09:39,098 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:09:40,291 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:09:40,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:42,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:44,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:46,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:48,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:50,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:53,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:54,167 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:09:54,167 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:09:55,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:57,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:09:59,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:01,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:03,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:05,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:07,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:09,264 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:10:09,264 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:10:09,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:10,510 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:10:11,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:13,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:15,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:17,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:19,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:21,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:23,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:25,103 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:10:25,103 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:10:25,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:27,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:29,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:31,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:33,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:35,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:37,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:39,967 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:40,178 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:10:40,178 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:10:40,736 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:10:41,967 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:43,967 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:45,968 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:47,968 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:49,968 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:51,811 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:10:51,847 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:10:51,869 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:10:51,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:10:51,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:53,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:55,317 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:10:55,317 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:10:55,969 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:57,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:10:59,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:01,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:03,971 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:05,971 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:07,971 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:09,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:10,449 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:11:10,449 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:11:10,967 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:11:11,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:13,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:15,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:17,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:19,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:21,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:23,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:25,549 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:11:25,549 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:11:25,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:27,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:29,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:31,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:34,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:36,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:38,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:40,685 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:11:40,685 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:11:40,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:41,203 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:11:42,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:44,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:46,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:48,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:50,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:52,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:54,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:55,773 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:11:55,773 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:11:56,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:11:58,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:00,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:02,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:04,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:06,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:08,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:10,845 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:12:10,845 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:12:10,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:11,442 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:12:12,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:14,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:16,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:18,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:20,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:22,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:24,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:25,940 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:12:25,940 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:12:26,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:28,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:30,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:32,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:34,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:36,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:38,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:40,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:41,165 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:12:41,165 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:12:41,682 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:12:42,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:44,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:46,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:48,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:50,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:52,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:54,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:56,285 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:12:56,285 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:12:56,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:12:58,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:00,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:03,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:05,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:07,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:09,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:11,361 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:13:11,361 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:13:11,915 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:13:11,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:13,001 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:13:13,016 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:13:13,045 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:13:13,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:13:13,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:14,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:15,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:26,439 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:13:26,440 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:13:41,517 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:13:41,517 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:13:42,241 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:13:52,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:13:56,597 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:13:56,597 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:14:11,675 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:14:11,676 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:14:12,548 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:14:24,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:26,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:26,765 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:14:26,765 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:14:28,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:30,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:32,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:34,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:36,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:38,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:40,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:41,894 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:14:41,894 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:14:42,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:42,798 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:14:44,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:46,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:48,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:50,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:52,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:54,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:56,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:14:57,021 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:14:57,021 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:14:58,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:00,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:02,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:04,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:06,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:08,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:10,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:12,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:12,099 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:15:12,099 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:15:13,043 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:15:14,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:16,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:18,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:20,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:22,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:24,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:26,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:27,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:15:27,175 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:15:28,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:30,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:32,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:34,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:36,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:38,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:40,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:42,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:42,289 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:15:42,290 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:15:43,277 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:15:44,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:46,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:49,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:51,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:53,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:55,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:57,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:15:57,369 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:15:57,369 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:15:59,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:01,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:03,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:05,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:07,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:09,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:11,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:12,445 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:16:12,445 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:16:13,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:13,510 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:16:15,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:17,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:19,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:21,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:23,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:25,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:27,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:27,159 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:16:27,222 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:16:27,250 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:16:27,565 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:16:27,565 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:16:28,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:16:29,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:31,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:33,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:35,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:37,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:39,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:41,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:42,679 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:16:42,679 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:16:43,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:43,750 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:16:45,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:47,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:49,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:51,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:53,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:55,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:57,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:16:57,748 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:16:57,748 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:16:59,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:01,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:03,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:05,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:07,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:09,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:11,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:12,831 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:17:12,831 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:17:13,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:13,985 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:17:15,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:17,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:19,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:21,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:23,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:25,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:27,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:27,991 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:17:27,991 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:17:29,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:31,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:33,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:36,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:38,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:40,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:42,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:43,068 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:17:43,068 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:17:44,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:44,217 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:17:46,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:48,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:50,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:52,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:54,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:56,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:58,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:17:58,479 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:17:58,479 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:18:00,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:02,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:04,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:06,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:08,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:10,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:12,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:13,571 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:18:13,571 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:18:14,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:14,458 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:18:16,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:18,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:20,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:22,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:24,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:26,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:28,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:28,655 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:18:28,655 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:18:30,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:31,073 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:18:31,122 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:18:31,146 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:18:32,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:18:32,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:34,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:36,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:40,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:42,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:43,801 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:18:43,802 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:18:44,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:44,711 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:18:46,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:48,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:50,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:52,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:54,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:56,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:58,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:18:58,877 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:18:58,877 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:19:00,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:04,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:06,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:08,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:10,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:12,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:13,989 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:19:13,989 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:19:14,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:14,935 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:19:17,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:19,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:21,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:23,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:25,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:27,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:29,118 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:19:29,118 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:19:29,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:31,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:33,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:35,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:37,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:39,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:41,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:43,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:44,238 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:19:44,238 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:19:45,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:45,166 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:19:47,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:49,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:51,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:53,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:55,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:57,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:59,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:19:59,342 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:19:59,342 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:20:01,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:03,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:05,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:07,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:09,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:11,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:13,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:14,416 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:20:14,416 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:20:15,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:15,397 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:20:17,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:19,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:21,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:23,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:25,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:27,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:29,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:29,534 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:20:29,534 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:20:31,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:33,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:35,169 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:20:35,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:35,211 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:20:35,240 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:20:36,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:20:36,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:37,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:39,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:41,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:43,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:44,617 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:20:44,617 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:20:45,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:45,633 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:20:47,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:49,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:51,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:53,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:55,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:57,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:59,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:20:59,694 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:20:59,694 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:21:01,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:03,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:05,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:07,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:09,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:12,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:14,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:14,785 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:21:14,785 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:21:15,857 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:21:16,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:18,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:20,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:22,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:24,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:26,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:28,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:29,887 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:21:29,887 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:21:30,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:32,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:34,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:36,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:38,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:40,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:42,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:44,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:45,100 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:21:45,100 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:21:46,082 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:21:46,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:48,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:50,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:52,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:54,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:56,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:21:58,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:00,210 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:22:00,210 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:22:00,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:02,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:04,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:06,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:08,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:10,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:12,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:14,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:15,280 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:22:15,280 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:22:16,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:16,305 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:22:18,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:20,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:22,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:24,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:26,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:28,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:30,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:30,382 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:22:30,382 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:22:32,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:34,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:36,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:37,725 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:22:37,781 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:22:37,810 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:22:38,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:22:38,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:40,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:42,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:44,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:45,484 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:22:45,484 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:22:46,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:46,565 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:22:48,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:50,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:52,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:54,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:56,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:22:58,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:00,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:00,585 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:23:00,585 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:23:02,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:04,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:06,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:08,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:10,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:12,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:14,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:15,674 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:23:15,674 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:23:16,797 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:23:17,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:19,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:21,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:23,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:25,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:27,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:29,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:30,744 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:23:30,745 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:23:31,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:33,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:35,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:37,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:39,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:43,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:45,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:45,837 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:23:45,837 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:23:47,019 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:23:47,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:49,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:51,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:53,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:55,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:57,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:23:59,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:00,911 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:24:00,911 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:24:01,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:03,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:05,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:07,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:09,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:11,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:13,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:15,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:15,982 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:24:15,982 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:24:17,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:17,244 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:24:19,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:21,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:23,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:25,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:27,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:29,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:31,059 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:24:31,059 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:24:31,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:33,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:35,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:37,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:39,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:41,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:42,064 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:24:42,122 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:24:42,145 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:24:42,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:24:43,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:45,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:46,153 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:24:46,154 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:24:47,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:47,479 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:24:49,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:51,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:53,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:55,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:24:58,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:00,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:01,316 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:25:01,317 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:25:02,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:04,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:06,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:08,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:10,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:12,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:14,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:16,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:16,386 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:25:16,386 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:25:17,719 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:25:18,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:20,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:22,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:24,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:26,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:28,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:30,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:31,563 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:25:31,563 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:25:32,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:34,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:36,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:38,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:40,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:42,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:44,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:46,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:46,674 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:25:46,674 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:25:47,955 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:25:48,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:50,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:52,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:54,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:56,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:25:58,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:00,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:01,790 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:26:01,790 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:26:02,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:04,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:06,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:08,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:10,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:12,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:14,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:16,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:16,872 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:26:16,872 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:26:18,198 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:26:18,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:20,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:22,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:25,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:27,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:29,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:31,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:32,025 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:26:32,025 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:26:33,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:35,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:37,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:39,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:41,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:43,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:45,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:47,106 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:26:47,106 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:26:47,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:48,449 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:26:49,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:51,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:53,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:55,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:57,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:26:59,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:27:01,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:27:02,225 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:27:02,225 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:27:03,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:27:03,805 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:27:03,824 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:27:03,846 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:27:04,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:27:05,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:27:07,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:27:17,300 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:27:17,300 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:27:18,728 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:27:32,379 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:27:32,379 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:27:37,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:27:47,455 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:27:47,456 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:27:49,037 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:28:02,530 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:28:02,530 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:28:09,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:11,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:13,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:15,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:17,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:17,612 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:28:17,612 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:28:19,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:19,309 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:28:21,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:23,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:25,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:27,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:29,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:31,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:32,748 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:28:32,748 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:28:33,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:35,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:37,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:39,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:41,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:43,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:45,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:47,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:47,844 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:28:47,844 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:28:49,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:49,551 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:28:51,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:53,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:55,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:57,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:28:59,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:01,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:02,918 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:29:02,918 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:29:03,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:05,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:07,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:09,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:14,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:16,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:18,043 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:29:18,043 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:29:18,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:19,774 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:29:20,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:22,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:24,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:26,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:28,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:30,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:32,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:33,121 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:29:33,121 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:29:34,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:38,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:40,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:42,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:44,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:46,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:48,188 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:29:48,189 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:29:48,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:50,017 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:29:50,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:52,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:54,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:56,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:29:58,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:00,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:02,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:03,286 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:30:03,286 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:30:04,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:06,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:08,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:10,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:12,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:14,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:15,173 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:30:15,234 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:30:15,256 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:30:15,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:30:16,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:18,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:18,398 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:30:18,398 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:30:20,247 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:30:20,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:22,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:24,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:26,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:28,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:30,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:32,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:33,498 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:30:33,498 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:30:34,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:36,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:38,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:40,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:42,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:44,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:46,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:48,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:48,584 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:30:48,584 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:30:50,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:50,491 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:30:52,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:54,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:56,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:30:58,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:00,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:02,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:03,674 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:31:03,675 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:31:04,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:06,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:08,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:10,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:12,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:14,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:16,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:18,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:18,755 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:31:18,755 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:31:20,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:20,732 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:31:23,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:25,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:27,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:29,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:31,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:33,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:33,857 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:31:33,857 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:31:35,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:37,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:39,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:41,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:43,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:45,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:47,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:48,939 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:31:48,939 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:31:49,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:50,971 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:31:51,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:53,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:55,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:57,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:31:59,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:01,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:03,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:04,052 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:32:04,052 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:32:05,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:07,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:09,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:11,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:13,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:15,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:17,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:18,803 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:32:18,845 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:32:18,867 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:32:19,145 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:32:19,146 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:32:19,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:32:19,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:20,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:21,206 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:32:21,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:23,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:25,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:27,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:29,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:31,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:33,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:34,217 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:32:34,217 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:32:35,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:37,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:39,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:41,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:43,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:45,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:47,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:49,293 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:32:49,293 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:32:49,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:51,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:51,435 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:32:53,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:55,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:57,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:32:59,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:01,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:03,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:04,374 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:33:04,374 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:33:05,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:07,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:09,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:11,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:13,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:15,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:17,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:19,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:19,474 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:33:19,474 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:33:21,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:21,659 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:33:23,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:25,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:27,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:29,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:31,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:33,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:34,580 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:33:34,580 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:33:35,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:37,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:39,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:41,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:43,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:45,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:47,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:49,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:49,711 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:33:49,711 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:33:51,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:51,877 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:33:53,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:55,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:57,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:33:59,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:02,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:04,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:04,802 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:34:04,803 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:34:06,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:08,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:10,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:12,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:14,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:16,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:18,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:19,929 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:34:19,929 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:34:20,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:22,110 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:34:22,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:23,641 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:34:23,690 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:34:23,716 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:34:24,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:34:24,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:26,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:28,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:30,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:32,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:34,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:35,031 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:34:35,032 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:34:36,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:38,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:40,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:42,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:44,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:46,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:48,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:50,107 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:34:50,107 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:34:50,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:52,334 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:34:52,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:54,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:56,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:34:58,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:00,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:02,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:04,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:05,189 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:35:05,189 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:35:06,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:08,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:10,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:12,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:14,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:16,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:20,296 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:35:20,296 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:35:20,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:22,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:22,566 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:35:24,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:26,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:28,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:30,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:32,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:34,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:35,381 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:35:35,381 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:35:36,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:38,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:40,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:42,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:44,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:46,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:48,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:50,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:50,454 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:35:50,454 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:35:52,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:52,802 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:35:54,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:56,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:35:58,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:00,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:03,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:05,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:05,540 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:36:05,541 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:36:07,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:09,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:11,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:13,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:15,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:17,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:19,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:20,615 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:36:20,615 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:36:21,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:23,025 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:36:23,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:25,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:27,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:28,315 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:36:28,357 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:36:28,380 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:36:28,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:36:29,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:31,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:33,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:35,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:35,717 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:36:35,717 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:36:37,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:39,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:41,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:43,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:45,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:47,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:49,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:50,803 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:36:50,804 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:36:51,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:53,270 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:36:53,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:55,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:57,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:36:59,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:01,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:03,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:05,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:05,899 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:37:05,899 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:37:07,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:09,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:11,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:13,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:15,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:17,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:19,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:21,054 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:37:21,054 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:37:21,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:23,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:23,501 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:37:25,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:27,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:29,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:31,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:33,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:35,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:36,179 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:37:36,179 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:37:37,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:39,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:41,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:43,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:45,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:47,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:49,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:51,282 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:37:51,282 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:37:51,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:53,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:53,744 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:37:55,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:57,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:37:59,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:01,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:03,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:05,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:06,398 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:38:06,398 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:38:07,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:09,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:11,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:13,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:15,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:17,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:19,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:21,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:21,491 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:38:21,491 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:38:23,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:23,976 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:38:25,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:27,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:29,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:31,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:31,898 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:38:31,941 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:38:31,963 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:38:32,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:38:33,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:34,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:36,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:36,623 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:38:36,623 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:38:38,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:40,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:42,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:44,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:46,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:48,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:50,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:51,700 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:38:51,701 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:38:52,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:54,229 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:38:54,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:56,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:38:58,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:00,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:02,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:04,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:06,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:06,827 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:39:06,827 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:39:08,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:10,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:12,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:14,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:16,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:18,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:20,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:21,905 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:39:21,905 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:39:22,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:24,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:24,475 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:39:26,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:28,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:30,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:32,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:34,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:36,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:36,996 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:39:36,996 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:39:38,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:40,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:42,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:44,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:46,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:48,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:50,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:52,120 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:39:52,120 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:39:52,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:54,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:54,731 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:39:56,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:39:58,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:00,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:02,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:04,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:07,374 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:40:07,374 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:40:07,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:09,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:11,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:13,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:15,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:17,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:19,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:21,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:22,504 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:40:22,504 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:40:23,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:24,992 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:40:25,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:27,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:29,443 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:31,443 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:33,443 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:35,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:37,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:37,576 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:40:37,577 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:40:39,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:41,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:43,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:45,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:47,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:49,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:51,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:52,670 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:40:52,670 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:40:53,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:53,759 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:40:53,777 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:40:53,807 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:40:54,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:40:55,235 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:40:55,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:56,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:40:57,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:41:07,752 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:41:07,752 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:41:22,826 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:41:22,826 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:41:25,560 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:41:27,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:41:37,908 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:41:37,909 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:41:53,014 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:41:53,014 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:41:55,833 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:41:59,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:01,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:03,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:05,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:07,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:08,087 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:42:08,087 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:42:09,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:11,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:13,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:15,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:19,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:21,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:23,231 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:42:23,231 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:42:23,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:25,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:26,067 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:42:27,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:29,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:31,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:33,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:35,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:37,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:38,372 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:42:38,372 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:42:39,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:41,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:43,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:45,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:47,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:49,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:52,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:53,485 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:42:53,485 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:42:54,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:56,314 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:42:56,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:42:58,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:00,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:02,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:04,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:06,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:08,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:08,588 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:43:08,588 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:43:10,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:12,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:14,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:16,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:18,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:20,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:22,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:23,662 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:43:23,662 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:43:24,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:26,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:26,546 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:43:28,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:30,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:32,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:34,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:36,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:38,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:38,738 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:43:38,739 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:43:40,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:42,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:44,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:46,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:48,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:50,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:52,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:53,880 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:43:53,880 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:43:54,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:56,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:43:56,786 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:43:58,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:00,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:02,073 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:44:02,122 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:44:02,144 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:44:02,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:44:02,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:04,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:06,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:08,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:09,016 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:44:09,016 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:44:10,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:12,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:14,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:16,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:18,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:20,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:22,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:24,116 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:44:24,116 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:44:24,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:26,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:27,025 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:44:28,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:30,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:32,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:34,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:36,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:38,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:39,225 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:44:39,225 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:44:40,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:42,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:45,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:47,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:49,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:51,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:53,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:54,294 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:44:54,294 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:44:55,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:57,250 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:44:57,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:44:59,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:01,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:03,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:05,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:07,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:09,443 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:45:09,443 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:45:09,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:11,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:13,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:15,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:17,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:19,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:21,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:23,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:24,540 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:45:24,540 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:45:25,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:27,492 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:45:27,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:29,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:31,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:33,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:35,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:37,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:39,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:39,886 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:45:39,886 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:45:41,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:43,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:45,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:47,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:49,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:51,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:53,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:54,955 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:45:54,956 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:45:55,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:57,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:45:57,727 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:45:59,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:01,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:03,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:05,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:06,951 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:46:06,992 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:46:07,015 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:46:07,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:46:07,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:09,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:10,029 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:46:10,030 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:46:11,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:13,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:15,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:17,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:19,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:21,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:23,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:25,109 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:46:25,110 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:46:25,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:27,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:27,961 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:46:29,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:31,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:33,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:35,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:38,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:40,254 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:46:40,254 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:46:40,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:42,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:44,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:46,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:48,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:50,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:52,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:54,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:55,327 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:46:55,327 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:46:56,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:46:58,188 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:46:58,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:00,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:02,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:04,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:06,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:08,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:10,436 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:47:10,436 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:47:10,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:12,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:14,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:16,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:18,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:20,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:22,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:24,518 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:25,534 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:47:25,534 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:47:26,518 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:28,426 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:47:28,518 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:30,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:32,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:34,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:36,520 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:38,520 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:40,520 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:40,618 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:47:40,618 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:47:42,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:44,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:46,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:48,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:50,522 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:52,522 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:54,522 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:55,735 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:47:55,735 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:47:56,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:58,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:47:58,647 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:48:00,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:02,524 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:04,524 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:06,524 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:08,524 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:10,525 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:10,869 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:48:10,869 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:48:12,525 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:12,692 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:48:12,743 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:48:12,770 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:48:13,525 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:48:13,526 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:14,526 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:16,526 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:18,526 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:20,526 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:23,527 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:25,527 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:25,986 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:48:25,986 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:48:27,528 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:28,908 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:48:29,528 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:31,528 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:33,529 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:35,529 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:37,529 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:39,529 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:41,053 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:48:41,053 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:48:41,530 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:43,530 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:45,530 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:47,531 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:49,531 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:51,531 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:53,532 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:55,532 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:56,182 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:48:56,183 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:48:57,532 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:48:59,134 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:48:59,533 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:01,533 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:03,533 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:05,534 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:07,534 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:09,534 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:11,272 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:49:11,272 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:49:11,534 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:13,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:15,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:17,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:19,536 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:21,536 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:23,536 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:25,537 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:26,348 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:49:26,349 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:49:27,537 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:29,367 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:49:29,537 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:31,538 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:33,538 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:35,538 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:37,538 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:39,539 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:41,450 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:49:41,450 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:49:41,539 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:43,539 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:45,540 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:47,540 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:49,540 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:51,541 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:53,541 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:55,542 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:56,519 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:49:56,519 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:49:57,543 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:59,543 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:49:59,585 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:50:01,543 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:03,544 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:05,544 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:07,544 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:09,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:11,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:11,626 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:50:11,626 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:50:14,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:16,397 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:50:16,444 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:50:16,467 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:50:16,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:50:16,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:17,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:18,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:20,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:22,547 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:24,547 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:26,547 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:26,730 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:50:26,730 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:50:28,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:29,822 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:50:30,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:32,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:34,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:36,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:38,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:40,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:41,930 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:50:41,930 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:50:42,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:44,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:46,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:48,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:50,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:52,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:54,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:56,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:50:57,005 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:50:57,005 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:50:58,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:00,043 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:51:00,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:02,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:04,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:06,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:08,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:10,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:12,142 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:51:12,142 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:51:12,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:14,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:16,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:18,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:20,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:22,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:24,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:26,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:27,226 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:51:27,227 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:51:28,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:30,269 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:51:30,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:32,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:34,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:36,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:38,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:40,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:42,363 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:51:42,363 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:51:42,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:44,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:46,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:48,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:50,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:52,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:54,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:56,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:51:57,439 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:51:57,440 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:51:58,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:00,509 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:52:00,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:02,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:04,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:06,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:08,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:10,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:12,597 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:52:12,597 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:52:13,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:15,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:17,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:19,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:20,622 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:52:20,664 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:52:20,688 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:52:21,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:52:21,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:22,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:23,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:25,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:27,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:27,668 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:52:27,668 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:52:29,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:30,788 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:52:31,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:33,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:35,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:37,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:39,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:41,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:42,857 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:52:42,857 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:52:43,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:45,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:47,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:49,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:51,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:53,579 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:55,579 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:57,580 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:52:57,993 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:52:57,994 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:52:59,580 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:01,023 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:53:01,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:03,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:05,582 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:07,582 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:09,583 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:11,583 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:13,066 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:53:13,066 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:53:13,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:15,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:17,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:19,585 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:21,585 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:23,586 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:25,586 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:27,587 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:28,221 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:53:28,221 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:53:29,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:31,259 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:53:31,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:33,589 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:35,589 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:37,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:39,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:41,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:43,292 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:53:43,292 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:53:43,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:45,592 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:47,592 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:50,593 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:52,593 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:54,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:56,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:53:58,420 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:53:58,421 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:53:58,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:00,595 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:01,493 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:54:02,595 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:04,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:06,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:08,597 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:10,597 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:12,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:13,536 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:54:13,537 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:54:14,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:16,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:18,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:20,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:22,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:24,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:26,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:28,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:28,633 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:54:28,633 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:54:30,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:31,732 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:54:32,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:34,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:36,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:38,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:40,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:42,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:43,161 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:54:43,176 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:54:43,204 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:54:43,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:54:43,703 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:54:43,703 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:54:44,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:46,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:52,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:54:58,786 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:54:58,786 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:55:02,001 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:55:13,861 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:55:13,861 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:55:24,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:26,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:28,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:28,946 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:55:28,946 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:55:30,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:32,268 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:55:32,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:34,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:36,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:38,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:40,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:42,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:44,083 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:55:44,083 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:55:44,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:46,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:48,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:50,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:52,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:54,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:56,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:58,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:55:59,155 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:55:59,155 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:56:00,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:02,517 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:56:02,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:04,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:06,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:08,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:10,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:12,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:14,291 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:56:14,291 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:56:14,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:16,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:18,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:20,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:22,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:24,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:26,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:29,407 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:56:29,407 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:56:29,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:31,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:32,766 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:56:33,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:35,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:37,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:39,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:41,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:43,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:44,507 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:56:44,507 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:56:45,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:47,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:49,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:51,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:53,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:55,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:57,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:59,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:56:59,640 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:56:59,640 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:57:01,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:03,015 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:57:03,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:05,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:07,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:09,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:11,635 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:13,635 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:14,798 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:57:14,799 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:57:15,635 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:17,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:19,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:21,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:23,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:25,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:26,663 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:57:26,707 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:57:26,739 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:57:27,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:57:27,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:29,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:29,906 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:57:29,906 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:57:31,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:33,271 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:57:33,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:35,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:37,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:39,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:41,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:43,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:45,110 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:57:45,110 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:57:45,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:47,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:49,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:51,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:53,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:55,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:57,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:57:59,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:00,216 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:58:00,217 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:58:01,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:03,534 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:58:03,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:05,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:07,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:09,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:11,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:13,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:15,374 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:58:15,374 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:58:15,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:17,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:19,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:21,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:23,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:25,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:27,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:29,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:30,461 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:58:30,461 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:58:31,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:33,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:33,785 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:58:36,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:38,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:40,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:42,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:44,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:45,621 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:58:45,621 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:58:46,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:48,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:50,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:52,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:54,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:56,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:58:58,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:00,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:00,695 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:59:00,696 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:59:02,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:04,027 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:59:04,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:06,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:08,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:10,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:12,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:14,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:15,907 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:59:15,907 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:59:16,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:18,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:20,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:22,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:24,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:26,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:28,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:30,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:30,998 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:59:30,998 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:59:31,091 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 01:59:31,138 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 01:59:31,161 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 01:59:31,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 01:59:32,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:33,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:34,272 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 01:59:34,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:36,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:38,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:40,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:42,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:44,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:46,070 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 01:59:46,070 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 01:59:46,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:48,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:50,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:52,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:54,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:56,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 01:59:58,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:00,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:01,167 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:00:01,168 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:00:02,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:04,522 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:00:04,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:06,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:08,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:10,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:12,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:14,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:16,250 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:00:16,250 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:00:16,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:18,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:20,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:22,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:24,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:26,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:28,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:30,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:31,325 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:00:31,325 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:00:32,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:34,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:34,761 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:00:36,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:38,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:40,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:42,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:44,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:46,417 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:00:46,417 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:00:47,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:49,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:51,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:53,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:55,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:57,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:00:59,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:01,532 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:01:01,532 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:01:01,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:03,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:05,009 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:01:05,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:07,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:09,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:11,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:13,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:15,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:16,610 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:01:16,610 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:01:17,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:19,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:21,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:23,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:25,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:27,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:29,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:31,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:31,751 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:01:31,751 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:01:33,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:35,248 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:01:35,294 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:01:35,341 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:01:35,364 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:01:35,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:01:35,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:36,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:37,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:39,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:41,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:43,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:45,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:46,842 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:01:46,842 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:01:47,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:49,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:51,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:53,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:55,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:57,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:01:59,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:01,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:01,924 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:02:01,924 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:02:03,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:05,511 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:02:05,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:07,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:09,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:11,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:13,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:15,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:16,995 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:02:16,995 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:02:17,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:19,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:21,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:23,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:25,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:27,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:29,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:31,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:32,115 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:02:32,115 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:02:33,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:35,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:35,753 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:02:37,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:40,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:42,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:44,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:46,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:47,223 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:02:47,223 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:02:48,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:50,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:52,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:54,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:56,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:02:58,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:00,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:02,298 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:03:02,298 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:03:02,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:04,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:05,991 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:03:06,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:08,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:10,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:12,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:14,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:16,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:17,389 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:03:17,389 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:03:18,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:20,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:22,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:24,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:26,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:28,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:30,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:32,494 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:03:32,494 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:03:32,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:34,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:36,225 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:03:36,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:38,446 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:03:38,493 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:03:38,516 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:03:38,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:03:38,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:40,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:42,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:44,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:46,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:47,591 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:03:47,591 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:03:48,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:50,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:52,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:54,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:56,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:03:58,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:00,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:02,680 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:04:02,680 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:04:02,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:04,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:06,478 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:04:06,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:08,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:10,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:12,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:14,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:16,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:17,777 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:04:17,777 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:04:18,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:20,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:22,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:24,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:26,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:28,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:30,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:32,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:32,867 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:04:32,867 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:04:34,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:36,725 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:04:37,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:39,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:41,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:43,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:45,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:47,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:47,940 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:04:47,941 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:04:49,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:51,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:53,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:55,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:57,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:04:59,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:01,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:03,061 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:05:03,062 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:05:03,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:05,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:06,969 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:05:07,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:09,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:11,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:13,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:15,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:17,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:18,132 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:05:18,132 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:05:19,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:21,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:23,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:25,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:27,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:29,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:31,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:33,205 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:05:33,205 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:05:33,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:35,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:37,217 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:05:37,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:39,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:41,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:43,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:44,856 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:05:44,906 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:05:44,929 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:05:45,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:05:45,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:46,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:47,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:48,338 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:05:48,338 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:05:49,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:51,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:53,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:55,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:57,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:05:59,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:01,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:03,428 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:06:03,428 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:06:03,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:05,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:07,468 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:06:07,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:09,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:11,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:13,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:15,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:17,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:18,574 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:06:18,574 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:06:19,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:21,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:23,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:25,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:28,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:30,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:32,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:33,706 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:06:33,706 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:06:34,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:36,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:37,716 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:06:38,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:40,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:42,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:44,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:46,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:48,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:48,839 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:06:48,839 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:06:50,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:52,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:54,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:56,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:06:58,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:00,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:02,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:03,932 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:07:03,932 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:07:04,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:06,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:07,985 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:07:08,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:10,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:12,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:14,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:16,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:18,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:19,029 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:07:19,029 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:07:20,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:22,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:24,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:26,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:28,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:30,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:32,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:34,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:34,972 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:07:34,972 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:07:36,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:38,244 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:07:38,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:40,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:43,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:45,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:47,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:49,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:50,060 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:07:50,060 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:07:51,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:53,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:55,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:57,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:07:59,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:08:01,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:08:03,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:08:05,152 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:08:05,152 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:08:05,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:08:06,637 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:08:06,647 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:08:06,676 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:08:06,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:08:07,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:08:08,510 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:08:09,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:08:20,240 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:08:20,240 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:08:35,312 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:08:35,312 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:08:38,830 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:08:39,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:08:50,387 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:08:50,387 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:09:05,466 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:09:05,466 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:09:09,105 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:09:11,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:13,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:15,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:17,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:19,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:20,545 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:09:20,545 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:09:21,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:23,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:25,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:27,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:29,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:31,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:33,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:35,645 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:09:35,645 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:09:35,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:37,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:39,354 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:09:39,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:41,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:43,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:45,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:47,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:49,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:50,782 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:09:50,782 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:09:51,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:53,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:55,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:57,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:09:59,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:01,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:03,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:05,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:05,856 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:10:05,857 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:10:07,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:09,604 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:10:09,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:11,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:13,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:15,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:17,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:19,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:20,993 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:10:20,993 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:10:21,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:23,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:26,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:28,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:30,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:32,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:34,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:36,077 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:10:36,077 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:10:36,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:38,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:39,841 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:10:40,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:42,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:44,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:46,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:48,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:50,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:51,249 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:10:51,249 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:10:52,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:54,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:56,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:10:58,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:00,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:02,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:04,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:06,333 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:11:06,333 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:11:06,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:08,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:10,087 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:11:10,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:12,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:14,421 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:11:14,470 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:11:14,492 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:11:14,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:11:14,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:16,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:18,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:20,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:21,472 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:11:21,472 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:11:22,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:24,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:26,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:28,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:30,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:32,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:34,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:36,604 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:11:36,604 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:11:36,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:38,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:40,330 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:11:40,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:42,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:44,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:46,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:48,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:50,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:51,672 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:11:51,672 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:11:53,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:55,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:57,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:11:59,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:01,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:03,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:05,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:06,809 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:12:06,809 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:12:07,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:09,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:10,577 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:12:11,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:13,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:15,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:17,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:19,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:21,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:21,883 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:12:21,883 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:12:23,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:25,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:27,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:29,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:31,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:33,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:35,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:37,104 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:12:37,104 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:12:37,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:40,818 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:12:41,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:43,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:45,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:47,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:49,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:51,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:52,210 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:12:52,210 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:12:53,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:55,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:57,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:12:59,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:01,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:03,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:05,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:07,320 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:13:07,320 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:13:07,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:09,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:11,034 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:13:11,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:13,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:15,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:16,801 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:13:16,845 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:13:16,869 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:13:17,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:13:17,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:18,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:19,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:21,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:22,395 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:13:22,395 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:13:23,869 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:25,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:27,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:29,870 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:31,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:33,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:35,871 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:37,490 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:13:37,491 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:13:37,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:39,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:41,260 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:13:41,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:43,872 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:45,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:47,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:49,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:51,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:52,628 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:13:52,628 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:13:53,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:55,874 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:57,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:13:59,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:01,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:03,875 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:05,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:07,699 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:14:07,699 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:14:07,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:09,876 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:11,481 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:14:11,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:13,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:15,877 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:18,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:20,878 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:22,808 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:14:22,808 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:14:22,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:24,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:26,879 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:28,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:30,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:32,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:34,880 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:36,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:37,912 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:14:37,912 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:14:38,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:40,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:41,706 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:14:42,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:44,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:46,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:48,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:50,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:52,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:52,990 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:14:52,990 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:14:54,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:56,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:14:58,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:00,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:02,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:04,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:06,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:08,065 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:15:08,065 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:15:08,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:10,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:11,926 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:15:12,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:14,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:16,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:18,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:20,358 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:15:20,402 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:15:20,427 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:15:20,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:15:20,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:22,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:23,165 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:15:23,166 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:15:24,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:26,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:28,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:30,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:32,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:34,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:36,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:38,319 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:15:38,319 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:15:38,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:40,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:42,167 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:15:42,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:44,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:46,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:48,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:50,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:52,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:53,466 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:15:53,466 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:15:54,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:56,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:15:58,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:00,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:02,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:04,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:06,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:08,558 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:16:08,558 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:16:08,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:10,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:12,403 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:16:12,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:14,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:17,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:19,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:21,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:23,660 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:16:23,660 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:16:23,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:25,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:27,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:29,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:31,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:33,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:35,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:37,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:38,844 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:16:38,845 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:16:39,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:41,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:42,637 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:16:43,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:45,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:47,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:49,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:51,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:53,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:54,018 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:16:54,018 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:16:55,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:57,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:16:59,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:01,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:03,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:05,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:07,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:09,162 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:17:09,162 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:17:09,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:11,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:12,879 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:17:13,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:15,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:17,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:19,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:21,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:23,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:24,251 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:17:24,252 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:17:24,629 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:17:24,675 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:17:24,704 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:17:24,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:17:25,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:27,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:29,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:31,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:33,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:35,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:37,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:39,349 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:17:39,349 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:17:39,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:41,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:43,130 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:17:43,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:45,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:47,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:49,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:51,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:53,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:54,424 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:17:54,424 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:17:55,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:17:57,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:00,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:02,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:04,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:06,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:08,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:09,527 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:18:09,527 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:18:10,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:12,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:13,375 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:18:14,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:16,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:18,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:20,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:22,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:24,600 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:18:24,600 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:18:24,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:26,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:28,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:30,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:32,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:34,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:36,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:38,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:39,694 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:18:39,694 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:18:40,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:42,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:43,621 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:18:44,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:46,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:48,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:50,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:52,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:54,767 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:18:54,767 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:18:54,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:56,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:18:58,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:00,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:02,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:04,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:06,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:08,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:09,837 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:19:09,837 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:19:10,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:12,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:13,867 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:19:14,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:16,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:18,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:20,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:22,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:24,915 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:19:24,915 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:19:24,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:26,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:27,374 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:19:27,418 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:19:27,441 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:19:27,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:19:27,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:28,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:30,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:33,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:35,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:37,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:39,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:40,085 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:19:40,086 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:19:41,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:43,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:44,111 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:19:45,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:47,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:49,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:51,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:53,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:55,156 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:19:55,156 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:19:55,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:57,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:19:59,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:01,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:03,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:05,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:07,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:09,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:10,273 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:20:10,273 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:20:11,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:13,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:14,355 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:20:15,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:17,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:19,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:21,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:23,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:25,362 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:20:25,362 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:20:25,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:27,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:29,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:31,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:33,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:35,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:37,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:39,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:40,509 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:20:40,509 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:20:41,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:43,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:44,610 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:20:45,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:47,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:49,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:51,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:53,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:55,618 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:20:55,618 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:20:55,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:57,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:20:59,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:01,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:03,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:05,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:07,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:10,748 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:21:10,748 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:21:10,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:12,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:14,864 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:21:14,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:16,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:18,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:20,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:22,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:24,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:25,858 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:21:25,858 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:21:26,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:28,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:30,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:32,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:34,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:36,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:38,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:40,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:40,978 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:21:40,978 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:21:42,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:44,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:45,137 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:21:46,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:48,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:49,571 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:21:49,588 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:21:49,615 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:21:49,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:21:50,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:52,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:21:56,050 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:21:56,051 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:22:11,130 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:22:11,131 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:22:15,470 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:22:26,211 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:22:26,212 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:22:28,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:22:41,285 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:22:41,285 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:22:45,770 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:22:56,357 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:22:56,358 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:23:00,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:02,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:04,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:06,970 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:08,971 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:10,971 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:11,461 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:23:11,461 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:23:12,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:14,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:16,028 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:23:16,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:18,972 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:20,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:22,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:24,973 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:26,532 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:23:26,532 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:23:26,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:28,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:30,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:32,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:34,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:36,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:38,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:40,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:41,616 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:23:41,616 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:23:42,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:44,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:46,256 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:23:46,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:48,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:50,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:52,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:54,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:56,686 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:23:56,686 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:23:56,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:23:58,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:01,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:03,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:05,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:07,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:09,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:11,869 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:24:11,870 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:24:11,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:13,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:15,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:16,503 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:24:17,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:21,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:23,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:25,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:26,995 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:24:26,995 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:24:27,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:29,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:31,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:33,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:35,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:37,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:39,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:41,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:42,061 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:24:42,061 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:24:43,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:45,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:46,747 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:24:47,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:49,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:51,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:53,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:55,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:57,146 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:24:57,146 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:24:57,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:24:59,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:01,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:03,085 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:25:03,134 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:25:03,164 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:25:03,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:25:03,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:04,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:05,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:07,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:09,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:11,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:12,257 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:25:12,257 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:25:13,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:15,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:17,041 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:25:17,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:19,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:23,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:25,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:27,330 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:25:27,331 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:25:27,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:29,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:31,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:33,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:35,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:37,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:39,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:41,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:42,401 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:25:42,401 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:25:43,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:45,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:47,270 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:25:47,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:49,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:51,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:53,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:55,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:25:57,516 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:25:57,516 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:25:58,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:00,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:02,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:04,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:06,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:08,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:10,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:12,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:12,610 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:26:12,611 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:26:14,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:16,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:17,496 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:26:18,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:20,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:22,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:24,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:26,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:27,690 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:26:27,690 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:26:29,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:31,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:33,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:35,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:37,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:39,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:41,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:42,765 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:26:42,765 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:26:43,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:45,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:47,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:47,723 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:26:49,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:51,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:53,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:55,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:57,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:26:57,877 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:26:57,877 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:26:59,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:01,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:03,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:05,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:07,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:09,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:10,485 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:27:10,529 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:27:10,551 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:27:11,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:27:11,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:12,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:12,972 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:27:12,973 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:27:13,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:15,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:17,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:17,979 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:27:19,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:21,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:23,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:25,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:27,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:28,055 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:27:28,055 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:27:29,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:31,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:33,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:35,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:37,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:39,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:41,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:43,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:43,179 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:27:43,179 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:27:45,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:47,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:48,208 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:27:49,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:51,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:53,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:55,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:57,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:27:58,253 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:27:58,253 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:27:59,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:01,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:03,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:05,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:07,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:09,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:11,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:13,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:13,339 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:28:13,339 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:28:15,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:17,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:18,437 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:28:19,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:21,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:23,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:25,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:27,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:28,445 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:28:28,445 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:28:29,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:31,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:33,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:35,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:37,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:39,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:41,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:43,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:43,568 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:28:43,568 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:28:45,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:48,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:48,664 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:28:50,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:52,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:54,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:56,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:58,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:28:58,638 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:28:58,638 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:29:00,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:02,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:04,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:06,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:08,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:10,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:12,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:13,710 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:29:13,711 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:29:13,848 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:29:13,892 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:29:13,914 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:29:14,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:29:14,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:16,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:18,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:18,900 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:29:20,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:22,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:24,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:26,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:28,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:28,808 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:29:28,808 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:29:30,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:32,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:34,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:36,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:38,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:40,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:42,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:43,926 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:29:43,926 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:29:44,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:46,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:48,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:49,129 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:29:50,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:52,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:54,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:56,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:58,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:29:59,120 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:29:59,120 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:30:00,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:02,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:04,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:06,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:08,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:10,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:12,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:14,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:14,220 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:30:14,220 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:30:16,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:18,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:19,353 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:30:20,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:22,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:24,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:26,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:28,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:29,322 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:30:29,322 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:30:30,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:32,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:34,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:36,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:38,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:40,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:42,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:44,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:44,443 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:30:44,443 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:30:46,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:48,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:49,579 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:30:50,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:52,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:54,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:56,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:58,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:30:59,540 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:30:59,540 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:31:00,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:02,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:04,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:06,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:08,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:10,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:12,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:14,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:14,646 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:31:14,647 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:31:16,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:17,623 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:31:17,669 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:31:17,692 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:31:18,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:31:18,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:19,815 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:31:21,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:23,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:25,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:27,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:29,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:29,718 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:31:29,718 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:31:31,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:33,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:35,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:37,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:39,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:41,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:43,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:44,787 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:31:44,787 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:31:45,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:47,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:49,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:50,032 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:31:51,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:53,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:55,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:57,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:59,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:31:59,900 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:31:59,900 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:32:01,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:03,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:05,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:07,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:09,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:11,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:13,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:14,979 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:32:14,979 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:32:15,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:17,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:19,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:20,253 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:32:21,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:23,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:25,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:27,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:29,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:30,121 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:32:30,121 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:32:31,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:33,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:35,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:37,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:39,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:41,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:43,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:45,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:45,204 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:32:45,204 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:32:47,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:49,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:50,483 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:32:51,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:53,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:55,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:57,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:32:59,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:00,311 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:33:00,311 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:33:01,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:03,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:05,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:07,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:09,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:11,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:13,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:15,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:15,411 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:33:15,411 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:33:17,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:19,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:20,711 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:33:20,830 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:33:20,873 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:33:20,895 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:33:21,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:33:21,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:23,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:25,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:27,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:30,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:30,507 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:33:30,507 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:33:32,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:34,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:36,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:38,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:40,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:42,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:44,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:45,625 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:33:45,625 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:33:46,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:48,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:50,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:50,967 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:33:52,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:54,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:56,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:33:58,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:00,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:00,766 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:34:00,766 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:34:02,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:04,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:06,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:08,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:10,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:12,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:14,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:15,909 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:34:15,909 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:34:16,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:18,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:20,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:21,207 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:34:22,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:24,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:26,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:28,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:30,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:31,020 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:34:31,021 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:34:32,082 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:34,082 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:36,082 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:38,083 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:40,083 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:42,083 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:45,084 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:46,125 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:34:46,127 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:34:47,084 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:49,084 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:51,085 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:51,443 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:34:53,085 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:55,085 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:57,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:34:59,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:01,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:01,239 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:35:01,239 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:35:03,087 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:05,087 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:07,087 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:09,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:11,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:13,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:15,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:16,378 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:35:16,378 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:35:17,089 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:19,089 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:21,089 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:21,683 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:35:23,090 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:25,090 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:27,090 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:29,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:31,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:31,514 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:35:31,514 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:35:33,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:35,092 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:37,092 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:39,092 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:41,093 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:41,876 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:35:41,894 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:35:41,917 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:35:42,093 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:35:43,093 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:45,094 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:35:46,608 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:35:46,608 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:35:51,952 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:36:01,689 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:36:01,690 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:36:16,760 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:36:16,760 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:36:19,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:36:22,276 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:36:31,835 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:36:31,835 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:36:46,913 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:36:46,914 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:36:51,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:36:52,554 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:36:53,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:36:55,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:36:57,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:36:59,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:01,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:01,991 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:37:01,991 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:37:03,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:05,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:07,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:09,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:11,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:14,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:16,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:17,060 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:37:17,060 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:37:18,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:20,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:22,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:22,783 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:37:24,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:26,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:28,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:30,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:32,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:32,180 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:37:32,180 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:37:34,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:36,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:38,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:40,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:42,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:44,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:46,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:47,320 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:37:47,320 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:37:48,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:50,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:52,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:53,005 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:37:54,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:56,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:37:58,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:00,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:02,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:02,405 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:38:02,405 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:38:04,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:06,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:08,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:10,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:12,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:14,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:16,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:17,493 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:38:17,493 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:38:18,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:20,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:22,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:23,230 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:38:24,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:26,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:28,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:30,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:32,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:32,613 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:38:32,613 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:38:34,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:36,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:38,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:40,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:42,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:44,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:46,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:47,686 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:38:47,686 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:38:48,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:50,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:52,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:53,023 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:38:53,071 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:38:53,097 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:38:53,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:38:53,486 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:38:54,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:56,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:38:58,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:00,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:02,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:02,818 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:39:02,819 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:39:04,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:06,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:08,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:10,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:12,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:14,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:16,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:17,888 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:39:17,888 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:39:18,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:20,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:22,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:23,717 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:39:24,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:26,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:29,145 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:31,145 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:33,036 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:39:33,037 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:39:33,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:35,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:37,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:39,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:41,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:43,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:45,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:47,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:48,115 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:39:48,116 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:39:49,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:51,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:53,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:53,950 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:39:55,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:39:57,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:01,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:03,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:03,310 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:40:03,311 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:40:05,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:07,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:09,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:11,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:13,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:15,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:17,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:18,405 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:40:18,405 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:40:19,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:21,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:23,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:24,189 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:40:25,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:27,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:29,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:31,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:33,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:33,489 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:40:33,489 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:40:35,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:37,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:39,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:41,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:43,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:45,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:47,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:48,581 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:40:48,581 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:40:49,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:51,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:53,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:54,424 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:40:55,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:57,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:57,235 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:40:57,279 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:40:57,303 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:40:58,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:40:58,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:40:59,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:01,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:03,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:03,681 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:41:03,682 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:41:05,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:07,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:09,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:11,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:13,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:15,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:17,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:18,790 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:41:18,790 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:41:19,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:21,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:23,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:24,655 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:41:25,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:27,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:29,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:31,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:33,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:33,862 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:41:33,862 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:41:35,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:37,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:39,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:41,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:43,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:45,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:48,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:48,931 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:41:48,931 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:41:50,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:52,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:54,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:54,880 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:41:56,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:41:58,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:00,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:02,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:04,038 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:42:04,038 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:42:04,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:06,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:08,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:10,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:12,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:14,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:16,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:18,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:19,131 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:42:19,131 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:42:20,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:22,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:24,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:25,117 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:42:26,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:28,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:30,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:32,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:34,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:34,252 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:42:34,252 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:42:36,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:38,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:40,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:42,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:44,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:46,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:48,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:49,334 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:42:49,334 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:42:50,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:52,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:54,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:55,345 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:42:56,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:42:58,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:00,146 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:43:00,189 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:43:00,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:43:00,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:00,214 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:43:02,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:03,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:04,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:04,408 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:43:04,409 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:43:06,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:08,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:10,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:12,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:14,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:16,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:18,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:19,495 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:43:19,495 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:43:20,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:22,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:24,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:25,574 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:43:26,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:28,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:30,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:32,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:34,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:34,563 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:43:34,563 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:43:36,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:38,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:40,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:42,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:44,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:46,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:48,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:49,679 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:43:49,679 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:43:50,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:52,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:54,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:55,801 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:43:56,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:43:58,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:00,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:02,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:04,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:04,784 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:44:04,784 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:44:06,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:08,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:10,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:13,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:15,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:17,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:19,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:19,855 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:44:19,855 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:44:21,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:23,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:25,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:26,022 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:44:27,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:29,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:31,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:33,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:34,947 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:44:34,947 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:44:35,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:37,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:39,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:41,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:43,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:45,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:47,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:49,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:50,036 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:44:50,036 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:44:51,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:53,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:55,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:56,250 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:44:57,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:44:59,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:01,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:03,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:05,165 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:45:05,165 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:45:05,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:06,073 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:45:06,114 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:45:06,137 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:45:06,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:45:07,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:09,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:11,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:13,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:15,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:17,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:19,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:20,237 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:45:20,237 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:45:21,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:23,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:25,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:26,471 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:45:27,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:29,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:31,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:33,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:35,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:35,309 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:45:35,309 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:45:37,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:39,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:41,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:43,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:45,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:47,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:49,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:50,431 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:45:50,431 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:45:51,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:53,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:55,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:56,692 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:45:57,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:45:59,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:01,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:03,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:05,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:05,500 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:46:05,501 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:46:07,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:09,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:11,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:13,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:15,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:17,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:19,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:20,586 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:46:20,586 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:46:22,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:24,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:26,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:26,907 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:46:28,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:30,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:32,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:34,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:35,730 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:46:35,730 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:46:36,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:38,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:40,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:42,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:44,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:46,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:48,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:50,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:50,830 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:46:50,830 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:46:52,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:54,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:56,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:46:57,131 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:46:58,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:00,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:02,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:05,934 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:47:05,934 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:47:06,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:08,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:09,412 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:47:09,454 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:47:09,476 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:47:10,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:47:10,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:12,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:14,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:16,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:18,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:20,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:21,008 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:47:21,008 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:47:22,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:24,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:26,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:27,369 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:47:28,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:30,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:32,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:34,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:36,125 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:47:36,125 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:47:36,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:38,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:40,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:42,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:44,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:46,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:48,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:50,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:51,276 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:47:51,276 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:47:52,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:54,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:56,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:47:57,606 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:47:58,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:00,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:02,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:05,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:06,471 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:48:06,471 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:48:07,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:09,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:11,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:13,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:15,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:17,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:19,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:21,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:21,543 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:48:21,543 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:48:23,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:25,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:27,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:27,845 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:48:29,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:31,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:33,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:35,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:36,676 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:48:36,676 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:48:37,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:39,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:41,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:43,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:45,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:47,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:49,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:51,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:51,828 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:48:51,828 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:48:53,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:55,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:57,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:48:58,092 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:48:59,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:01,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:03,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:05,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:06,922 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:49:06,922 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:49:07,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:09,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:11,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:13,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:15,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:17,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:19,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:21,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:22,221 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:49:22,221 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:49:23,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:25,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:27,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:28,328 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:49:29,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:30,975 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:49:30,993 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:49:31,020 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:49:31,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:49:31,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:32,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:33,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:49:37,553 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:49:37,553 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:49:52,632 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:49:52,632 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:49:58,644 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:50:03,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:07,741 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:50:07,741 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:50:22,819 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:50:22,819 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:50:28,934 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:50:36,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:37,888 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:50:37,888 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:50:38,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:40,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:42,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:44,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:46,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:48,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:50,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:52,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:52,960 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:50:52,960 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:50:54,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:56,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:58,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:50:59,175 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:51:00,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:02,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:04,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:06,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:08,037 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:51:08,038 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:51:08,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:10,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:12,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:14,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:16,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:18,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:20,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:22,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:23,155 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:51:23,156 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:51:24,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:26,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:28,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:29,423 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:51:30,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:32,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:34,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:36,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:38,230 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:51:38,231 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:51:38,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:40,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:42,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:44,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:46,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:48,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:50,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:52,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:53,302 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:51:53,302 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:51:54,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:56,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:58,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:51:59,654 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:52:00,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:02,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:04,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:06,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:08,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:08,407 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:52:08,407 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:52:10,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:12,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:14,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:16,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:18,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:20,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:22,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:23,506 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:52:23,506 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:52:25,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:27,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:29,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:29,879 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:52:31,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:33,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:35,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:37,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:38,625 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:52:38,625 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:52:39,224 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:52:39,264 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:52:39,286 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:52:39,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:52:39,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:41,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:43,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:45,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:47,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:49,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:51,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:53,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:53,696 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:52:53,696 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:52:55,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:57,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:52:59,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:00,125 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:53:01,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:03,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:05,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:07,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:08,793 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:53:08,793 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:53:09,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:11,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:13,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:15,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:17,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:19,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:21,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:23,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:23,863 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:53:23,863 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:53:25,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:27,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:29,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:30,349 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:53:31,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:33,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:35,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:37,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:38,968 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:53:38,968 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:53:39,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:41,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:43,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:45,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:47,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:49,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:51,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:53,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:54,061 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:53:54,061 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:53:55,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:57,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:53:59,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:00,594 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:54:01,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:03,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:05,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:07,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:09,180 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:54:09,181 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:54:09,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:11,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:13,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:15,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:17,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:19,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:21,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:23,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:24,268 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:54:24,268 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:54:25,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:27,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:29,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:30,813 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:54:31,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:33,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:35,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:37,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:39,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:39,343 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:54:39,343 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:54:41,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:43,009 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:54:43,058 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:54:43,082 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:54:43,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:54:43,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:45,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:47,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:49,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:51,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:53,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:54,450 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:54:54,450 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:54:56,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:54:58,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:00,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:01,045 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:55:02,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:04,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:06,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:08,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:09,525 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:55:09,525 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:55:10,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:12,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:14,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:16,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:18,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:20,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:22,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:24,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:24,616 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:55:24,616 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:55:26,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:28,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:30,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:31,268 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:55:32,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:34,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:36,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:38,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:39,694 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:55:39,695 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:55:40,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:42,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:44,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:46,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:48,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:50,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:52,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:54,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:54,783 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:55:54,784 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:55:56,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:55:58,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:00,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:01,493 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:56:02,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:04,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:06,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:08,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:09,869 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:56:09,870 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:56:10,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:12,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:14,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:16,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:18,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:20,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:22,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:24,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:24,971 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:56:24,971 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:56:26,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:28,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:30,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:31,725 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:56:32,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:34,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:36,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:38,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:40,042 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:56:40,042 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:56:40,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:42,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:44,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:46,007 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:56:46,053 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:56:46,077 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:56:46,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:56:46,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:48,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:50,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:52,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:55,137 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:56:55,137 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:56:55,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:57,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:56:59,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:01,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:01,949 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:57:03,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:05,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:07,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:09,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:10,224 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:57:10,224 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:57:11,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:13,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:15,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:17,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:19,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:21,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:23,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:25,325 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:57:25,325 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:57:25,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:27,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:29,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:31,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:32,178 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:57:33,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:35,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:37,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:39,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:40,401 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:57:40,401 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:57:41,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:43,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:45,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:47,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:49,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:51,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:53,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:55,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:55,491 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:57:55,491 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:57:57,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:57:59,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:01,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:02,411 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:58:03,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:05,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:07,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:09,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:10,588 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:58:10,588 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:58:11,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:13,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:15,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:17,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:19,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:21,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:23,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:25,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:25,727 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:58:25,727 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:58:27,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:29,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:31,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:32,629 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:58:33,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:35,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:37,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:39,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:40,816 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:58:40,816 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:58:41,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:43,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:45,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:47,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:49,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:49,612 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 02:58:49,653 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 02:58:49,675 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 02:58:50,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 02:58:50,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:51,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:53,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:55,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:55,889 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:58:55,889 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:58:57,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:58:59,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:01,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:02,854 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:59:03,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:05,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:08,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:10,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:11,021 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:59:11,021 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:59:12,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:14,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:16,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:18,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:20,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:22,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:24,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:26,160 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:59:26,160 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:59:26,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:28,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:30,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:32,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:33,075 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 02:59:34,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:36,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:38,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:40,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:41,247 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:59:41,247 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:59:42,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:44,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:46,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:48,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:50,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:52,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:54,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:56,318 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 02:59:56,318 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 02:59:56,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 02:59:58,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:00,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:02,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:03,297 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:00:04,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:06,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:08,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:10,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:11,388 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:00:11,388 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:00:12,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:14,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:16,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:18,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:20,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:22,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:24,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:26,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:26,514 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:00:26,514 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:00:28,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:30,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:32,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:33,525 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:00:34,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:36,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:38,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:40,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:41,584 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:00:41,585 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:00:42,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:44,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:46,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:48,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:50,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:52,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:53,112 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:00:53,162 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:00:53,189 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:00:53,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:00:54,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:56,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:00:56,695 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:00:56,695 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:00:58,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:00,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:02,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:03,768 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:01:04,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:07,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:09,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:11,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:11,767 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:01:11,767 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:01:13,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:15,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:17,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:19,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:21,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:23,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:25,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:26,897 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:01:26,897 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:01:27,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:29,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:31,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:33,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:34,008 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:01:35,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:37,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:39,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:41,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:42,019 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:01:42,020 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:01:43,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:45,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:47,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:49,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:51,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:53,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:55,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:57,115 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:01:57,116 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:01:57,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:01:59,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:01,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:03,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:04,253 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:02:05,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:07,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:09,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:11,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:12,238 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:02:12,239 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:02:13,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:15,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:17,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:19,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:21,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:23,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:25,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:27,358 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:02:27,359 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:02:27,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:29,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:31,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:34,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:34,493 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:02:36,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:38,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:40,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:42,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:42,476 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:02:42,476 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:02:44,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:46,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:48,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:50,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:52,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:54,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:56,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:02:57,551 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:02:57,551 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:02:58,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:00,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:02,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:04,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:04,734 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:03:06,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:08,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:10,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:12,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:12,689 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:03:12,689 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:03:14,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:15,924 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:03:15,935 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:03:15,964 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:03:16,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:03:17,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:18,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:27,771 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:03:27,772 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:03:34,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:03:35,014 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:03:42,852 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:03:42,852 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:03:57,925 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:03:57,925 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:04:05,300 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:04:06,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:08,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:10,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:12,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:13,003 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:04:13,004 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:04:14,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:16,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:18,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:20,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:22,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:24,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:26,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:28,135 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:04:28,135 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:04:28,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:30,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:32,453 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:34,453 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:35,532 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:04:36,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:38,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:40,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:42,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:43,218 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:04:43,218 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:04:44,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:46,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:48,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:50,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:52,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:55,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:57,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:04:58,289 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:04:58,289 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:04:59,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:01,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:03,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:05,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:05,769 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:05:07,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:09,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:11,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:13,413 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:05:13,413 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:05:13,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:15,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:17,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:19,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:21,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:23,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:25,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:27,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:28,514 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:05:28,514 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:05:29,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:31,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:33,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:35,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:36,015 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:05:37,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:39,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:41,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:43,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:43,652 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:05:43,652 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:05:45,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:47,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:49,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:51,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:53,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:55,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:57,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:05:58,795 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:05:58,795 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:05:59,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:01,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:03,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:05,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:06,252 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:06:07,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:09,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:10,922 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:06:10,972 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:06:10,993 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:06:11,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:06:11,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:13,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:13,905 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:06:13,906 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:06:15,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:17,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:19,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:21,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:23,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:25,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:27,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:29,010 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:06:29,010 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:06:29,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:31,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:33,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:35,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:36,512 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:06:37,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:39,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:41,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:43,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:44,109 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:06:44,109 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:06:45,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:47,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:49,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:51,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:53,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:55,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:57,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:06:59,233 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:06:59,234 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:06:59,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:01,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:04,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:06,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:06,750 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:07:08,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:10,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:12,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:14,452 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:07:14,453 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:07:14,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:16,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:18,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:20,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:22,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:24,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:26,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:28,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:29,539 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:07:29,540 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:07:30,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:32,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:34,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:36,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:36,978 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:07:38,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:40,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:42,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:44,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:44,670 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:07:44,670 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:07:46,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:48,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:50,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:52,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:54,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:56,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:58,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:07:59,830 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:07:59,830 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:08:00,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:02,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:04,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:06,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:07,209 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:08:08,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:10,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:12,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:14,388 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:08:14,450 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:08:14,473 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:08:14,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:08:14,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:14,916 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:08:14,917 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:08:16,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:18,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:20,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:22,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:24,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:26,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:28,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:30,063 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:08:30,063 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:08:30,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:32,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:34,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:36,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:37,441 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:08:38,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:40,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:42,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:44,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:45,167 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:08:45,167 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:08:46,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:48,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:50,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:52,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:54,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:56,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:08:58,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:00,240 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:09:00,241 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:09:00,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:02,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:05,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:07,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:07,665 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:09:09,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:11,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:13,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:15,333 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:09:15,333 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:09:15,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:17,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:19,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:21,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:23,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:25,518 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:27,518 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:29,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:30,429 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:09:30,429 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:09:31,520 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:33,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:35,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:37,522 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:37,894 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:09:39,522 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:41,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:43,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:45,521 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:09:45,521 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:09:45,524 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:47,524 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:49,525 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:51,525 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:53,526 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:55,526 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:57,527 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:09:59,527 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:00,657 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:10:00,657 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:10:01,528 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:03,528 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:05,528 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:07,529 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:08,123 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:10:09,529 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:11,530 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:13,530 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:15,531 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:15,748 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:10:15,748 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:10:17,531 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:19,206 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:10:19,257 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:10:19,283 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:10:19,532 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:10:19,532 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:20,532 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:21,532 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:23,533 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:25,533 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:27,534 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:29,534 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:30,820 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:10:30,823 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:10:31,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:33,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:35,536 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:37,536 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:38,347 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:10:39,537 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:41,537 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:43,537 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:45,538 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:45,948 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:10:45,949 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:10:47,538 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:49,539 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:51,539 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:53,540 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:55,540 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:57,541 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:10:59,541 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:01,120 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:11:01,120 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:11:01,542 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:03,542 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:05,543 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:07,543 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:08,570 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:11:09,543 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:11,544 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:13,544 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:15,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:16,264 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:11:16,265 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:11:17,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:19,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:21,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:23,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:27,547 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:29,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:31,348 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:11:31,348 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:11:31,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:33,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:35,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:37,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:38,792 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:11:39,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:41,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:43,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:45,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:46,426 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:11:46,426 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:11:48,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:50,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:52,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:54,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:56,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:11:58,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:00,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:01,497 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:12:01,497 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:12:02,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:04,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:06,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:08,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:09,012 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:12:10,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:12,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:14,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:16,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:16,589 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:12:16,589 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:12:18,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:20,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:22,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:23,747 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:12:23,802 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:12:23,892 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:12:24,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:12:24,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:26,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:30,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:31,665 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:12:31,665 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:12:32,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:34,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:36,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:38,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:39,298 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:12:40,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:42,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:44,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:46,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:46,763 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:12:46,763 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:12:48,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:50,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:52,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:54,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:56,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:12:58,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:00,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:02,033 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:13:02,033 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:13:02,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:04,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:06,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:08,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:09,533 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:13:10,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:12,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:14,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:16,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:17,129 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:13:17,129 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:13:18,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:20,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:22,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:24,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:26,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:28,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:30,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:32,349 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:13:32,349 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:13:32,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:34,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:36,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:38,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:39,758 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:13:40,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:42,579 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:44,579 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:46,580 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:47,423 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:13:47,423 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:13:48,580 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:50,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:52,581 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:54,582 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:56,582 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:13:58,582 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:00,583 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:02,559 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:14:02,559 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:14:02,583 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:04,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:06,584 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:09,585 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:09,982 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:14:11,585 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:13,586 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:15,586 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:17,587 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:17,635 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:14:17,635 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:14:19,587 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:21,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:23,588 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:25,589 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:27,589 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:28,417 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:14:28,454 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:14:28,477 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:14:28,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:14:29,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:31,590 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:32,747 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:14:32,747 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:14:33,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:35,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:37,592 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:39,592 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:40,215 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:14:41,593 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:43,593 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:45,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:47,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:47,845 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:14:47,845 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:14:49,594 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:51,595 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:53,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:55,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:57,596 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:14:59,597 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:01,597 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:03,020 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:15:03,020 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:15:03,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:05,598 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:07,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:09,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:10,457 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:15:11,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:13,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:15,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:17,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:18,186 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:15:18,186 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:15:19,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:21,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:23,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:25,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:27,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:29,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:31,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:33,287 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:15:33,287 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:15:33,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:35,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:37,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:39,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:40,700 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:15:41,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:43,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:45,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:47,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:48,423 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:15:48,423 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:15:49,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:52,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:54,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:56,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:15:58,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:00,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:02,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:03,499 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:16:03,499 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:16:04,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:06,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:08,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:10,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:10,943 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:16:12,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:14,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:16,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:18,574 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:16:18,575 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:16:18,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:20,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:22,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:24,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:26,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:28,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:30,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:32,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:33,719 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:16:33,719 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:16:34,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:36,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:38,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:40,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:41,179 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:16:42,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:44,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:46,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:48,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:48,792 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:16:48,792 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:16:50,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:50,986 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:16:50,997 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:16:51,021 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:16:51,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:16:51,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:52,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:16:54,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:17:03,865 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:17:03,865 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:17:11,461 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:17:19,131 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:17:19,132 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:17:22,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:17:34,207 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:17:34,207 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:17:41,762 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:17:49,289 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:17:49,290 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:17:56,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:17:58,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:00,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:02,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:04,376 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:18:04,376 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:18:04,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:06,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:08,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:10,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:12,017 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:18:12,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:14,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:16,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:18,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:19,472 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:18:19,472 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:18:20,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:22,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:24,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:26,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:28,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:30,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:32,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:34,553 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:18:34,554 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:18:34,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:36,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:38,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:41,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:42,245 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:18:43,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:45,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:47,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:49,650 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:18:49,650 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:18:49,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:51,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:53,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:55,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:57,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:18:59,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:01,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:03,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:04,774 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:19:04,774 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:19:05,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:07,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:09,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:11,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:12,473 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:19:13,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:15,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:17,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:19,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:19,854 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:19:19,854 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:19:21,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:23,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:25,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:27,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:29,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:31,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:33,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:34,929 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:19:34,929 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:19:35,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:37,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:39,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:41,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:42,720 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:19:43,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:45,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:47,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:49,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:50,001 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:19:50,002 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:19:51,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:53,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:55,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:57,599 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:19:57,647 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:19:57,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:19:57,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:57,673 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:19:58,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:19:59,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:01,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:03,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:05,107 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:20:05,107 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:20:05,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:07,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:09,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:11,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:12,985 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:20:13,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:15,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:17,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:19,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:20,237 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:20:20,237 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:20:21,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:23,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:25,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:27,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:29,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:31,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:33,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:35,319 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:20:35,320 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:20:35,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:37,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:39,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:41,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:43,228 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:20:43,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:45,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:47,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:50,467 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:20:50,467 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:20:50,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:52,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:54,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:56,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:20:58,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:00,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:02,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:04,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:05,605 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:21:05,605 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:21:06,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:08,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:10,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:12,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:13,471 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:21:14,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:16,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:18,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:20,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:20,708 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:21:20,708 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:21:22,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:24,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:26,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:28,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:30,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:32,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:34,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:35,805 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:21:35,805 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:21:36,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:38,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:40,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:42,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:43,712 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:21:44,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:46,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:48,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:50,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:50,876 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:21:50,877 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:21:52,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:54,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:21:56,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:00,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:02,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:03,414 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:22:03,464 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:22:03,486 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:22:03,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:22:04,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:06,032 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:22:06,033 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:22:06,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:08,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:10,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:12,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:13,963 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:22:14,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:16,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:18,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:20,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:21,312 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:22:21,312 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:22:22,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:24,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:26,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:28,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:30,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:32,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:34,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:36,431 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:22:36,431 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:22:37,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:39,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:41,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:43,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:44,196 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:22:45,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:47,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:49,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:51,560 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:22:51,560 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:22:51,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:53,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:55,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:57,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:22:59,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:01,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:03,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:05,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:06,668 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:23:06,668 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:23:07,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:09,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:11,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:13,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:14,440 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:23:15,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:17,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:19,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:21,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:21,790 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:23:21,791 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:23:23,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:25,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:27,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:29,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:31,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:33,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:35,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:36,915 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:23:36,915 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:23:37,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:39,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:41,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:43,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:44,666 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:23:45,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:47,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:49,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:51,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:52,012 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:23:52,013 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:23:53,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:55,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:57,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:23:59,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:01,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:03,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:05,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:07,085 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:24:07,085 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:24:07,274 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:24:07,316 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:24:07,338 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:24:07,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:24:07,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:09,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:12,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:14,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:14,897 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:24:16,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:18,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:20,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:22,163 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:24:22,164 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:24:22,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:24,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:26,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:28,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:30,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:32,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:34,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:36,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:37,246 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:24:37,246 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:24:38,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:40,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:42,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:44,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:45,138 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:24:46,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:48,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:52,322 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:24:52,322 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:24:52,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:54,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:56,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:24:58,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:00,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:02,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:04,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:06,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:07,391 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:25:07,391 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:25:08,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:10,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:12,721 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:14,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:15,371 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:25:16,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:18,722 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:20,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:22,464 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:25:22,465 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:25:22,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:24,723 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:26,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:28,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:30,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:32,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:34,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:36,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:37,557 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:25:37,557 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:25:38,725 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:40,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:42,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:44,726 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:45,599 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:25:46,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:48,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:50,727 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:52,683 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:25:52,683 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:25:52,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:54,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:56,728 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:25:58,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:00,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:02,729 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:04,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:07,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:07,756 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:26:07,756 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:26:09,730 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:10,499 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:26:10,540 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:26:10,563 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:26:10,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:26:11,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:13,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:15,731 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:15,830 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:26:17,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:19,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:21,732 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:22,825 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:26:22,825 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:26:23,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:25,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:27,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:29,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:31,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:33,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:35,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:37,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:37,899 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:26:37,899 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:26:39,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:41,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:43,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:45,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:46,055 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:26:47,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:49,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:51,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:52,977 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:26:52,977 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:26:53,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:55,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:57,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:26:59,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:01,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:03,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:05,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:07,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:08,075 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:27:08,075 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:27:09,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:11,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:13,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:15,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:16,284 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:27:17,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:19,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:21,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:23,164 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:27:23,164 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:27:23,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:25,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:27,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:29,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:31,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:33,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:35,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:37,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:38,338 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:27:38,338 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:27:39,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:41,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:43,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:45,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:46,506 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:27:47,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:49,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:51,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:53,420 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:27:53,421 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:27:53,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:55,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:27:57,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:00,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:02,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:04,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:06,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:08,502 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:28:08,502 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:28:08,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:10,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:12,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:14,227 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:28:14,269 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:28:14,292 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:28:14,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:28:14,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:16,736 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:28:16,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:18,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:20,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:22,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:23,634 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:28:23,634 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:28:24,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:26,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:28,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:30,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:32,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:34,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:36,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:38,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:38,774 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:28:38,774 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:28:40,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:42,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:44,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:46,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:46,975 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:28:48,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:50,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:52,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:53,857 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:28:53,857 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:28:54,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:56,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:28:58,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:00,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:02,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:04,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:07,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:09,088 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:29:09,088 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:29:09,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:11,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:13,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:15,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:17,217 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:29:17,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:19,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:21,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:23,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:24,176 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:29:24,177 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:29:25,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:27,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:29,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:31,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:33,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:35,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:37,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:39,247 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:29:39,247 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:29:39,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:41,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:43,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:45,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:47,461 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:29:47,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:49,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:51,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:53,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:54,348 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:29:54,348 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:29:55,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:57,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:29:59,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:01,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:03,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:05,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:07,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:09,420 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:30:09,420 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:30:09,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:11,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:13,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:15,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:17,699 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:30:17,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:19,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:21,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:23,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:24,519 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:30:24,520 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:30:25,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:27,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:29,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:31,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:33,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:35,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:35,904 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:30:35,922 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:30:35,952 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:30:36,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:30:36,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:37,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:30:39,641 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:30:39,641 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:30:47,986 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:30:54,754 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:30:54,754 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:31:07,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:09,830 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:31:09,830 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:31:18,305 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:31:24,908 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:31:24,908 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:31:39,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:39,983 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:31:39,983 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:31:41,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:43,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:45,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:47,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:48,580 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:31:49,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:52,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:54,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:55,109 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:31:55,109 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:31:56,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:31:58,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:00,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:02,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:04,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:06,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:08,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:10,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:32:10,176 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:32:10,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:12,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:14,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:16,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:18,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:18,825 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:32:20,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:22,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:24,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:25,262 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:32:25,262 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:32:26,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:28,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:30,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:32,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:34,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:36,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:38,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:40,367 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:32:40,367 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:32:40,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:42,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:44,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:46,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:48,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:49,058 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:32:50,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:52,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:54,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:55,472 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:32:55,472 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:32:56,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:32:58,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:00,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:04,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:06,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:08,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:10,642 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:33:10,642 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:33:10,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:12,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:14,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:16,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:18,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:19,293 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:33:20,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:22,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:24,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:25,733 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:33:25,733 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:33:26,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:28,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:30,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:32,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:34,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:36,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:38,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:40,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:40,826 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:33:40,827 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:33:42,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:44,603 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:33:44,652 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:33:44,679 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:33:44,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:33:44,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:46,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:47,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:48,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:49,530 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:33:50,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:53,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:55,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:55,924 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:33:55,924 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:33:57,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:33:59,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:01,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:03,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:05,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:07,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:09,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:11,066 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:34:11,066 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:34:11,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:13,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:15,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:17,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:19,757 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:34:19,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:21,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:23,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:25,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:26,161 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:34:26,161 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:34:27,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:29,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:31,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:33,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:35,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:37,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:39,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:41,282 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:34:41,283 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:34:41,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:43,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:45,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:47,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:49,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:49,985 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:34:51,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:53,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:55,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:56,360 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:34:56,360 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:34:57,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:34:59,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:01,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:03,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:05,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:07,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:09,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:11,449 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:35:11,449 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:35:11,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:13,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:15,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:17,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:19,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:20,228 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:35:21,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:24,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:26,529 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:35:26,529 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:35:26,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:28,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:30,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:32,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:34,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:36,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:38,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:40,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:41,630 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:35:41,630 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:35:42,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:44,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:46,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:47,752 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:35:47,794 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:35:47,818 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:35:47,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:35:48,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:49,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:50,456 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:35:50,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:52,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:54,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:56,738 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:35:56,739 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:35:56,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:35:58,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:00,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:02,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:04,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:06,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:08,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:10,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:11,893 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:36:11,894 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:36:12,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:14,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:16,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:18,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:20,680 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:36:20,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:22,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:24,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:26,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:27,004 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:36:27,004 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:36:28,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:30,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:32,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:34,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:36,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:40,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:42,123 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:36:42,123 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:36:42,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:44,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:46,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:48,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:50,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:50,911 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:36:52,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:54,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:56,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:36:57,243 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:36:57,244 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:36:58,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:00,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:02,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:04,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:06,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:08,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:10,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:12,327 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:37:12,327 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:37:12,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:14,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:16,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:18,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:20,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:21,132 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:37:22,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:24,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:26,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:27,426 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:37:27,426 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:37:28,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:30,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:32,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:34,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:36,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:38,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:42,518 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:37:42,518 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:37:42,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:45,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:47,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:49,854 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:51,364 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:37:51,829 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:37:51,870 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:37:51,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:51,892 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:37:52,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:37:53,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:55,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:57,629 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:37:57,629 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:37:57,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:37:59,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:01,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:03,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:05,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:07,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:09,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:11,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:12,703 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:38:12,703 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:38:13,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:15,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:17,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:19,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:21,587 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:38:21,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:23,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:25,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:27,802 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:38:27,802 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:38:27,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:29,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:31,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:33,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:35,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:37,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:39,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:41,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:42,873 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:38:42,873 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:38:43,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:45,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:47,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:49,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:51,833 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:38:51,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:53,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:55,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:57,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:38:57,982 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:38:57,982 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:38:59,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:01,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:03,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:05,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:07,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:09,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:11,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:13,075 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:39:13,075 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:39:13,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:15,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:17,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:19,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:21,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:22,055 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:39:23,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:25,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:27,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:28,227 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:39:28,227 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:39:29,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:31,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:33,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:35,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:38,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:40,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:42,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:43,295 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:39:43,295 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:39:44,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:46,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:48,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:50,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:52,273 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:39:52,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:54,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:56,133 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:39:56,177 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:39:56,200 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:39:56,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:39:56,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:39:58,417 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:39:58,417 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:39:58,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:00,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:02,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:04,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:06,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:08,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:10,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:12,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:13,510 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:40:13,511 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:40:14,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:16,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:18,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:20,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:22,514 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:40:22,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:24,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:26,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:28,590 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:40:28,590 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:40:28,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:30,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:32,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:34,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:36,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:38,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:40,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:42,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:43,710 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:40:43,710 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:40:44,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:46,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:48,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:50,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:52,737 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:40:52,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:54,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:56,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:40:58,780 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:40:58,780 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:40:58,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:00,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:02,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:04,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:06,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:08,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:10,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:12,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:13,886 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:41:13,886 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:41:14,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:16,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:18,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:20,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:22,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:22,958 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:41:24,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:26,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:28,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:28,966 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:41:28,966 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:41:30,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:32,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:34,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:36,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:38,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:40,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:42,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:44,059 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:41:44,059 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:41:44,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:46,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:48,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:50,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:52,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:53,180 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:41:54,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:56,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:58,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:41:59,130 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:41:59,130 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:41:59,999 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:42:00,053 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:42:00,076 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:42:00,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:42:00,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:02,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:04,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:07,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:09,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:11,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:13,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:14,205 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:42:14,205 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:42:15,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:17,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:19,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:21,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:23,413 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:42:23,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:25,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:27,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:29,310 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:42:29,310 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:42:29,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:31,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:33,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:35,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:37,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:39,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:41,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:43,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:44,407 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:42:44,407 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:42:45,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:47,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:49,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:51,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:53,650 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:42:53,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:55,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:57,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:42:59,502 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:42:59,503 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:42:59,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:01,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:03,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:05,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:07,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:09,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:11,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:13,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:14,645 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:43:14,645 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:43:15,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:17,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:19,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:21,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:23,891 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:43:23,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:25,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:27,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:29,742 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:43:29,742 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:43:29,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:32,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:34,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:36,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:38,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:40,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:42,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:44,818 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:43:44,818 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:43:44,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:46,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:48,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:50,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:52,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:54,128 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:43:54,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:56,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:58,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:43:59,899 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:43:59,899 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:44:00,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:02,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:04,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:06,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:08,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:10,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:12,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:14,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:15,074 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:44:15,074 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:44:16,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:18,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:20,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:21,814 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:44:21,829 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:44:21,858 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:44:21,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:44:22,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:23,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:24,373 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:44:24,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:44:30,157 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:44:30,157 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:44:45,231 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:44:45,231 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:44:54,704 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:44:54,966 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:00,301 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:45:00,302 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:45:15,378 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:45:15,378 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:45:24,979 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:45:26,974 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:28,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:30,664 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:45:30,664 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:45:30,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:32,975 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:34,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:36,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:38,976 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:40,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:42,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:44,977 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:45,743 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:45:45,743 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:45:46,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:48,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:50,978 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:52,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:54,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:55,216 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:45:56,979 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:45:58,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:00,834 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:46:00,834 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:46:00,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:02,980 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:04,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:06,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:08,981 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:10,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:12,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:14,982 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:15,904 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:46:15,904 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:46:16,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:18,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:20,983 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:22,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:24,984 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:25,452 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:46:27,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:29,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:31,000 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:46:31,000 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:46:31,985 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:33,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:35,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:37,986 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:39,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:41,987 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:43,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:45,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:46,140 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:46:46,140 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:46:47,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:49,988 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:51,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:53,989 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:55,682 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:46:55,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:57,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:46:59,990 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:01,208 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:47:01,208 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:47:01,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:03,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:05,991 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:07,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:09,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:11,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:13,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:15,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:16,355 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:47:16,355 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:47:17,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:19,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:21,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:23,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:25,905 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:47:25,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:27,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:29,557 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:47:29,610 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:47:29,632 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:47:29,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:47:29,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:31,433 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:47:31,433 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:47:31,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:33,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:35,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:37,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:39,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:41,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:43,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:45,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:46,501 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:47:46,501 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:47:47,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:49,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:51,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:53,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:56,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:47:56,144 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:47:58,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:00,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:01,610 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:48:01,610 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:48:02,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:04,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:06,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:08,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:10,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:13,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:15,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:16,680 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:48:16,680 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:48:17,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:19,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:21,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:23,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:25,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:26,368 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:48:27,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:29,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:31,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:31,829 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:48:31,830 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:48:33,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:35,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:37,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:39,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:41,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:43,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:45,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:46,896 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:48:46,896 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:48:47,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:49,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:51,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:53,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:55,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:56,600 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:48:57,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:48:59,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:01,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:02,033 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:49:02,033 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:49:03,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:05,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:07,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:09,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:11,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:13,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:15,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:17,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:17,142 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:49:17,142 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:49:19,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:21,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:23,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:25,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:26,827 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:49:27,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:29,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:31,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:32,287 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:49:32,287 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:49:33,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:33,674 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:49:33,729 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:49:33,754 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:49:34,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:49:35,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:37,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:39,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:41,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:43,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:45,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:47,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:47,440 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:49:47,440 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:49:49,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:51,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:53,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:55,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:57,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:49:57,061 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:49:59,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:01,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:02,518 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:50:02,518 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:50:03,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:05,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:07,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:09,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:11,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:13,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:15,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:17,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:17,596 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:50:17,596 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:50:19,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:21,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:23,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:25,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:27,303 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:50:28,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:30,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:32,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:32,698 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:50:32,698 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:50:34,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:36,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:38,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:40,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:42,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:44,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:46,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:47,770 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:50:47,770 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:50:48,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:50,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:52,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:54,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:56,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:50:57,529 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:50:58,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:00,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:02,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:02,977 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:51:02,978 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:51:04,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:06,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:08,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:10,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:12,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:14,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:16,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:18,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:18,070 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:51:18,070 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:51:20,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:22,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:24,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:26,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:27,753 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:51:28,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:30,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:32,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:33,185 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:51:33,185 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:51:34,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:36,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:38,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:38,129 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:51:38,180 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:51:38,206 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:51:39,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:51:39,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:40,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:42,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:44,037 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:46,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:48,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:48,279 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:51:48,279 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:51:50,038 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:52,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:54,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:56,039 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:51:57,989 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:51:58,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:00,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:02,040 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:03,384 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:52:03,384 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:52:04,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:06,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:08,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:10,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:12,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:14,042 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:16,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:18,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:18,564 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:52:18,565 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:52:20,043 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:22,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:24,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:26,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:28,044 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:28,209 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:52:30,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:32,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:33,638 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:52:33,638 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:52:34,045 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:36,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:38,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:40,046 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:42,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:44,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:46,047 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:48,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:48,744 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:52:48,744 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:52:50,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:52,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:54,048 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:57,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:52:58,434 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:52:59,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:01,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:03,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:03,834 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:53:03,834 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:53:05,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:07,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:09,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:11,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:13,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:15,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:17,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:18,971 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:53:18,971 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:53:19,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:21,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:23,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:25,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:27,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:28,667 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:53:29,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:31,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:33,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:34,046 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:53:34,046 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:53:35,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:37,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:39,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:41,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:41,500 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:53:41,543 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:53:41,570 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:53:42,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:53:43,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:44,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:45,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:47,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:49,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:49,165 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:53:49,166 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:53:51,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:53,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:55,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:57,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:53:58,915 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:53:59,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:01,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:03,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:04,261 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:54:04,262 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:54:05,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:07,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:09,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:11,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:13,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:15,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:17,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:19,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:19,346 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:54:19,346 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:54:21,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:23,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:25,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:27,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:29,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:29,153 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:54:31,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:33,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:34,426 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:54:34,426 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:54:35,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:37,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:39,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:41,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:43,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:45,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:47,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:49,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:49,523 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:54:49,524 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:54:51,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:53,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:55,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:57,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:59,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:54:59,383 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:55:01,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:03,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:04,620 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:55:04,620 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:55:05,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:07,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:09,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:11,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:13,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:15,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:17,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:19,739 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:55:19,739 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:55:20,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:22,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:24,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:26,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:28,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:29,614 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:55:30,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:32,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:34,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:34,814 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:55:34,815 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:55:36,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:38,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:40,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:42,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:44,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:44,638 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:55:44,681 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:55:44,704 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:55:45,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:55:46,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:48,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:49,913 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:55:49,913 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:55:50,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:52,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:54,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:56,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:58,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:55:59,849 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:56:00,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:02,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:04,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:04,982 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:56:04,982 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:56:06,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:08,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:10,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:12,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:14,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:16,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:18,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:20,052 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:56:20,052 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:56:20,082 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:22,082 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:24,082 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:26,083 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:28,083 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:30,083 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:30,088 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:56:32,084 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:34,084 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:35,162 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:56:35,162 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:56:36,084 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:38,085 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:40,085 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:42,085 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:44,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:46,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:48,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:50,087 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:50,275 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:56:50,275 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:56:52,087 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:54,087 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:56,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:56:58,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:00,320 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:57:01,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:03,089 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:05,089 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:05,343 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:57:05,343 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:57:07,089 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:09,090 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:11,090 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:13,090 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:15,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:17,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:19,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:20,534 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:57:20,534 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:57:21,092 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:23,092 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:25,092 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:27,093 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:29,093 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:30,548 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:57:31,093 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:33,094 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:35,094 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:35,638 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:57:35,638 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:57:37,094 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:39,095 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:41,095 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:43,095 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:45,096 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:47,096 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:49,096 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:50,707 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:57:50,708 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:57:51,097 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:53,097 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:55,097 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:57,097 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:57:59,098 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:00,783 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:58:01,098 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:03,098 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:05,099 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:05,821 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:58:05,821 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:58:05,973 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 03:58:05,988 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 03:58:06,017 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 03:58:06,099 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 03:58:07,099 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:09,100 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:20,935 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:58:20,935 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:58:21,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:31,072 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:58:36,008 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:58:36,009 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:58:51,253 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:58:51,253 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:58:53,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:55,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:57,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:58:59,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:01,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:01,334 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:59:03,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:05,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:06,325 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:59:06,326 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:59:07,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:09,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:11,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:14,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:16,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:18,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:20,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:21,429 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:59:21,429 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:59:22,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:24,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:26,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:28,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:30,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:31,582 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 03:59:32,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:34,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:36,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:36,506 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:59:36,506 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:59:38,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:40,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:42,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:44,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:46,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:48,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:50,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:51,633 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 03:59:51,633 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 03:59:52,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:54,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 03:59:56,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:00,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:01,820 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:00:02,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:04,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:06,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:06,755 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:00:06,755 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:00:08,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:10,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:12,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:14,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:16,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:18,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:20,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:21,849 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:00:21,849 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:00:22,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:24,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:26,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:28,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:30,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:32,054 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:00:32,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:34,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:36,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:36,982 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:00:36,982 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:00:38,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:40,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:42,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:44,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:46,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:48,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:50,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:52,106 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:00:52,106 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:00:52,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:54,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:56,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:56,340 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:00:56,391 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:00:56,418 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:00:57,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:00:57,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:00:58,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:00,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:02,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:02,279 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:01:04,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:06,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:07,233 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:01:07,233 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:01:08,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:10,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:12,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:14,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:17,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:19,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:21,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:22,347 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:01:22,348 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:01:23,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:25,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:27,145 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:29,145 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:31,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:32,515 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:01:33,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:35,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:37,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:37,749 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:01:37,749 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:01:39,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:41,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:43,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:45,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:47,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:49,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:51,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:52,833 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:01:52,833 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:01:53,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:55,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:57,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:01:59,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:01,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:02,744 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:02:03,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:05,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:07,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:07,928 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:02:07,929 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:02:09,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:11,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:13,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:15,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:17,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:19,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:21,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:23,003 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:02:23,003 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:02:23,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:25,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:27,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:29,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:31,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:32,980 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:02:33,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:35,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:37,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:38,110 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:02:38,110 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:02:39,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:41,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:43,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:45,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:47,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:49,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:51,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:53,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:53,203 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:02:53,203 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:02:55,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:57,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:02:59,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:00,500 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:03:00,543 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:03:00,572 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:03:01,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:03:01,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:03,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:03,213 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:03:05,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:07,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:08,303 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:03:08,303 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:03:09,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:11,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:13,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:15,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:17,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:19,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:21,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:23,378 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:03:23,378 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:03:24,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:26,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:28,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:30,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:32,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:33,441 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:03:34,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:36,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:38,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:38,503 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:03:38,503 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:03:40,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:42,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:44,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:46,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:48,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:50,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:52,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:53,573 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:03:53,573 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:03:54,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:56,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:03:58,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:00,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:02,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:03,668 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:04:04,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:06,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:08,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:08,671 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:04:08,671 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:04:10,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:12,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:14,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:16,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:18,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:20,186 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:22,186 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:23,752 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:04:23,753 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:04:24,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:26,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:28,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:30,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:32,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:33,894 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:04:34,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:36,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:38,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:38,850 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:04:38,850 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:04:40,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:42,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:44,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:46,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:48,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:50,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:52,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:53,940 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:04:53,940 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:04:54,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:56,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:04:58,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:00,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:02,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:04,118 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:05:04,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:05,054 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:05:05,098 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:05:05,122 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:05:05,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:05:06,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:08,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:09,073 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:05:09,074 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:05:10,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:12,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:14,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:16,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:19,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:21,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:23,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:24,156 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:05:24,156 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:05:25,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:27,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:29,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:31,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:33,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:34,348 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:05:35,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:37,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:39,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:39,266 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:05:39,266 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:05:41,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:43,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:45,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:47,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:49,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:51,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:53,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:54,348 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:05:54,348 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:05:55,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:57,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:05:59,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:01,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:03,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:04,574 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:06:05,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:07,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:09,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:09,435 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:06:09,435 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:06:11,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:13,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:15,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:17,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:19,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:21,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:23,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:24,507 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:06:24,507 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:06:25,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:27,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:29,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:31,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:33,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:34,802 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:06:35,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:37,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:39,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:39,589 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:06:39,589 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:06:41,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:43,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:45,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:47,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:49,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:51,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:53,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:54,663 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:06:54,663 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:06:55,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:57,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:06:59,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:01,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:03,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:05,028 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:07:05,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:07,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:08,491 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:07:08,538 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:07:08,563 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:07:09,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:07:09,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:09,737 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:07:09,737 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:07:10,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:11,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:13,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:15,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:17,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:19,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:21,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:23,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:24,816 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:07:24,816 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:07:25,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:27,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:29,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:32,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:34,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:35,283 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:07:36,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:38,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:39,892 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:07:39,892 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:07:40,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:42,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:44,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:46,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:48,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:50,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:52,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:54,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:55,033 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:07:55,033 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:07:56,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:07:58,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:00,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:02,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:04,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:05,511 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:08:06,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:08,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:10,107 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:08:10,107 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:08:10,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:12,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:14,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:16,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:18,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:20,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:22,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:24,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:25,176 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:08:25,176 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:08:26,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:28,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:30,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:32,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:34,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:35,751 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:08:36,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:38,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:40,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:40,253 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:08:40,253 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:08:42,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:44,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:46,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:48,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:50,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:52,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:54,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:55,363 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:08:55,363 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:08:56,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:08:58,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:00,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:02,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:04,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:05,949 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:09:06,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:08,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:10,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:10,434 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:09:10,435 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:09:12,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:12,668 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:09:12,710 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:09:12,732 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:09:13,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:09:14,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:15,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:16,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:19,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:21,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:23,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:25,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:25,658 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:09:25,658 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:09:27,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:29,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:31,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:33,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:35,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:36,196 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:09:37,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:39,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:40,767 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:09:40,767 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:09:41,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:43,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:45,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:47,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:49,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:51,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:53,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:55,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:55,869 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:09:55,869 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:09:57,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:09:59,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:01,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:03,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:05,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:06,434 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:10:07,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:09,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:10,967 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:10:10,967 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:10:11,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:13,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:15,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:17,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:19,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:21,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:23,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:25,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:26,148 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:10:26,148 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:10:27,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:29,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:31,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:33,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:35,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:36,670 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:10:37,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:39,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:41,247 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:10:41,247 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:10:41,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:43,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:45,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:47,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:49,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:51,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:54,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:56,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:10:56,319 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:10:56,319 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:10:58,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:00,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:02,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:04,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:06,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:06,910 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:11:08,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:10,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:11,408 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:11:11,408 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:11:12,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:14,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:16,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:18,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:20,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:22,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:24,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:26,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:26,526 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:11:26,526 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:11:28,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:30,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:32,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:34,019 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:11:34,034 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:11:34,064 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:11:34,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:11:34,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:35,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:36,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:11:37,146 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:11:41,614 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:11:41,614 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:11:56,690 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:11:56,690 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:12:07,486 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:12:10,282 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:12:11,772 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:12:11,772 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:12:26,848 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:12:26,848 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:12:37,767 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:12:41,935 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:12:41,935 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:12:42,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:12:44,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:12:46,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:12:48,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:12:50,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:12:52,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:12:54,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:12:56,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:12:57,005 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:12:57,005 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:12:58,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:00,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:02,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:04,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:06,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:08,010 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:13:08,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:10,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:12,102 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:13:12,102 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:13:12,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:14,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:16,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:18,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:20,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:22,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:24,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:26,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:27,182 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:13:27,182 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:13:28,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:30,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:32,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:34,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:36,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:38,246 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:13:38,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:40,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:42,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:42,312 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:13:42,312 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:13:44,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:47,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:49,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:51,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:53,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:55,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:57,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:13:57,385 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:13:57,385 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:13:59,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:01,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:03,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:05,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:07,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:08,470 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:14:09,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:11,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:12,500 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:14:12,500 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:14:13,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:15,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:17,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:19,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:21,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:23,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:25,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:27,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:27,615 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:14:27,615 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:14:29,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:31,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:33,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:35,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:37,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:38,702 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:14:39,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:41,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:42,703 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:14:42,704 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:14:43,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:45,239 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:14:45,281 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:14:45,303 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:14:45,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:14:45,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:47,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:48,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:49,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:51,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:53,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:55,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:57,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:14:57,821 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:14:57,821 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:14:59,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:01,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:03,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:05,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:07,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:08,941 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:15:09,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:11,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:12,894 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:15:12,894 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:15:13,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:15,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:17,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:19,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:21,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:23,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:25,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:27,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:28,027 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:15:28,027 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:15:29,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:31,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:33,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:35,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:37,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:39,179 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:15:39,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:41,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:43,133 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:15:43,133 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:15:43,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:45,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:47,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:49,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:51,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:54,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:56,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:15:58,242 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:15:58,242 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:15:58,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:00,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:02,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:04,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:06,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:08,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:09,415 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:16:10,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:12,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:13,338 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:16:13,338 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:16:14,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:16,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:18,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:20,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:22,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:24,329 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:26,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:28,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:28,419 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:16:28,419 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:16:30,330 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:32,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:34,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:36,331 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:38,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:39,639 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:16:40,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:42,332 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:43,490 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:16:43,490 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:16:44,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:46,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:48,333 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:49,616 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:16:49,668 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:16:49,696 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:16:50,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:16:50,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:52,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:54,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:56,334 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:58,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:16:58,602 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:16:58,603 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:17:00,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:02,335 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:04,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:06,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:08,336 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:09,862 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:17:10,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:12,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:13,722 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:17:13,722 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:17:14,337 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:16,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:18,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:20,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:22,338 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:24,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:26,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:28,339 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:28,838 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:17:28,838 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:17:30,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:32,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:34,340 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:36,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:38,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:40,090 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:17:40,341 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:42,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:43,918 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:17:43,918 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:17:44,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:46,342 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:48,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:50,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:53,343 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:55,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:57,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:17:58,995 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:17:58,996 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:17:59,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:01,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:03,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:05,345 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:07,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:09,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:10,310 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:18:11,346 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:13,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:14,087 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:18:14,087 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:18:15,347 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:17,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:19,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:21,348 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:23,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:25,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:27,349 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:29,176 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:18:29,176 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:18:29,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:31,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:33,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:35,350 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:37,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:39,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:40,533 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:18:41,351 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:43,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:44,275 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:18:44,275 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:18:45,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:47,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:49,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:51,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:53,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:53,389 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:18:53,440 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:18:53,462 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:18:54,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:18:54,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:55,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:57,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:59,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:18:59,356 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:18:59,357 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:19:01,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:03,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:05,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:09,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:10,783 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:19:11,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:13,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:14,444 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:19:14,444 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:19:15,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:17,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:19,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:21,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:23,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:25,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:27,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:29,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:29,545 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:19:29,545 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:19:31,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:33,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:35,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:37,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:39,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:41,022 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:19:41,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:43,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:44,630 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:19:44,630 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:19:45,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:47,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:49,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:51,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:53,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:55,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:57,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:59,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:19:59,736 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:19:59,736 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:20:01,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:03,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:05,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:07,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:09,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:11,257 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:20:11,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:13,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:14,808 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:20:14,808 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:20:15,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:17,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:19,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:21,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:23,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:25,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:27,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:29,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:29,883 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:20:29,883 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:20:31,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:33,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:35,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:37,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:40,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:41,504 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:20:42,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:44,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:45,017 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:20:45,017 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:20:46,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:48,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:50,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:52,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:54,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:56,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:57,035 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:20:57,078 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:20:57,101 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:20:57,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:20:58,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:20:59,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:00,087 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:21:00,087 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:21:00,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:02,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:04,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:06,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:08,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:10,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:11,745 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:21:12,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:14,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:15,232 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:21:15,232 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:21:16,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:18,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:20,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:22,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:24,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:26,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:28,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:30,299 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:21:30,299 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:21:30,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:32,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:34,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:36,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:38,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:40,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:41,983 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:21:42,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:44,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:45,368 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:21:45,368 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:21:46,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:48,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:50,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:52,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:54,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:56,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:21:58,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:00,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:00,458 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:22:00,458 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:22:02,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:04,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:06,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:08,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:10,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:12,234 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:22:12,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:14,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:15,545 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:22:15,545 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:22:16,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:18,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:20,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:22,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:24,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:26,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:28,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:30,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:30,635 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:22:30,636 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:22:32,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:34,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:36,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:38,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:40,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:42,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:42,478 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:22:44,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:45,768 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:22:45,768 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:22:46,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:48,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:51,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:53,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:55,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:57,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:22:59,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:00,306 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:23:00,354 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:23:00,377 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:23:00,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:23:00,843 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:23:00,843 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:23:01,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:03,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:05,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:07,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:09,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:11,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:12,729 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:23:13,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:15,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:15,914 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:23:15,914 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:23:17,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:19,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:21,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:23,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:25,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:27,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:29,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:31,043 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:23:31,043 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:23:31,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:33,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:35,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:37,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:39,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:41,398 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:42,991 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:23:43,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:45,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:46,113 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:23:46,113 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:23:47,399 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:49,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:51,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:53,400 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:55,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:57,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:23:59,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:01,248 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:24:01,248 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:24:01,401 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:03,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:05,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:07,402 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:09,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:12,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:13,251 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:24:14,403 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:16,322 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:24:16,322 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:24:16,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:18,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:20,404 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:22,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:24,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:26,405 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:28,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:30,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:31,496 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:24:31,497 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:24:32,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:34,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:36,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:38,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:40,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:42,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:43,499 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:24:44,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:46,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:46,587 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:24:46,587 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:24:48,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:50,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:52,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:54,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:56,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:24:58,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:00,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:01,664 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:25:01,664 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:25:02,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:04,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:06,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:08,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:10,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:12,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:13,746 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:25:14,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:16,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:16,777 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:25:16,777 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:25:18,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:20,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:21,836 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:25:21,854 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:25:21,883 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:25:22,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:25:22,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:24,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:25:31,856 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:25:31,856 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:25:44,063 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:25:46,935 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:25:46,935 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:26:01,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:02,014 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:26:02,015 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:26:14,378 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:26:17,090 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:26:17,090 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:26:32,180 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:26:32,180 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:26:33,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:35,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:37,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:39,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:41,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:43,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:44,655 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:26:45,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:47,272 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:26:47,355 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:26:47,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:49,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:51,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:53,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:55,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:57,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:26:59,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:01,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:02,454 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:27:02,454 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:27:03,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:05,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:07,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:09,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:11,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:13,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:14,896 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:27:15,443 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:17,443 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:17,537 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:27:17,537 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:27:19,443 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:21,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:23,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:25,444 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:27,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:29,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:31,445 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:32,639 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:27:32,639 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:27:33,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:35,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:37,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:39,446 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:41,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:43,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:45,125 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:27:45,447 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:47,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:47,707 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:27:47,707 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:27:49,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:51,448 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:53,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:55,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:57,449 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:27:59,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:01,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:02,783 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:28:02,783 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:28:04,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:06,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:08,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:10,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:12,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:14,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:15,362 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:28:16,453 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:17,895 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:28:17,895 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:28:18,453 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:20,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:22,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:24,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:26,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:28,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:30,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:32,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:32,973 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:28:32,973 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:28:34,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:35,724 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:28:35,765 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:28:35,788 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:28:36,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:28:36,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:38,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:40,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:42,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:44,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:45,605 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:28:46,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:48,059 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:28:48,059 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:28:48,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:50,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:52,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:54,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:56,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:28:58,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:00,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:02,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:03,165 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:29:03,166 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:29:04,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:06,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:08,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:10,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:12,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:14,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:15,833 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:29:16,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:18,242 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:29:18,242 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:29:18,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:20,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:22,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:24,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:26,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:28,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:30,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:32,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:33,339 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:29:33,339 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:29:34,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:36,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:38,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:40,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:42,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:44,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:46,065 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:29:46,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:48,426 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:29:48,427 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:29:48,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:50,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:52,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:54,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:56,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:29:58,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:00,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:03,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:03,528 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:30:03,528 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:30:05,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:07,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:09,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:11,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:13,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:15,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:16,290 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:30:17,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:18,661 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:30:18,661 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:30:19,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:21,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:23,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:25,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:27,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:29,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:31,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:33,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:33,742 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:30:33,742 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:30:35,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:37,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:39,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:40,743 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:30:40,786 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:30:40,809 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:30:41,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:30:41,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:43,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:45,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:46,530 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:30:47,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:48,857 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:30:48,858 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:30:49,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:51,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:53,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:55,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:57,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:30:59,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:01,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:03,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:03,970 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:31:03,970 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:31:05,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:07,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:09,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:11,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:13,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:15,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:16,744 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:31:17,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:19,096 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:31:19,096 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:31:19,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:21,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:23,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:25,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:27,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:29,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:31,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:33,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:34,187 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:31:34,187 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:31:35,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:37,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:39,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:41,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:43,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:45,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:46,974 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:31:47,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:49,260 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:31:49,260 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:31:49,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:51,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:53,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:55,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:57,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:31:59,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:01,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:03,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:04,363 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:32:04,363 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:32:05,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:07,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:10,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:12,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:14,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:16,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:17,206 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:32:18,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:19,468 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:32:19,468 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:32:20,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:22,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:24,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:26,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:28,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:30,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:32,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:34,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:34,628 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:32:34,628 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:32:36,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:38,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:40,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:42,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:44,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:44,550 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:32:44,593 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:32:44,616 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:32:45,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:32:46,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:47,435 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:32:47,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:48,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:49,698 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:32:49,698 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:32:50,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:52,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:54,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:56,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:32:58,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:00,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:02,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:04,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:04,804 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:33:04,804 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:33:06,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:08,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:10,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:12,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:14,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:16,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:17,657 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:33:18,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:20,014 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:33:20,015 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:33:20,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:22,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:24,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:26,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:28,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:30,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:32,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:34,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:35,111 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:33:35,111 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:33:36,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:38,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:40,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:42,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:44,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:46,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:47,887 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:33:48,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:50,277 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:33:50,277 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:33:50,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:52,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:54,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:56,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:33:58,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:00,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:02,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:04,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:05,381 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:34:05,381 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:34:06,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:08,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:10,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:12,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:14,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:16,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:18,110 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:34:18,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:20,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:20,525 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:34:20,525 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:34:23,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:25,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:27,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:29,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:31,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:33,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:35,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:35,605 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:34:35,605 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:34:37,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:39,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:41,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:43,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:45,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:47,462 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:34:47,512 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:34:47,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:47,535 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:34:48,360 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:34:48,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:34:49,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:50,687 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:34:50,687 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:34:51,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:53,536 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:55,536 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:57,536 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:34:59,537 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:01,537 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:03,537 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:05,538 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:05,772 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:35:05,772 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:35:07,538 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:09,538 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:11,539 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:13,539 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:15,539 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:17,540 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:18,586 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:35:19,540 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:20,866 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:35:20,867 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:35:21,540 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:23,541 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:25,541 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:27,541 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:29,542 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:31,542 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:33,542 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:35,542 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:35,957 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:35:35,957 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:35:37,543 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:39,543 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:41,543 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:43,544 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:45,544 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:47,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:48,808 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:35:49,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:51,033 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:35:51,033 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:35:51,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:53,545 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:55,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:57,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:35:59,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:01,546 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:03,547 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:05,547 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:06,105 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:36:06,105 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:36:07,547 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:09,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:11,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:13,548 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:15,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:17,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:19,030 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:36:19,549 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:21,187 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:36:21,187 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:36:21,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:23,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:25,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:27,550 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:29,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:31,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:33,551 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:35,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:36,342 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:36:36,342 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:36:37,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:39,552 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:41,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:43,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:45,553 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:48,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:49,270 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:36:50,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:51,486 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:36:51,486 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:36:52,238 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:36:52,281 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:36:52,303 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:36:52,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:36:52,554 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:54,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:56,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:36:58,555 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:00,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:02,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:04,556 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:06,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:06,563 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:37:06,563 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:37:08,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:10,557 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:12,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:14,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:16,558 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:18,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:19,510 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:37:20,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:21,731 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:37:21,731 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:37:22,559 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:24,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:26,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:28,560 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:30,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:32,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:34,561 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:36,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:36,860 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:37:36,860 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:37:38,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:40,562 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:42,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:44,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:46,563 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:48,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:49,742 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:37:50,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:52,021 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:37:52,021 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:37:52,564 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:54,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:56,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:37:58,565 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:00,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:02,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:04,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:06,566 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:07,143 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:38:07,144 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:38:08,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:10,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:12,567 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:14,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:17,568 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:19,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:19,992 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:38:21,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:22,251 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:38:22,251 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:38:23,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:25,569 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:27,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:29,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:31,570 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:33,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:35,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:37,331 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:38:37,331 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:38:37,571 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:39,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:41,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:43,572 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:45,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:47,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:49,573 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:50,232 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:38:51,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:52,402 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:38:52,402 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:38:53,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:55,574 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:57,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:38:59,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:01,575 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:03,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:05,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:07,470 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:39:07,470 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:39:07,576 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:09,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:11,577 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:13,473 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:39:13,492 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:39:13,521 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:39:13,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:39:13,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:14,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:15,578 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:39:20,487 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:39:22,560 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:39:22,560 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:39:37,632 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:39:37,633 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:39:50,828 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:39:52,706 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:39:52,707 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:39:57,591 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:07,781 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:40:07,781 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:40:21,117 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:40:22,864 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:40:22,865 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:40:29,599 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:31,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:33,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:35,600 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:37,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:37,947 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:40:37,947 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:40:39,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:41,601 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:43,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:45,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:47,602 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:49,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:51,362 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:40:51,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:53,052 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:40:53,052 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:40:53,603 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:55,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:57,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:40:59,604 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:02,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:04,605 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:06,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:08,167 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:41:08,167 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:41:08,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:10,606 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:12,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:14,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:16,607 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:18,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:20,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:21,600 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:41:22,608 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:23,243 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:41:23,243 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:41:24,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:26,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:28,609 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:30,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:32,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:34,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:36,610 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:38,341 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:41:38,341 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:41:38,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:40,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:42,611 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:44,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:46,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:48,612 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:50,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:51,844 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:41:52,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:53,420 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:41:53,420 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:41:54,613 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:56,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:41:58,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:00,614 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:02,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:04,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:06,615 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:08,574 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:42:08,575 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:42:08,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:10,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:12,616 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:14,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:16,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:18,617 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:20,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:22,081 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:42:22,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:23,711 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:42:23,711 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:42:24,618 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:26,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:28,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:30,619 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:31,725 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:42:31,771 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:42:31,797 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:42:32,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:42:32,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:33,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:34,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:36,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:38,620 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:38,809 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:42:38,809 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:42:40,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:42,621 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:44,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:46,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:48,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:50,622 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:52,315 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:42:52,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:53,907 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:42:53,907 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:42:54,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:56,623 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:42:58,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:00,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:02,624 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:04,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:06,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:08,625 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:09,042 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:43:09,042 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:43:10,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:12,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:14,626 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:16,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:19,627 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:21,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:22,548 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:43:23,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:24,134 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:43:24,135 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:43:25,628 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:27,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:29,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:31,629 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:33,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:35,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:37,630 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:39,201 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:43:39,201 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:43:39,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:41,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:43,631 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:45,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:47,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:49,632 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:51,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:52,780 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:43:53,633 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:54,295 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:43:54,295 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:43:55,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:57,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:43:59,634 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:01,635 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:03,635 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:05,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:07,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:09,382 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:44:09,382 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:44:09,636 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:11,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:13,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:15,637 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:17,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:19,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:21,638 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:23,012 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:44:23,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:24,459 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:44:24,459 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:44:25,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:27,639 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:29,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:31,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:33,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:35,640 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:36,478 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:44:36,519 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:44:36,542 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:44:36,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:44:37,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:39,556 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:44:39,556 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:44:39,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:41,641 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:43,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:45,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:47,642 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:49,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:51,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:53,251 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:44:53,643 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:54,651 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:44:54,651 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:44:55,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:57,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:44:59,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:01,644 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:03,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:05,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:07,645 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:09,810 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:45:09,810 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:45:10,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:12,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:14,646 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:16,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:18,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:20,647 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:22,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:23,473 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:45:24,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:24,892 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:45:24,893 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:45:26,648 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:28,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:30,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:32,649 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:34,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:36,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:38,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:40,019 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:45:40,019 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:45:40,650 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:42,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:44,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:46,651 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:48,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:50,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:52,652 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:53,694 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:45:54,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:55,127 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:45:55,127 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:45:56,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:45:58,653 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:00,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:02,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:04,654 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:06,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:08,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:10,258 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:46:10,258 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:46:10,655 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:12,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:14,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:16,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:18,656 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:20,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:22,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:23,924 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:46:24,657 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:25,355 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:46:25,355 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:46:26,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:28,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:30,658 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:32,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:34,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:36,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:38,659 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:40,426 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:46:40,426 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:46:40,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:40,771 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:46:40,815 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:46:40,837 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:46:41,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:46:41,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:42,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:44,660 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:46,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:48,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:50,661 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:52,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:54,144 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:46:54,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:55,536 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:46:55,537 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:46:56,662 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:46:58,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:00,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:02,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:04,663 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:06,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:08,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:10,616 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:47:10,616 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:47:10,664 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:12,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:14,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:16,665 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:18,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:20,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:22,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:24,371 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:47:24,666 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:25,702 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:47:25,702 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:47:26,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:28,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:30,667 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:32,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:34,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:36,668 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:39,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:40,783 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:47:40,783 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:47:41,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:43,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:45,669 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:47,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:49,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:51,670 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:53,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:54,594 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:47:55,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:55,885 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:47:55,885 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:47:57,671 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:47:59,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:01,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:03,672 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:05,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:07,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:09,673 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:11,016 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:48:11,016 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:48:11,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:13,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:15,674 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:17,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:19,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:21,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:23,675 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:24,812 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:48:25,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:26,092 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:48:26,092 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:48:27,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:29,676 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:31,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:33,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:35,677 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:37,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:39,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:41,164 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:48:41,164 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:48:41,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:43,678 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:44,974 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:48:45,021 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:48:45,050 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:48:45,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:48:45,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:46,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:47,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:49,679 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:51,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:53,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:55,042 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:48:55,680 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:56,230 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:48:56,230 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:48:57,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:48:59,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:01,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:03,681 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:05,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:07,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:09,682 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:11,326 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:49:11,326 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:49:11,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:13,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:15,683 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:17,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:19,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:21,684 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:23,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:25,268 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:49:25,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:26,415 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:49:26,415 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:49:27,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:29,685 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:31,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:33,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:35,686 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:37,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:39,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:41,522 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:49:41,522 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:49:41,687 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:43,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:45,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:47,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:49,688 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:51,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:53,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:55,495 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:49:56,603 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:49:56,604 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:49:56,689 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:49:58,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:00,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:02,690 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:04,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:06,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:08,691 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:10,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:11,673 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:50:11,673 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:50:12,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:14,692 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:16,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:18,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:20,693 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:22,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:24,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:25,718 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:50:26,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:26,749 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:50:26,749 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:50:28,694 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:30,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:32,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:34,695 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:36,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:38,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:40,696 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:41,845 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:50:41,845 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:50:42,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:44,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:46,697 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:48,243 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:50:48,293 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:50:48,316 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:50:48,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:50:48,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:50,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:52,698 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:54,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:55,949 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:50:56,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:50:56,918 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:50:56,918 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:50:58,699 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:00,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:02,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:04,700 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:06,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:08,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:10,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:12,030 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:51:12,030 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:51:12,701 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:14,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:16,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:18,702 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:20,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:22,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:24,703 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:26,194 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:51:26,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:27,173 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:51:27,173 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:51:28,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:30,704 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:32,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:34,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:36,705 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:38,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:40,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:42,334 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:51:42,334 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:51:42,706 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:44,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:46,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:48,707 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:50,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:52,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:54,708 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:56,426 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:51:57,433 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:51:57,433 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:51:57,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:51:59,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:01,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:03,709 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:05,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:07,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:09,710 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:11,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:12,529 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:52:12,529 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:52:13,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:15,711 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:17,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:19,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:21,712 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:23,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:25,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:26,665 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:52:27,673 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:52:27,674 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:52:27,713 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:29,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:31,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:33,714 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:35,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:37,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:39,715 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:41,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:42,819 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:52:42,819 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:52:43,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:45,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:47,716 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:49,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:51,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:53,717 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:55,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:56,906 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:52:57,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:52:57,890 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:52:57,890 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:52:59,718 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:01,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:03,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:05,719 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:07,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:09,229 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:53:09,248 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:53:09,272 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:53:09,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:53:09,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:11,720 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:12,963 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:53:12,963 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:53:21,724 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:27,176 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:53:28,047 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:53:28,047 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:53:43,123 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:53:43,123 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:53:53,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:55,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:57,456 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:53:57,733 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:53:58,198 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:53:58,198 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:53:59,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:01,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:03,734 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:05,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:07,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:09,735 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:11,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:13,318 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:54:13,318 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:54:13,736 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:16,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:18,737 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:20,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:22,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:24,738 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:26,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:27,684 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:54:28,431 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:54:28,431 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:54:28,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:30,739 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:32,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:34,740 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:36,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:38,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:40,741 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:42,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:43,516 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:54:43,516 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:54:44,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:46,742 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:48,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:50,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:52,743 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:54,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:56,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:54:57,931 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:54:58,598 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:54:58,598 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:54:58,744 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:00,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:02,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:04,745 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:06,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:08,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:10,746 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:12,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:13,690 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:55:13,690 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:55:14,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:16,747 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:18,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:20,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:22,748 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:24,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:26,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:28,163 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:55:28,749 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:28,784 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:55:28,784 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:55:30,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:32,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:34,750 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:36,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:38,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:40,751 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:42,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:43,887 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:55:43,887 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:55:44,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:46,752 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:48,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:50,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:52,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:54,753 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:56,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:57,339 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:55:57,393 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:55:57,417 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:55:57,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:55:58,407 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:55:58,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:55:59,005 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:55:59,006 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:55:59,754 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:00,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:02,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:04,755 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:06,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:09,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:11,756 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:13,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:14,141 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:56:14,141 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:56:15,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:17,757 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:19,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:21,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:23,758 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:25,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:27,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:28,656 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:56:29,206 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:56:29,206 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:56:29,759 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:31,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:33,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:35,760 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:37,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:39,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:41,761 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:44,275 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:56:44,275 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:56:45,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:47,762 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:49,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:51,763 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:53,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:55,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:57,764 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:56:58,903 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:56:59,373 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:56:59,373 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:56:59,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:01,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:03,765 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:05,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:07,766 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:09,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:11,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:13,767 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:14,518 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:57:14,518 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:57:15,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:17,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:19,768 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:21,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:23,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:25,769 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:27,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:29,148 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:57:29,589 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:57:29,590 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:57:29,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:31,770 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:33,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:35,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:37,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:39,771 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:41,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:43,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:44,744 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:57:44,744 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:57:45,772 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:47,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:49,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:51,773 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:53,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:55,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:57,774 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:59,386 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:57:59,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:57:59,824 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:57:59,824 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:58:01,353 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 04:58:01,396 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 04:58:01,418 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 04:58:01,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 04:58:01,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:02,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:03,775 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:05,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:07,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:09,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:11,776 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:13,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:14,955 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:58:14,956 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:58:15,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:17,777 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:19,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:21,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:23,778 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:25,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:27,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:29,654 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:58:29,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:30,052 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:58:30,052 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:58:31,779 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:33,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:35,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:37,780 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:39,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:42,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:44,781 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:45,125 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:58:45,125 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:58:46,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:48,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:50,782 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:52,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:54,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:56,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:58,783 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:58:59,891 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:59:00,200 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:59:00,200 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:59:00,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:02,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:04,784 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:06,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:08,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:10,785 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:12,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:14,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:15,333 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:59:15,334 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:59:16,786 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:18,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:20,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:22,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:24,787 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:26,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:28,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:30,120 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 04:59:30,421 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:59:30,421 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:59:30,788 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:32,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:34,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:36,789 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:38,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:40,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:42,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:44,790 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:45,490 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 04:59:45,490 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 04:59:46,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:48,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:50,791 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:52,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:54,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:56,792 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 04:59:58,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:00,349 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:00:00,594 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:00:00,594 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:00:00,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:02,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:04,793 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:05,057 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:00:05,123 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:00:05,150 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:00:05,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:00:06,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:08,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:10,794 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:12,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:14,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:15,677 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:00:15,678 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:00:16,795 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:18,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:20,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:22,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:24,796 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:26,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:28,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:30,577 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:00:30,758 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:00:30,758 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:00:30,797 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:32,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:34,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:36,798 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:38,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:40,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:42,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:44,799 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:45,847 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:00:45,847 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:00:46,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:48,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:50,800 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:52,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:54,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:56,801 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:00:58,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:00,794 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:01:00,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:00,940 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:01:00,940 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:01:02,802 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:04,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:06,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:08,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:10,803 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:13,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:15,804 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:16,011 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:01:16,011 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:01:17,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:19,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:21,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:23,805 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:25,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:27,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:29,806 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:31,019 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:01:31,149 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:01:31,149 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:01:31,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:33,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:35,807 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:37,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:39,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:41,808 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:43,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:45,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:46,241 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:01:46,241 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:01:47,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:49,809 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:51,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:53,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:55,810 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:57,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:01:59,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:01,249 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:02:01,322 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:02:01,322 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:02:01,811 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:03,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:05,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:07,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:07,882 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:02:07,926 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:02:07,952 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:02:08,812 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:02:08,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:09,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:11,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:13,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:15,813 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:16,422 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:02:16,422 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:02:17,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:19,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:21,814 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:23,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:25,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:27,815 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:29,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:31,481 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:02:31,499 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:02:31,499 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:02:31,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:33,816 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:35,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:37,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:39,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:41,817 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:43,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:45,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:46,610 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:02:46,610 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:02:47,818 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:49,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:51,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:53,819 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:55,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:57,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:02:59,820 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:01,690 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:03:01,690 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:03:01,759 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:03:01,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:03,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:05,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:07,821 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:09,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:11,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:13,822 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:15,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:16,759 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:03:16,759 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:03:17,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:19,823 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:21,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:23,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:25,824 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:27,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:29,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:31,836 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:03:31,837 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:03:31,923 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:03:32,825 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:34,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:36,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:38,826 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:40,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:42,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:44,827 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:46,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:46,945 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:03:46,945 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:03:48,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:50,828 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:52,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:54,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:56,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:03:58,829 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:00,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:02,019 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:04:02,019 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:04:02,154 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:04:02,830 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:04,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:06,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:08,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:10,831 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:12,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:13,566 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:04:13,609 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:04:13,631 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:04:13,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:04:14,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:15,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:16,832 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:17,112 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:04:17,112 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:04:18,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:20,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:22,833 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:24,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:26,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:28,834 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:30,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:32,199 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:04:32,199 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:04:32,393 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:04:32,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:34,835 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:36,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:38,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:40,836 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:42,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:44,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:46,837 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:47,267 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:04:47,267 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:04:48,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:50,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:52,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:54,838 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:56,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:04:58,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:00,839 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:02,388 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:05:02,388 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:05:02,644 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:05:02,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:04,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:06,840 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:08,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:10,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:12,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:14,841 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:17,534 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:05:17,535 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:05:17,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:19,842 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:21,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:23,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:25,843 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:27,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:29,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:31,844 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:32,618 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:05:32,618 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:05:32,885 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:05:33,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:35,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:37,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:39,845 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:41,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:43,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:45,846 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:47,702 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:05:47,702 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:05:47,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:49,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:51,847 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:53,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:55,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:57,848 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:05:59,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:01,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:02,809 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:06:02,809 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:06:03,125 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:06:03,849 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:05,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:07,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:09,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:11,850 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:13,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:15,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:17,851 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:17,893 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:06:17,893 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:06:19,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:21,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:23,852 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:25,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:27,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:29,853 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:31,854 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:32,980 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:06:32,980 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:06:33,360 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:06:33,854 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:35,020 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:06:35,035 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:06:35,065 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:06:35,855 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:06:35,855 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:37,855 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:06:48,049 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:06:48,049 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:07:03,546 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:07:03,547 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:07:03,696 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:07:15,873 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:07:18,622 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:07:18,623 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:07:33,705 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:07:33,706 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:07:34,004 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:07:47,881 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:07:48,788 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:07:48,788 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:07:49,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:07:51,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:07:53,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:07:55,882 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:07:57,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:07:59,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:01,883 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:03,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:03,944 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:08:03,944 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:08:04,260 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:08:05,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:07,884 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:09,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:11,885 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:13,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:15,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:17,886 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:19,018 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:08:19,018 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:08:19,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:21,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:23,887 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:28,888 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:30,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:32,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:34,088 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:08:34,088 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:08:34,479 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:08:34,889 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:36,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:38,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:40,890 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:42,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:44,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:46,891 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:48,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:49,190 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:08:49,190 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:08:50,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:52,892 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:54,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:56,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:08:58,893 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:00,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:02,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:04,289 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:09:04,289 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:09:04,712 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:09:04,894 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:06,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:08,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:10,895 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:12,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:14,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:16,896 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:18,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:19,360 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:09:19,360 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:09:20,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:22,897 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:24,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:26,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:28,898 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:30,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:32,899 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:34,537 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:09:34,537 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:09:34,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:34,958 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:09:36,900 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:38,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:40,901 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:42,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:44,902 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:46,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:48,903 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:49,639 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:09:49,640 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:09:50,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:52,743 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:09:52,810 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:09:52,837 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:09:52,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:09:52,904 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:54,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:56,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:09:58,905 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:01,906 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:03,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:04,712 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:10:04,712 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:10:05,214 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:10:05,907 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:07,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:09,908 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:11,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:13,909 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:15,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:17,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:19,839 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:10:19,839 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:10:19,910 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:21,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:23,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:25,911 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:27,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:29,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:31,912 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:33,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:34,940 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:10:34,940 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:10:35,453 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:10:35,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:37,913 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:39,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:41,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:43,914 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:45,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:47,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:49,915 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:50,081 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:10:50,081 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:10:51,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:53,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:55,916 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:57,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:10:59,917 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:03,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:05,244 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:11:05,245 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:11:05,699 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:11:05,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:07,918 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:09,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:11,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:13,919 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:15,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:17,920 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:19,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:20,357 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:11:20,357 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:11:21,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:23,921 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:25,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:27,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:29,922 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:31,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:33,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:35,449 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:11:35,449 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:11:35,923 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:35,951 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:11:37,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:39,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:41,924 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:43,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:45,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:47,925 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:49,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:50,532 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:11:50,533 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:11:51,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:53,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:55,926 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:56,008 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:11:56,059 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:11:56,085 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:11:56,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:11:56,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:57,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:11:59,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:01,927 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:03,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:05,604 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:12:05,604 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:12:05,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:06,202 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:12:07,928 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:09,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:11,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:13,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:15,929 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:18,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:20,712 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:12:20,712 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:12:20,930 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:22,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:24,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:26,931 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:28,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:30,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:32,932 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:34,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:35,907 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:12:35,907 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:12:36,443 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:12:36,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:38,933 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:40,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:42,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:44,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:46,934 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:48,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:50,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:50,983 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:12:50,983 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:12:52,935 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:54,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:56,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:12:58,936 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:00,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:02,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:04,937 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:06,103 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:13:06,103 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:13:06,690 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:13:06,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:08,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:10,938 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:12,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:14,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:16,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:18,939 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:20,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:21,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:13:21,176 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:13:22,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:24,940 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:26,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:28,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:30,941 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:32,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:34,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:36,253 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:13:36,253 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:13:36,933 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:13:36,942 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:38,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:40,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:42,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:44,943 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:46,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:48,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:50,944 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:51,363 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:13:51,364 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:13:52,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:54,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:56,945 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:58,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:13:59,738 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:13:59,787 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:13:59,816 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:13:59,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:14:00,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:01,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:02,946 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:04,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:06,484 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:14:06,484 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:14:06,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:07,188 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:14:08,947 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:10,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:12,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:14,948 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:16,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:18,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:20,949 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:21,552 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:14:21,552 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:14:22,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:24,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:26,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:28,950 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:32,951 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:34,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:36,645 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:14:36,645 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:14:36,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:37,429 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:14:38,952 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:40,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:42,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:44,953 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:46,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:48,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:50,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:51,744 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:14:51,744 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:14:52,954 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:54,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:56,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:14:58,955 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:00,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:02,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:05,956 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:06,819 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:15:06,819 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:15:07,669 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:15:07,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:09,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:11,957 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:13,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:15,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:17,958 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:19,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:21,900 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:15:21,900 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:15:21,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:23,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:25,959 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:27,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:29,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:31,960 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:33,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:35,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:37,011 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:15:37,011 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:15:37,906 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:15:37,961 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:39,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:41,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:43,962 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:45,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:47,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:49,963 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:51,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:52,131 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:15:52,131 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:15:53,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:55,964 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:57,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:15:59,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:01,965 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:03,917 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:16:03,964 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:16:03,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:03,992 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:16:04,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:16:05,992 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:07,232 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:16:07,232 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:16:07,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:08,158 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:16:09,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:11,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:13,993 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:15,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:17,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:19,994 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:21,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:22,307 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:16:22,307 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:16:23,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:25,995 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:27,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:29,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:31,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:33,996 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:35,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:37,375 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:16:37,375 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:16:37,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:38,401 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:16:39,997 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:41,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:43,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:45,998 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:47,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:49,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:51,999 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:52,473 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:16:52,473 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:16:54,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:56,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:16:58,000 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:00,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:02,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:04,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:06,001 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:07,545 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:17:07,546 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:17:08,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:08,641 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:17:10,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:12,002 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:14,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:16,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:18,003 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:21,004 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:22,637 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:17:22,637 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:17:23,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:25,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:27,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:29,005 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:31,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:33,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:35,006 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:37,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:37,749 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:17:37,749 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:17:38,884 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:17:39,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:41,007 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:43,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:45,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:47,008 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:49,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:51,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:52,820 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:17:52,820 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:17:53,009 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:55,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:57,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:17:59,010 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:01,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:03,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:05,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:07,011 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:07,542 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:18:07,590 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:18:07,612 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:18:07,932 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:18:07,933 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:18:08,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:18:09,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:09,145 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:18:11,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:13,012 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:15,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:17,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:19,013 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:21,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:23,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:23,067 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:18:23,067 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:18:25,014 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:27,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:29,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:31,015 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:33,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:35,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:37,016 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:38,138 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:18:38,139 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:18:39,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:39,445 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:18:41,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:43,017 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:45,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:47,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:49,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:51,018 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:53,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:53,238 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:18:53,239 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:18:55,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:57,019 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:18:59,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:01,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:03,020 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:05,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:08,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:08,353 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:19:08,353 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:19:09,689 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:19:10,021 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:12,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:14,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:16,022 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:18,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:20,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:22,023 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:23,483 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:19:23,483 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:19:24,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:26,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:28,024 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:30,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:32,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:34,025 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:36,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:38,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:38,554 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:19:38,554 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:19:39,936 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:19:40,026 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:42,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:44,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:46,027 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:48,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:50,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:52,028 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:53,738 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:19:53,738 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:19:54,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:56,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:19:58,029 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:00,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:02,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:04,030 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:06,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:08,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:08,807 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:20:08,807 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:20:10,031 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:10,182 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:20:12,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:14,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:16,032 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:18,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:20,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:22,033 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:23,930 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:20:23,930 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:20:24,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:26,034 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:28,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:29,484 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:20:29,494 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:20:29,525 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:20:30,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:20:30,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:31,035 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:32,036 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:39,002 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:20:39,002 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:20:40,446 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:20:46,041 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:20:54,090 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:20:54,090 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:21:09,167 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:21:09,168 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:21:10,735 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:21:20,049 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:22,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:24,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:24,277 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:21:24,277 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:21:27,050 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:29,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:31,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:33,051 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:35,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:37,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:39,052 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:39,352 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:21:39,352 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:21:40,996 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:21:41,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:43,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:45,053 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:47,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:49,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:51,054 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:53,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:54,484 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:21:54,484 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:21:55,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:57,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:21:59,055 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:01,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:03,056 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:05,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:07,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:09,057 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:09,588 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:22:09,588 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:22:11,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:11,252 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:22:13,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:15,058 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:17,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:19,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:21,059 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:23,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:24,744 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:22:24,744 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:22:25,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:27,060 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:29,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:31,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:33,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:35,061 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:37,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:39,062 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:39,882 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:22:39,882 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:22:41,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:41,489 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:22:43,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:45,063 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:47,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:49,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:51,064 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:53,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:54,951 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:22:54,951 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:22:55,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:57,065 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:22:59,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:01,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:03,066 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:05,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:07,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:09,067 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:10,037 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:23:10,038 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:23:11,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:11,728 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:23:13,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:15,068 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:17,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:19,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:21,069 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:22,406 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:23:22,467 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:23:22,494 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:23:23,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:23:23,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:24,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:25,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:25,148 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:23:25,148 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:23:27,070 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:29,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:31,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:33,071 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:35,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:37,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:39,072 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:40,248 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:23:40,248 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:23:41,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:41,975 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:23:43,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:45,073 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:47,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:49,074 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:52,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:54,075 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:55,349 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:23:55,349 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:23:56,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:23:58,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:00,076 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:02,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:04,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:06,077 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:08,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:10,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:10,489 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:24:10,490 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:24:12,078 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:12,211 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:24:14,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:16,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:18,079 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:20,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:22,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:24,080 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:25,603 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:24:25,603 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:24:26,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:28,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:30,081 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:32,082 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:34,082 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:36,082 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:38,083 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:40,083 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:40,721 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:24:40,721 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:24:42,083 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:42,445 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:24:44,084 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:46,084 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:50,085 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:52,085 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:54,085 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:55,793 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:24:55,793 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:24:56,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:24:58,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:00,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:02,086 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:04,087 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:06,087 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:08,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:10,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:10,860 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:25:10,860 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:25:12,088 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:12,669 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:25:14,089 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:16,089 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:18,089 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:20,090 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:22,090 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:24,090 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:25,954 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:25:25,955 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:25:26,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:27,570 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:25:27,616 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:25:27,639 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:25:28,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:25:28,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:30,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:32,091 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:34,092 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:36,092 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:38,092 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:41,068 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:25:41,068 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:25:41,093 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:42,910 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:25:43,093 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:45,094 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:47,094 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:49,094 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:53,095 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:55,095 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:56,169 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:25:56,169 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:25:57,096 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:25:59,096 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:01,096 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:03,096 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:05,097 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:07,097 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:09,097 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:11,098 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:11,275 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:26:11,275 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:26:13,098 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:13,138 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:26:15,098 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:17,099 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:19,099 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:21,099 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:23,100 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:25,100 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:26,346 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:26:26,346 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:26:27,100 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:29,101 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:31,101 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:33,101 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:35,102 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:37,102 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:39,102 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:41,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:41,488 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:26:41,489 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:26:43,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:43,363 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:26:45,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:47,104 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:49,104 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:51,104 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:53,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:55,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:56,561 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:26:56,561 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:26:57,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:26:59,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:01,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:03,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:05,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:07,107 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:09,107 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:11,107 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:11,636 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:27:11,636 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:27:13,108 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:13,584 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:27:15,108 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:17,108 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:19,109 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:21,109 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:23,109 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:25,110 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:26,750 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:27:26,750 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:27:27,110 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:29,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:31,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:31,745 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:27:31,789 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:27:31,812 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:27:32,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:27:33,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:34,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:36,112 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:38,112 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:40,112 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:41,824 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:27:41,824 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:27:42,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:43,807 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:27:44,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:46,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:48,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:50,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:52,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:54,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:27:56,923 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:27:56,923 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:27:58,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:00,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:02,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:04,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:06,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:08,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:10,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:12,033 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:28:12,033 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:28:12,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:14,034 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:28:14,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:16,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:18,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:20,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:22,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:24,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:26,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:27,195 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:28:27,195 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:28:28,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:30,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:32,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:34,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:36,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:38,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:40,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:42,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:42,307 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:28:42,307 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:28:44,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:44,255 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:28:46,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:48,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:50,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:52,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:54,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:56,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:28:57,381 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:28:57,381 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:28:58,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:00,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:02,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:04,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:06,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:08,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:10,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:12,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:12,495 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:29:12,495 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:29:14,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:14,473 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:29:16,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:18,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:20,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:22,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:24,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:26,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:27,674 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:29:27,674 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:29:28,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:30,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:32,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:34,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:35,889 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:29:35,938 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:29:35,961 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:29:36,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:29:36,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:37,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:38,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:41,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:42,802 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:29:42,803 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:29:43,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:44,708 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:29:45,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:47,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:49,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:51,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:53,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:55,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:57,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:29:57,980 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:29:57,980 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:29:59,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:01,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:03,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:05,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:07,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:09,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:11,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:13,053 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:30:13,053 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:30:13,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:14,933 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:30:15,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:17,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:19,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:21,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:23,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:25,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:27,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:28,256 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:30:28,256 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:30:29,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:31,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:33,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:35,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:37,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:39,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:41,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:43,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:43,344 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:30:43,344 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:30:45,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:45,158 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:30:47,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:49,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:51,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:53,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:55,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:57,144 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:30:58,423 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:30:58,423 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:30:59,145 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:01,145 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:03,145 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:05,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:07,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:09,146 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:11,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:13,147 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:13,593 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:31:13,593 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:31:15,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:15,379 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:31:17,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:19,148 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:21,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:23,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:25,149 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:27,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:28,691 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:31:28,691 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:31:29,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:31,150 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:33,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:35,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:37,151 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:38,524 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:31:38,569 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:31:38,593 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:31:39,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:31:39,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:41,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:43,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:43,794 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:31:43,794 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:31:45,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:45,607 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:31:47,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:49,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:51,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:53,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:55,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:58,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:31:58,907 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:31:58,907 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:32:00,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:02,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:04,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:06,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:08,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:10,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:12,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:13,981 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:32:13,981 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:32:14,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:15,844 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:32:16,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:18,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:20,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:22,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:24,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:26,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:28,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:29,126 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:32:29,126 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:32:30,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:32,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:34,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:36,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:38,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:40,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:42,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:44,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:44,203 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:32:44,204 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:32:46,080 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:32:46,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:48,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:50,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:52,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:54,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:56,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:58,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:32:59,412 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:32:59,412 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:33:00,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:02,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:05,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:07,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:09,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:11,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:13,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:14,496 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:33:14,496 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:33:15,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:16,322 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:33:17,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:19,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:21,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:23,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:25,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:27,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:29,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:29,588 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:33:29,588 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:33:31,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:33,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:35,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:37,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:39,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:41,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:43,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:44,708 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:33:44,708 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:33:45,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:46,560 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:33:47,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:49,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:51,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:53,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:55,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:57,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:59,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:33:59,797 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:33:59,797 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:34:00,333 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:34:00,351 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:34:00,380 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:34:01,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:34:01,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:34:02,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:34:03,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:34:14,903 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:34:14,903 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:34:16,831 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:34:29,976 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:34:29,976 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:34:43,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:34:45,189 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:34:45,189 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:34:47,159 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:35:00,259 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:35:00,259 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:35:15,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:15,380 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:35:15,380 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:35:17,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:17,444 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:35:19,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:21,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:23,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:25,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:27,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:29,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:30,475 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:35:30,476 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:35:31,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:33,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:35,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:37,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:39,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:41,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:43,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:45,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:45,640 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:35:45,640 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:35:47,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:47,670 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:35:49,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:52,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:54,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:56,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:35:58,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:00,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:00,741 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:36:00,741 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:36:02,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:04,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:06,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:08,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:10,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:12,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:14,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:15,863 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:36:15,863 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:36:16,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:17,902 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:36:18,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:20,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:22,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:24,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:26,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:28,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:30,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:30,952 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:36:30,952 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:36:32,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:34,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:36,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:38,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:40,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:42,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:44,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:46,119 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:36:46,119 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:36:46,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:48,140 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:36:48,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:50,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:52,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:54,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:56,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:36:58,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:00,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:01,199 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:37:01,199 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:37:02,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:04,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:06,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:08,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:10,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:12,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:14,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:16,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:16,336 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:37:16,336 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:37:17,311 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:37:17,355 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:37:17,382 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:37:18,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:37:18,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:18,387 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:37:20,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:22,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:24,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:26,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:28,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:30,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:31,458 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:37:31,459 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:37:32,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:34,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:36,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:38,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:40,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:42,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:44,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:46,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:46,542 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:37:46,542 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:37:48,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:48,640 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:37:50,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:52,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:54,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:57,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:37:59,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:01,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:01,644 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:38:01,644 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:38:03,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:05,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:07,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:09,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:11,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:13,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:15,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:16,745 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:38:16,745 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:38:17,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:18,885 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:38:19,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:21,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:23,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:25,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:27,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:29,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:31,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:31,823 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:38:31,823 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:38:33,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:35,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:37,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:39,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:41,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:43,237 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:45,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:46,911 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:38:46,911 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:38:47,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:49,130 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:38:49,238 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:51,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:53,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:55,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:57,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:38:59,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:01,240 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:02,053 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:39:02,053 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:39:03,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:05,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:07,241 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:09,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:11,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:13,242 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:15,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:17,231 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:39:17,231 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:39:17,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:19,243 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:19,364 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:39:21,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:21,294 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:39:21,349 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:39:21,372 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:39:22,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:39:23,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:25,244 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:27,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:29,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:31,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:32,323 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:39:32,324 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:39:33,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:35,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:37,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:39,246 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:41,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:43,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:45,247 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:47,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:47,395 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:39:47,395 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:39:49,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:49,588 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:39:51,248 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:54,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:56,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:39:58,249 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:00,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:02,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:02,487 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:40:02,487 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:40:04,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:06,250 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:08,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:10,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:12,251 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:14,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:16,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:17,562 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:40:17,562 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:40:18,252 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:19,805 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:40:20,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:22,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:24,253 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:26,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:28,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:30,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:32,254 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:32,633 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:40:32,633 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:40:34,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:36,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:38,255 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:40,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:42,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:44,256 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:46,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:47,706 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:40:47,706 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:40:48,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:50,030 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:40:50,257 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:52,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:54,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:56,258 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:40:58,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:00,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:02,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:02,777 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:41:02,777 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:41:04,259 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:06,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:08,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:10,260 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:12,261 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:14,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:16,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:17,867 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:41:17,868 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:41:18,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:20,262 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:20,265 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:41:22,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:24,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:25,288 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:41:25,332 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:41:25,356 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:41:26,263 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:41:26,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:27,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:28,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:30,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:32,264 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:33,052 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:41:33,052 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:41:34,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:36,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:38,265 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:40,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:44,266 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:46,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:48,123 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:41:48,123 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:41:48,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:50,267 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:50,490 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:41:52,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:54,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:56,268 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:41:58,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:00,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:02,269 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:03,208 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:42:03,208 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:42:04,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:06,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:08,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:10,270 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:12,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:14,271 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:16,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:18,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:18,296 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:42:18,296 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:42:20,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:20,710 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:42:22,272 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:24,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:26,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:28,273 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:30,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:33,274 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:33,387 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:42:33,387 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:42:35,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:37,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:39,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:41,275 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:43,276 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:45,276 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:47,276 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:48,473 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:42:48,474 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:42:49,277 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:50,933 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:42:51,277 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:53,277 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:55,278 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:57,278 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:42:59,278 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:01,279 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:03,279 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:03,621 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:43:03,622 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:43:05,279 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:07,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:09,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:11,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:13,280 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:15,281 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:17,281 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:18,701 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:43:18,701 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:43:19,281 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:21,162 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:43:21,282 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:23,282 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:25,282 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:27,283 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:29,283 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:31,283 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:31,614 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:43:31,667 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:43:31,690 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:43:32,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:43:33,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:33,781 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:43:33,781 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:43:34,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:35,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:37,284 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:39,285 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:41,285 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:43,285 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:45,286 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:47,286 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:48,893 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:43:48,893 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:43:49,286 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:51,286 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:51,382 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:43:53,287 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:55,287 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:57,287 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:43:59,288 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:01,288 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:03,288 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:04,002 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:44:04,002 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:44:05,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:07,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:09,289 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:11,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:13,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:15,290 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:17,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:19,112 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:44:19,112 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:44:19,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:21,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:21,607 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:44:23,291 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:25,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:27,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:29,292 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:31,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:33,293 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:34,214 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:44:34,214 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:44:36,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:38,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:40,294 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:42,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:44,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:46,295 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:48,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:49,289 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:44:49,289 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:44:50,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:51,841 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:44:52,296 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:54,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:56,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:44:58,297 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:00,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:02,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:04,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:04,399 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:45:04,399 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:45:06,298 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:08,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:10,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:12,299 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:14,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:16,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:18,300 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:19,471 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:45:19,471 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:45:20,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:22,068 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:45:22,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:24,301 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:26,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:28,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:30,302 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:32,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:34,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:34,576 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:45:34,576 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:45:35,046 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:45:35,091 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:45:35,114 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:45:35,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:45:36,303 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:38,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:40,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:42,304 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:44,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:46,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:48,305 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:49,656 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:45:49,656 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:45:50,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:52,301 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:45:52,306 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:54,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:56,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:45:58,307 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:00,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:02,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:04,308 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:04,747 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:46:04,747 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:46:06,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:08,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:10,309 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:12,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:14,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:16,310 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:18,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:19,957 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:46:19,957 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:46:21,311 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:22,536 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:46:23,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:25,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:27,312 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:29,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:31,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:33,313 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:35,086 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:46:35,087 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:46:35,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:37,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:39,314 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:41,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:43,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:45,315 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:47,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:49,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:50,161 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:46:50,161 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:46:51,316 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:52,775 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:46:53,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:55,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:57,317 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:46:59,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:01,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:03,318 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:05,270 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:47:05,270 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:47:05,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:07,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:09,319 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:11,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:13,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:15,320 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:17,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:19,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:20,376 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:47:20,376 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:47:21,321 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:23,014 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:47:23,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:25,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:27,322 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:29,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:31,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:33,323 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:35,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:35,454 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:47:35,454 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:47:37,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:39,324 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:41,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:43,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:45,325 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:48,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:50,326 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:50,582 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:47:50,582 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:47:52,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:53,242 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:47:54,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:56,327 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:56,643 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:47:56,655 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:47:56,683 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:47:57,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:47:58,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:47:59,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:48:00,328 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:48:05,657 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:48:05,657 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:48:20,741 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:48:20,741 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:48:23,556 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:48:34,344 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:48:35,816 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:48:35,843 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:48:50,928 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:48:50,928 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:48:53,858 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:49:06,006 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:49:06,006 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:49:06,352 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:08,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:10,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:12,353 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:14,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:16,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:18,354 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:20,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:21,075 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:49:21,075 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:49:22,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:24,118 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:49:24,355 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:26,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:28,356 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:30,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:32,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:34,357 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:36,190 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:49:36,190 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:49:36,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:38,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:40,358 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:42,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:44,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:46,359 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:48,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:50,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:51,290 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:49:51,290 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:49:52,360 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:54,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:54,370 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:49:56,361 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:49:58,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:00,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:02,362 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:04,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:06,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:06,410 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:50:06,410 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:50:08,363 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:10,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:12,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:14,364 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:16,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:18,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:20,365 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:21,526 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:50:21,526 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:50:22,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:24,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:24,605 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:50:26,366 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:28,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:30,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:32,367 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:34,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:36,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:36,607 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:50:36,607 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:50:38,368 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:40,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:42,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:44,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:46,369 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:48,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:50,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:51,693 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:50:51,693 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:50:52,370 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:54,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:54,846 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:50:56,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:50:58,371 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:00,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:02,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:04,372 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:06,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:06,777 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:51:06,777 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:51:08,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:08,977 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:51:09,039 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:51:09,067 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:51:09,373 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:51:11,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:13,374 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:15,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:17,375 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:19,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:21,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:21,883 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:51:21,884 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:51:23,376 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:25,090 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:51:25,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:27,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:29,377 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:31,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:33,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:35,378 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:36,963 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:51:36,963 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:51:37,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:39,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:41,379 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:43,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:45,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:47,380 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:49,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:51,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:52,064 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:51:52,064 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:51:53,381 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:55,329 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:51:55,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:57,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:51:59,382 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:01,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:03,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:05,383 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:07,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:52:07,175 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:52:07,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:09,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:11,384 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:13,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:15,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:17,385 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:21,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:22,264 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:52:22,264 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:52:23,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:25,386 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:25,571 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:52:27,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:29,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:31,387 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:33,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:35,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:37,361 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:52:37,361 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:52:37,388 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:39,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:41,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:43,389 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:45,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:47,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:49,390 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:51,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:52,478 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:52:52,478 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:52:53,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:55,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:55,805 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:52:57,391 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:52:59,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:01,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:03,392 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:05,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:07,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:07,547 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:53:07,547 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:53:09,393 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:11,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:11,853 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:53:11,897 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:53:11,936 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:53:11,936 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-10 05:53:11,936 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: metric 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:53:11,937 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:53:11,961 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:53:12,394 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:53:13,395 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:14,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:15,396 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:18,397 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/config.yaml 2022-01-10 05:53:22,653 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:53:22,653 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:53:26,204 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:53:37,825 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:53:37,825 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:53:39,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:42,406 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:44,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:46,407 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:48,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:50,408 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:52,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:52,960 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:53:52,961 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:53:54,409 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:56,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:53:56,488 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:53:58,410 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:00,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:02,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:04,411 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:06,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:08,060 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:54:08,060 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:54:08,412 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:10,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:12,413 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:14,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:16,414 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:18,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:20,415 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:22,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:23,173 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:54:23,173 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:54:24,416 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:26,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:26,730 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:54:28,417 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:30,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:32,418 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:34,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:36,419 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:38,247 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:54:38,247 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:54:38,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:40,420 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:42,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:44,421 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:46,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:48,422 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:50,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:52,423 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:53,363 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:54:53,363 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:54:54,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:56,424 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:54:56,973 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:54:59,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:01,425 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:03,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:05,426 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:07,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:08,450 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:55:08,450 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:55:09,427 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:11,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:13,428 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:15,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:17,429 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:19,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:21,430 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:23,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:23,582 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:55:23,582 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:55:25,431 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:27,213 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:55:27,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:29,432 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:31,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:33,433 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:35,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:37,434 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:38,654 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:55:38,655 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:55:39,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:41,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:43,435 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:45,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:47,436 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:49,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:51,437 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:53,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:53,729 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:55:53,729 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:55:55,438 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:57,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:55:57,452 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:55:59,439 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:01,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:02,278 DEBUG SenderThread:31514 [sender.py:send():182] send: history 2022-01-10 05:56:02,298 DEBUG SenderThread:31514 [sender.py:send():182] send: summary 2022-01-10 05:56:02,331 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end 2022-01-10 05:56:02,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json 2022-01-10 05:56:03,440 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:04,441 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:07,442 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:08,871 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:56:08,872 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:56:23,945 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:56:23,945 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:56:27,729 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:56:39,033 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:56:39,033 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:56:39,450 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:41,451 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:43,452 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:51,454 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:54,103 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:56:54,104 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:56:55,455 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:57,456 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:56:58,060 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:56:59,457 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:01,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:03,458 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:05,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:07,459 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:09,179 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:57:09,180 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:57:09,460 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:11,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:13,461 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:15,462 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:17,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:19,463 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:21,464 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:23,465 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:24,259 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:57:24,259 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:57:25,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:27,466 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:28,369 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:57:29,467 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:31,468 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:33,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:35,469 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:37,470 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:39,396 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:57:39,397 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:57:39,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:41,471 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:43,472 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:45,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:47,473 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:49,474 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:51,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:53,475 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:54,471 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:57:54,471 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:57:55,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:57,476 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:57:58,665 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:57:59,477 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:01,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:03,478 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:05,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:07,479 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:09,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:09,546 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:58:09,546 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:58:11,480 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:13,481 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:15,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:17,482 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:19,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:21,483 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:23,484 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:24,616 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:58:24,616 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:58:25,485 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:27,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:28,962 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:58:29,486 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:31,487 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:33,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:35,488 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:37,489 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:39,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:39,688 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:58:39,688 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:58:41,490 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:43,491 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:45,492 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:47,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:49,493 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:51,494 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:53,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:54,767 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:58:54,767 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:58:55,495 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:57,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:58:59,257 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:58:59,496 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:01,497 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:03,498 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:06,499 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:08,500 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:09,842 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:59:09,843 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:59:10,501 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:12,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:14,502 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:16,503 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:18,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:20,504 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:22,505 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:24,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:24,918 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:59:24,918 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:59:26,506 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:28,507 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:29,552 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 05:59:30,508 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:32,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:34,509 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:36,510 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:38,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:39,989 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:59:39,989 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:59:40,511 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:42,512 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:44,513 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:46,514 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:48,515 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:50,516 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:52,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:54,517 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:55,061 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 05:59:55,061 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 05:59:56,518 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:58,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 05:59:59,849 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 06:00:00,519 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:02,520 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:04,521 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:06,522 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:08,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:10,137 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 06:00:10,137 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 06:00:10,523 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:12,525 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:14,525 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:16,526 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:18,527 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:20,527 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:22,528 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:24,529 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:25,298 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 06:00:25,298 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 06:00:26,530 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:28,531 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:30,147 DEBUG SenderThread:31514 [sender.py:send():182] send: stats 2022-01-10 06:00:30,532 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:32,532 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:34,533 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:36,534 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:38,535 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log 2022-01-10 06:00:40,375 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status 2022-01-10 06:00:40,375 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status 2022-01-10 06:00:40,536 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log