2024-02-18 17:16:49,512 INFO    MainThread:3602 [wandb_setup.py:_flush():76] Current SDK version is 0.16.3
2024-02-18 17:16:49,512 INFO    MainThread:3602 [wandb_setup.py:_flush():76] Configure stats pid to 3602
2024-02-18 17:16:49,512 INFO    MainThread:3602 [wandb_setup.py:_flush():76] Loading settings from /home/ubuntu/.config/wandb/settings
2024-02-18 17:16:49,512 INFO    MainThread:3602 [wandb_setup.py:_flush():76] Loading settings from /home/ubuntu/torchtune-colorful-llama/colorful/wandb/settings
2024-02-18 17:16:49,512 INFO    MainThread:3602 [wandb_setup.py:_flush():76] Loading settings from environment variables: {'api_key': '***REDACTED***'}
2024-02-18 17:16:49,512 INFO    MainThread:3602 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False}
2024-02-18 17:16:49,512 INFO    MainThread:3602 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'colorful/full_finetune.py', 'program_abspath': '/home/ubuntu/torchtune-colorful-llama/colorful/full_finetune.py', 'program': '/home/ubuntu/torchtune-colorful-llama/colorful/./full_finetune.py'}
2024-02-18 17:16:49,513 INFO    MainThread:3602 [wandb_init.py:_log_setup():526] Logging user logs to /home/ubuntu/torchtune-colorful-llama/colorful/wandb/run-20240218_171649-qsv24pfw/logs/debug.log
2024-02-18 17:16:49,513 INFO    MainThread:3602 [wandb_init.py:_log_setup():527] Logging internal logs to /home/ubuntu/torchtune-colorful-llama/colorful/wandb/run-20240218_171649-qsv24pfw/logs/debug-internal.log
2024-02-18 17:16:49,513 INFO    MainThread:3602 [wandb_init.py:init():566] calling init triggers
2024-02-18 17:16:49,513 INFO    MainThread:3602 [wandb_init.py:init():573] wandb.init called with sweep_config: {}
config: {'log_dir': 'output/alpaca-colorful-llama2-finetune'}
2024-02-18 17:16:49,513 INFO    MainThread:3602 [wandb_init.py:init():616] starting backend
2024-02-18 17:16:49,513 INFO    MainThread:3602 [wandb_init.py:init():620] setting up manager
2024-02-18 17:16:49,516 INFO    MainThread:3602 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2024-02-18 17:16:49,519 INFO    MainThread:3602 [wandb_init.py:init():628] backend started and connected
2024-02-18 17:16:49,523 INFO    MainThread:3602 [wandb_init.py:init():720] updated telemetry
2024-02-18 17:16:49,533 INFO    MainThread:3602 [wandb_init.py:init():753] communicating run to backend with 90.0 second timeout
2024-02-18 17:16:50,069 INFO    MainThread:3602 [wandb_run.py:_on_init():2262] communicating current version
2024-02-18 17:16:50,325 INFO    MainThread:3602 [wandb_run.py:_on_init():2271] got version response 
2024-02-18 17:16:50,326 INFO    MainThread:3602 [wandb_init.py:init():804] starting run threads in backend
2024-02-18 17:16:50,455 INFO    MainThread:3602 [wandb_run.py:_console_start():2241] atexit reg
2024-02-18 17:16:50,456 INFO    MainThread:3602 [wandb_run.py:_redirect():2096] redirect: wrap_raw
2024-02-18 17:16:50,456 INFO    MainThread:3602 [wandb_run.py:_redirect():2161] Wrapping output streams.
2024-02-18 17:16:50,456 INFO    MainThread:3602 [wandb_run.py:_redirect():2186] Redirects installed.
2024-02-18 17:16:50,458 INFO    MainThread:3602 [wandb_init.py:init():847] run started, returning control to user process
2024-02-18 22:45:39,297 INFO    MainThread:3602 [wandb_run.py:_finish():1970] finishing run laurence_r/colorful-llama/qsv24pfw
2024-02-18 22:45:39,298 INFO    MainThread:3602 [wandb_run.py:_atexit_cleanup():2210] got exitcode: 0
2024-02-18 22:45:39,298 INFO    MainThread:3602 [wandb_run.py:_restore():2193] restore
2024-02-18 22:45:39,298 INFO    MainThread:3602 [wandb_run.py:_restore():2199] restore done
2024-02-18 22:45:45,293 INFO    MainThread:3602 [wandb_run.py:_footer_history_summary_info():3866] rendering history
2024-02-18 22:45:45,294 INFO    MainThread:3602 [wandb_run.py:_footer_history_summary_info():3898] rendering summary
2024-02-18 22:45:45,302 INFO    MainThread:3602 [wandb_run.py:_footer_sync_info():3825] logging synced files