2023-07-12 00:03:08,072 INFO MainThread:3148324 [wandb_setup.py:_flush():76] Current SDK version is 0.15.4 2023-07-12 00:03:08,072 INFO MainThread:3148324 [wandb_setup.py:_flush():76] Configure stats pid to 3148324 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_setup.py:_flush():76] Loading settings from /u/sragas/.config/wandb/settings 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_setup.py:_flush():76] Loading settings from /nfs/nfs2/home/sragas/demo/wandb/settings 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_setup.py:_flush():76] Loading settings from environment variables: {} 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False} 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'train_text_to_image_lora.py', 'program': 'train_text_to_image_lora.py'} 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_init.py:_log_setup():507] Logging user logs to /l/vision/v5/sragas/easel_ai/models_plain/wandb/run-20230712_000308-lh5nw6i8/logs/debug.log 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_init.py:_log_setup():508] Logging internal logs to /l/vision/v5/sragas/easel_ai/models_plain/wandb/run-20230712_000308-lh5nw6i8/logs/debug-internal.log 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_init.py:init():547] calling init triggers 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_init.py:init():554] wandb.init called with sweep_config: {} config: {} 2023-07-12 00:03:08,073 INFO MainThread:3148324 [wandb_init.py:init():596] starting backend 2023-07-12 00:03:08,074 INFO MainThread:3148324 [wandb_init.py:init():600] setting up manager 2023-07-12 00:03:08,077 INFO MainThread:3148324 [backend.py:_multiprocessing_setup():106] multiprocessing start_methods=fork,spawn,forkserver, using: spawn 2023-07-12 00:03:08,082 INFO MainThread:3148324 [wandb_init.py:init():606] backend started and connected 2023-07-12 00:03:08,086 INFO MainThread:3148324 [wandb_init.py:init():703] updated telemetry 2023-07-12 00:03:08,088 INFO MainThread:3148324 [wandb_init.py:init():736] communicating run to backend with 60.0 second timeout 2023-07-12 00:03:08,333 INFO MainThread:3148324 [wandb_run.py:_on_init():2176] communicating current version 2023-07-12 00:03:08,418 INFO MainThread:3148324 [wandb_run.py:_on_init():2185] got version response upgrade_message: "wandb version 0.15.5 is available! To upgrade, please run:\n $ pip install wandb --upgrade" 2023-07-12 00:03:08,418 INFO MainThread:3148324 [wandb_init.py:init():787] starting run threads in backend 2023-07-12 00:03:08,546 INFO MainThread:3148324 [wandb_run.py:_console_start():2155] atexit reg 2023-07-12 00:03:08,547 INFO MainThread:3148324 [wandb_run.py:_redirect():2010] redirect: SettingsConsole.WRAP_RAW 2023-07-12 00:03:08,547 INFO MainThread:3148324 [wandb_run.py:_redirect():2075] Wrapping output streams. 2023-07-12 00:03:08,547 INFO MainThread:3148324 [wandb_run.py:_redirect():2100] Redirects installed. 2023-07-12 00:03:08,548 INFO MainThread:3148324 [wandb_init.py:init():828] run started, returning control to user process