logs/20231117085552/wandb/debug.log

2023-11-17 08:56:56,509 INFO    MainThread:11532 [wandb_setup.py:_flush():76] Current SDK version is 0.15.7
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_setup.py:_flush():76] Configure stats pid to 11532
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_setup.py:_flush():76] Loading settings from /root/.config/wandb/settings
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_setup.py:_flush():76] Loading settings from /content/kohya-trainer/wandb/settings
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_setup.py:_flush():76] Loading settings from environment variables: {'root_dir': '/content/LoRA/logs/20231117085552'}
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'sdxl_train_network.py', 'program': '/content/kohya-trainer/sdxl_train_network.py'}
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_setup.py:_flush():76] Applying login settings: {'api_key': '***REDACTED***'}
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_setup.py:_flush():76] Applying login settings: {'api_key': '***REDACTED***'}
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_init.py:_log_setup():507] Logging user logs to /content/LoRA/logs/20231117085552/wandb/run-20231117_085656-hf8ykeyx/logs/debug.log
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_init.py:_log_setup():508] Logging internal logs to /content/LoRA/logs/20231117085552/wandb/run-20231117_085656-hf8ykeyx/logs/debug-internal.log
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_init.py:init():547] calling init triggers
2023-11-17 08:56:56,510 INFO    MainThread:11532 [wandb_init.py:init():554] wandb.init called with sweep_config: {}
config: {}
2023-11-17 08:56:56,511 INFO    MainThread:11532 [wandb_init.py:init():596] starting backend
2023-11-17 08:56:56,511 INFO    MainThread:11532 [wandb_init.py:init():600] setting up manager
2023-11-17 08:56:56,514 INFO    MainThread:11532 [backend.py:_multiprocessing_setup():106] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2023-11-17 08:56:56,520 INFO    MainThread:11532 [wandb_init.py:init():606] backend started and connected
2023-11-17 08:56:56,524 INFO    MainThread:11532 [wandb_init.py:init():697] updated telemetry
2023-11-17 08:56:56,536 INFO    MainThread:11532 [wandb_init.py:init():730] communicating run to backend with 60.0 second timeout
2023-11-17 08:56:56,910 INFO    MainThread:11532 [wandb_run.py:_on_init():2174] communicating current version
2023-11-17 08:56:57,186 INFO    MainThread:11532 [wandb_run.py:_on_init():2183] got version response upgrade_message: "wandb version 0.16.0 is available!  To upgrade, please run:\n $ pip install wandb --upgrade"

2023-11-17 08:56:57,186 INFO    MainThread:11532 [wandb_init.py:init():781] starting run threads in backend
2023-11-17 08:56:57,257 INFO    MainThread:11532 [wandb_run.py:_console_start():2153] atexit reg
2023-11-17 08:56:57,257 INFO    MainThread:11532 [wandb_run.py:_redirect():2008] redirect: wrap_raw
2023-11-17 08:56:57,257 INFO    MainThread:11532 [wandb_run.py:_redirect():2073] Wrapping output streams.
2023-11-17 08:56:57,257 INFO    MainThread:11532 [wandb_run.py:_redirect():2098] Redirects installed.
2023-11-17 08:56:57,261 INFO    MainThread:11532 [wandb_init.py:init():822] run started, returning control to user process
2023-11-17 10:38:29,956 INFO    MainThread:11532 [wandb_run.py:_finish():1888] finishing run ai-art-indonesia-1/rupid79_xllora_2/hf8ykeyx
2023-11-17 10:38:29,956 INFO    MainThread:11532 [wandb_run.py:_atexit_cleanup():2122] got exitcode: 0
2023-11-17 10:38:29,956 INFO    MainThread:11532 [wandb_run.py:_restore():2105] restore
2023-11-17 10:38:29,958 INFO    MainThread:11532 [wandb_run.py:_restore():2111] restore done
2023-11-17 10:38:35,772 INFO    MainThread:11532 [wandb_run.py:_footer_history_summary_info():3475] rendering history
2023-11-17 10:38:35,772 INFO    MainThread:11532 [wandb_run.py:_footer_history_summary_info():3507] rendering summary
2023-11-17 10:38:35,778 INFO    MainThread:11532 [wandb_run.py:_footer_sync_info():3434] logging synced files