lora training?

#5
by CappyAdams - opened

are there any scripts or anything for training loras for this model? it looks pretty good so far!

Yeah Lora training will very good...

Yeah Lora training will very good...

yo I did a bit of digging, I found this fork of SD-Scripts on the trainer's github.

https://github.com/GumGum10/sd-scripts

Lemmie know if you got it to work, cuz at the time of writing I'm having a bit of an issue (prob cuz my dumbass bought an amd gpu haha)

Get an Error

File "/content/sd-scripts/anima_38b_train_network.py", line 283, in
Anima38BNetworkTrainer().train(args)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
File "/content/sd-scripts/train_network.py", line 1046, in train
unet, text_encoders = self.load_unet_lazily(args, weight_dtype, accelerator, text_encoders)
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/content/sd-scripts/anima_38b_train_network.py", line 86, in load_unet_lazily
model, text_encoders = super().load_unet_lazily(
~~~~~~~~~~~~~~~~~~~~~~~~^
args, weight_dtype, accelerator, text_encoders
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/content/sd-scripts/anima_train_network.py", line 127, in load_unet_lazily
model = anima_utils.load_anima_model(
accelerator.device,
...<5 lines>...
args.fp8_scaled,
)
File "/content/sd-scripts/library/anima_utils.py", line 172, in load_anima_model
raise RuntimeError(f"Unexpected keys in checkpoint: {unexpected[:5]}{'...' if len(unexpected) > 5 else ''}")
RuntimeError: Unexpected keys in checkpoint: ['anima_v2_connector.quality_anchor.layer_mix_logits', 'anima_v2_connector.quality_anchor.query_norms.0.weight', 'anima_v2_connector.quality_anchor.query_norms.1.weight', 'anima_v2_connector.quality_anchor.query_norms.2.weight', 'anima_v2_connector.quality_anchor.query_norms.3.weight']...
Traceback (most recent call last):
File "/usr/local/bin/accelerate", line 8, in
sys.exit(main())
~~~~^^
File "/usr/local/lib/python3.13/dist-packages/accelerate/commands/accelerate_cli.py", line 50, in main
args.func(args)
~~~~~~~~~^^^^^^
File "/usr/local/lib/python3.13/dist-packages/accelerate/commands/launch.py", line 1213, in launch_command
simple_launcher(args)
~~~~~~~~~~~~~~~^^^^^^
File "/usr/local/lib/python3.13/dist-packages/accelerate/commands/launch.py", line 795, in simple_launcher
raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)

Sign up or log in to comment