| style training | |
| Mixer/magnet anon here, I've been doing so many LoRAs for the past week /2 weeks that my eyes hurt, and my SSD space as well. | |
| I found good settings for concepts if you have a 4090/3090/3090Ti (basically 24GB VRAM). | |
| For 150-200 images (I use 20 repeats), or for 800~ images I used 14 repeats average (it was 5 different concept folders): | |
| $learning_rate = 0.0001/1e-4 (or 0.0012/1.2e-3) | |
| $lr_warmup_ratio = 0.05 | |
| $train_batch_size = 12 | |
| $num_epochs = 4 | |
| $save_every_n_epochs=1 | |
| $scheduler="cosine_with_restarts" | |
| $network_dim=176 (or 192) | |
| $text_encoder_lr=1.5e-5 | |
| $unet_lr=0.00015 | |
| You have to be careful to get the concept but not the style, so play with the LR and repeats. | |
| For characters, the settings are similar but: less repeats, netdim at 96-128 and always 1e-4 LR | |
| Also, for concepts I didn't prune tags, but I added a first token to help the LoRA. I felt the resutls were better (but obviously you have to use more prompts), but, better results with promtps>not that good results without prompts. | |
| (For characters I still prune the tags that define it though, it is better in that case) | |
| ------------ | |
| Have I missed any new model that's worth to try to merge/mix and such? | |