SDXL LoRA DreamBooth - whatsupmate/ytzhakov_LoRA

Model description

These are whatsupmate/ytzhakov_LoRA LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.

The weights were trained using DreamBooth.

LoRA for the text encoder was enabled: False.

Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.

Trigger words

You should use a photo of ytzhakov person to trigger the image generation.

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.

Intended uses & limitations

How to use

# TODO: add an example code snippet for running this diffusion pipeline

Limitations and bias

[TODO: provide examples of latent issues and potential remediations]

Training details

!accelerate launch train_dreambooth_lora_sdxl.py
--pretrained_model_name_or_path="stabilityai/stable-diffusion-xl-base-1.0"
--pretrained_vae_model_name_or_path="madebyollin/sdxl-vae-fp16-fix"
--dataset_name="ytzhakov"
--output_dir="ytzhakov_LoRA"
--caption_column="prompt"
--mixed_precision="fp16"
--instance_prompt="a photo of ytzhakov person"
--resolution=512
--train_batch_size=1
--gradient_accumulation_steps=2
--gradient_checkpointing
--learning_rate=5e-5
--snr_gamma=5.0
--lr_scheduler="cosine"
--lr_warmup_steps=0
--use_8bit_adam
--max_train_steps=3000
--checkpointing_steps=1000
--seed="0"
--rank=128
--train_text_encoder
--prior_loss_weight=0.5