tushaar21 commited on
Commit
43f0d9e
1 Parent(s): 416e264

Training complete

Browse files
README.md ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - stable-diffusion-xl
4
+ - stable-diffusion-xl-diffusers
5
+ - text-to-image
6
+ - diffusers
7
+ - lora
8
+ - template:sd-lora
9
+ widget:
10
+
11
+ - text: 'a advertising photo of the TOK bottle'
12
+
13
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
14
+ instance_prompt: a advertising photo of the TOK bottle
15
+ license: openrail++
16
+ ---
17
+
18
+ # SDXL LoRA DreamBooth - tushaar21/sdxl_lora_adam_1e-4_500_rank6
19
+
20
+ <Gallery />
21
+
22
+ ## Model description
23
+
24
+ ### These are tushaar21/sdxl_lora_adam_1e-4_500_rank6 LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
25
+
26
+ ## Download model
27
+
28
+ ### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
29
+
30
+ - **LoRA**: download **[`sdxl_lora_adam_1e-4_500_rank6.safetensors` here 💾](/tushaar21/sdxl_lora_adam_1e-4_500_rank6/blob/main/sdxl_lora_adam_1e-4_500_rank6.safetensors)**.
31
+ - Place it on your `models/Lora` folder.
32
+ - On AUTOMATIC1111, load the LoRA by adding `<lora:sdxl_lora_adam_1e-4_500_rank6:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
33
+
34
+
35
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
36
+
37
+ ```py
38
+ from diffusers import AutoPipelineForText2Image
39
+ import torch
40
+
41
+ pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
42
+ pipeline.load_lora_weights('tushaar21/sdxl_lora_adam_1e-4_500_rank6', weight_name='pytorch_lora_weights.safetensors')
43
+
44
+ image = pipeline('a advertising photo of the TOK bottle').images[0]
45
+ ```
46
+
47
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
48
+
49
+ ## Trigger words
50
+
51
+ You should use a advertising photo of the TOK bottle to trigger the image generation.
52
+
53
+ ## Details
54
+ All [Files & versions](/tushaar21/sdxl_lora_adam_1e-4_500_rank6/tree/main).
55
+
56
+ The weights were trained using [🧨 diffusers Advanced Dreambooth Training Script](https://github.com/huggingface/diffusers/blob/main/examples/advanced_diffusion_training/train_dreambooth_lora_sdxl_advanced.py).
57
+
58
+ LoRA for the text encoder was enabled. False.
59
+
60
+ Pivotal tuning was enabled: False.
61
+
62
+ Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
63
+
logs/dreambooth-lora-sd-xl/1708813667.3597455/events.out.tfevents.1708813667.c4cb4cdd130d.299.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2ba6eb6012e2d4d799f4673c5b456837cc4991a4624142544fa1082d2128db9
3
+ size 3613
logs/dreambooth-lora-sd-xl/1708813667.3645988/hparams.yml ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.99
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: null
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 700
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: /kaggle/input/sdxl-bottle/training4
18
+ enable_xformers_memory_efficient_attention: false
19
+ gradient_accumulation_steps: 4
20
+ gradient_checkpointing: true
21
+ hub_model_id: null
22
+ hub_token: null
23
+ image_column: image
24
+ instance_data_dir: null
25
+ instance_prompt: a advertising photoshoot of the <s0><s1> on a stylish white background
26
+ with <s0><s1> flowers around it
27
+ learning_rate: 0.0001
28
+ local_rank: 0
29
+ logging_dir: logs
30
+ lr_num_cycles: 1
31
+ lr_power: 1.0
32
+ lr_scheduler: constant
33
+ lr_warmup_steps: 0
34
+ max_grad_norm: 1.0
35
+ max_train_steps: 500
36
+ mixed_precision: fp16
37
+ noise_offset: 0
38
+ num_class_images: 100
39
+ num_new_tokens_per_abstraction: 2
40
+ num_train_epochs: 42
41
+ num_validation_images: 4
42
+ optimizer: AdamW
43
+ output_dir: sdxl_lora_adam_1e-4_500_rank6
44
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
45
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
46
+ prior_generation_precision: null
47
+ prior_loss_weight: 1.0
48
+ prodigy_beta3: null
49
+ prodigy_decouple: true
50
+ prodigy_safeguard_warmup: true
51
+ prodigy_use_bias_correction: true
52
+ push_to_hub: false
53
+ random_flip: false
54
+ rank: 6
55
+ repeats: 2
56
+ report_to: tensorboard
57
+ resolution: 1024
58
+ resume_from_checkpoint: null
59
+ revision: null
60
+ sample_batch_size: 4
61
+ scale_lr: false
62
+ seed: 0
63
+ snr_gamma: 5.0
64
+ text_encoder_lr: 5.0e-06
65
+ token_abstraction: TOK
66
+ train_batch_size: 1
67
+ train_text_encoder: false
68
+ train_text_encoder_frac: 1.0
69
+ train_text_encoder_ti: true
70
+ train_text_encoder_ti_frac: 0.5
71
+ use_8bit_adam: true
72
+ validation_epochs: 50
73
+ validation_prompt: null
74
+ variant: null
75
+ with_prior_preservation: false
logs/dreambooth-lora-sd-xl/events.out.tfevents.1708813667.c4cb4cdd130d.299.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0e4554efe03b58ff231718c5d92a6b0c765e191a14410bf42ccd1a07ca910ae
3
+ size 167054
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e97abe033b3054b947fc21d41dd4d49b431cf4d509d2a5c7ca8c26689a2e2bcc
3
+ size 35002936
sdxl_lora_adam_1e-4_500_rank6.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf1a89bd3844d00906bd2891aad36f9c889ab8051093aaafa038a2f6eae663c6
3
+ size 35085736
sdxl_lora_adam_1e-4_500_rank6_emb.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2020846fb0796a0421ca64c7bfe0a3edc942a3458c1df85b8c69644aff85fba
3
+ size 16536