Hugging Face's logo

johnowhitaker
/
lora_pn03_036sim

Text-to-Image
Diffusers
stable-diffusion-xl
stable-diffusion-xl-diffusers
lora
Model card Files Community
lora_pn03_036sim
File size: 1,002 Bytes 
c71ca84
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
789d9bd
c71ca84
 
789d9bd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c71ca84
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
 

---
license: creativeml-openrail-m
base_model: playgroundai/playground-v2-1024px-aesthetic
dataset: None
tags:
- stable-diffusion-xl
- stable-diffusion-xl-diffusers
- text-to-image
- diffusers
- lora
inference: true
---
    
# LoRA text2image fine-tuning - johnowhitaker/lora_pn03_036sim

These are LoRA adaption weights for playgroundai/playground-v2-1024px-aesthetic. The weights were fine-tuned on a custom dataset.
![img_0](./image_0.png)
![img_1](./image_1.png)

Usage:
```python
import torch
from diffusers import DiffusionPipeline
device = "cuda:7"
pipe = DiffusionPipeline.from_pretrained(
    'playgroundai/playground-v2-1024px-aesthetic',
    torch_dtype=torch.float16,
    add_watermarker=False,
    variant="fp16"
)
pipe.to(device)
pipe.load_lora_weights('johnowhitaker/lora_pn03_036sim')
pipe("An owl wearing a tophat and tie, studio lighting, black background").images[0]
```


LoRA for the text encoder was enabled: False.

Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.