File size: 1,410 Bytes
e941a99
 
 
 
 
 
 
 
 
 
a3ee6a0
 
c2d88a5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
65be3a4
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
---
pipeline_tag: text-to-image
tags:
- LoRA
- stable-diffusion
- diffusers
- stable-diffusion-diffusers
---

# Totoro LoRA text2image fine-tuning
These are LoRA adaption weights for nitrosocke/Ghibli-Diffusion.

```python
pipe = StableDiffusionPipeline.from_pretrained(
  model_id,
  torch_dtype=torch.float16,
  safety_checker=None,
)
pipe.enable_xformers_memory_efficient_attention()
pipe.load_lora_weights(./lora_weights)
pipe = pipe.to('cuda')

image = pipe(
  prompt='Totoro',
  num_inference_steps=66,
  guidance_scale=6.9,
  cross_attention_kwargs={'scale': 0.6 },
).images[0]
```

![image1](./1de49996ce1f160a03e6f56db21b2fb11f38dbe9a867b04175e3145614ea7328.png)
![image2](./2b475450b9a5eee5338f2a867186a58fcdd191945d9c3c1cb9f4bfc8f932df20.png)
![image3](./3f5b7cb8c1aa4366cd152fdfedf8beb8e7bc09057e29b1497dc87e8bb038136f.png)
![image4](./4e2e852fda02e5790ec4e24d186b28d14a0a290d0b4968353beec407d455b5b2.png)
![image5](./567106c4dadf172faea14a1f41a65a876aea6920ecd42e022df44f33cccca32a.png)
![image6](./585044f0d451f3049c2b057012426492774bc3b4df96c850a16b1d6ca778a9fa.png)
![image7](./9707575780dbf1a94e5deae10e76ecb9ef8c97426e6c7d320bfe28751ec460c2.png)
![image8](./c645a8679850a7a302f6360d065341ba0617aa5b5a80aecc16666f7555db46c2.png)
![image9](./d480ca9f0e44771111d62a3a0664ad6bf0a2f1ad03b739055e59bee30439cf1b.png)
![image10](./ec7c5b63c53c7e33c9eb51ccfeb0c70b14f5a05d63a85d213bd8efc84fc7ee67.png)