--- pipeline_tag: text-to-image tags: - LoRA - stable-diffusion - diffusers - stable-diffusion-diffusers --- # Totoro LoRA text2image fine-tuning These are LoRA adaption weights for nitrosocke/Ghibli-Diffusion. ```python pipe = StableDiffusionPipeline.from_pretrained( model_id, torch_dtype=torch.float16, safety_checker=None, ) pipe.enable_xformers_memory_efficient_attention() pipe.load_lora_weights(./lora_weights) pipe = pipe.to('cuda') image = pipe( prompt='Totoro', num_inference_steps=66, guidance_scale=6.9, cross_attention_kwargs={'scale': 0.6 }, ).images[0] ``` ![image1](./1de49996ce1f160a03e6f56db21b2fb11f38dbe9a867b04175e3145614ea7328.png) ![image2](./2b475450b9a5eee5338f2a867186a58fcdd191945d9c3c1cb9f4bfc8f932df20.png) ![image3](./3f5b7cb8c1aa4366cd152fdfedf8beb8e7bc09057e29b1497dc87e8bb038136f.png) ![image4](./4e2e852fda02e5790ec4e24d186b28d14a0a290d0b4968353beec407d455b5b2.png) ![image5](./567106c4dadf172faea14a1f41a65a876aea6920ecd42e022df44f33cccca32a.png) ![image6](./585044f0d451f3049c2b057012426492774bc3b4df96c850a16b1d6ca778a9fa.png) ![image7](./9707575780dbf1a94e5deae10e76ecb9ef8c97426e6c7d320bfe28751ec460c2.png) ![image8](./c645a8679850a7a302f6360d065341ba0617aa5b5a80aecc16666f7555db46c2.png) ![image9](./d480ca9f0e44771111d62a3a0664ad6bf0a2f1ad03b739055e59bee30439cf1b.png) ![image10](./ec7c5b63c53c7e33c9eb51ccfeb0c70b14f5a05d63a85d213bd8efc84fc7ee67.png)