|
--- |
|
license: creativeml-openrail-m |
|
tags: |
|
- keras |
|
- diffusers |
|
- stable-diffusion |
|
- text-to-image |
|
- diffusion-models-class |
|
- dreambooth-hackathon |
|
- nature |
|
inference: true |
|
widget: |
|
- text: a photo of puggieace dog on the beach, sunset in background |
|
--- |
|
|
|
# KerasCV Stable Diffusion in Diffusers 🧨🤗 |
|
|
|
DreamBooth model for the `puggieace` concept trained by nielsgl on the `nielsgl/dreambooth-ace` dataset. |
|
It can be used by modifying the `instance_prompt`: **a photo of puggieace dog** |
|
|
|
## Description |
|
|
|
The pipeline contained in this repository was created using a modified version of [this Space](https://huggingface.co/spaces/sayakpaul/convert-kerascv-sd-diffusers) for StableDiffusionV2 from KerasCV. The purpose is to convert the KerasCV Stable Diffusion weights in a way that is compatible with [Diffusers](https://github.com/huggingface/diffusers). This allows users to fine-tune using KerasCV and use the fine-tuned weights in Diffusers taking advantage of its nifty features (like [schedulers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/schedulers), [fast attention](https://huggingface.co/docs/diffusers/optimization/fp16), etc.). |
|
This model was created as part of the Keras DreamBooth Sprint 🔥. Visit the [organisation page](https://huggingface.co/keras-dreambooth) for instructions on how to take part! |
|
|
|
## Examples |
|
|
|
> Portrait painting of a cute puggieace dog as a samurai |
|
|
|
![Portrait painting of a cute puggieace dog as a samurai, ultra realistic, concept art, intricate details, eerie, highly detailed, photorealistic, octane render, 8 k, unreal engine. art by artgerm and greg rutkowski and charlie bowater and magali villeneuve and alphonse mucha](examples/samurai-2.1.jpg) |
|
|
|
> Photo of cute puggieace dog as an astronaut, space and planet in background |
|
|
|
![Photo of cute puggieace dog as an astronaut, space and planet in background, ultra realistic, concept art, intricate details, highly detailed, photorealistic, octane render, 8 k, unreal engine. art by artgerm and greg rutkowski and charlie bowater, trending on artstation](examples/astronaut-2.1.jpg) |
|
|
|
> A photo of a cute puggieace dog getting a haircut in a barbershop |
|
|
|
![A photo of a cute puggieace dog getting a haircut in a barbershop, ultra realistic, intricate details, highly detailed, photorealistic, octane render, 8 k, unreal engine. art by artgerm and greg rutkowski and charlie bowater and magali villeneuve and alphonse mucha](examples/haircut-2.1.jpg) |
|
|
|
> Portrait photo of puggieace dog in New York |
|
|
|
![Portrait photo of puggieace dog in New York, city and skyscrapers in background, highly detailed, photorealistic, hdr, 4k](examples/ny-2.1.jpg) |
|
|
|
> Portrait of puggieace dog as a Roman Emperor, city in background |
|
|
|
![Portrait of puggieace dog as a Roman Emperor, city in background, ultra realistic, intricate details, eerie, highly detailed, photorealistic, octane render, 8 k, unreal engine. art by artgerm and greg rutkowski and charlie bowater and magali villeneuve and alphonse mucha](examples/emperor-2.1.jpg) |
|
|
|
|
|
## Usage |
|
|
|
```python |
|
from diffusers import StableDiffusionPipeline |
|
|
|
pipeline = StableDiffusionPipeline.from_pretrained('nielsgl/dreambooth-keras-pug-ace-sd2.1') |
|
image = pipeline().images[0] |
|
image |
|
``` |
|
|