Spaces:
Running
Running
Small style update (for now)
Browse files
README.md
CHANGED
|
@@ -7,14 +7,16 @@ sdk: static
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
# Welcome to the 🧨 `diffusers` organization!
|
|
|
|
| 11 |
`diffusers` is the go-to library for state-of-the-art pretrained diffusion models for multi-modal generative AI.
|
| 12 |
|
| 13 |
[GitHub](https://github.com/huggingface/diffusers), [Docs](https://huggingface.co/docs/diffusers/index)
|
| 14 |
|
| 15 |
-
In this organization, you can find some utilities and models we have made for you 🫶
|
|
|
|
|
|
|
| 16 |
|
| 17 |
-
## 🆕 SDXL ControlNets
|
| 18 |
We are training ControlNets for Stable Diffusion XL ✨
|
| 19 |
|
| 20 |
### Small sized ControlNets 🤏
|
|
@@ -22,26 +24,27 @@ We are training ControlNets for Stable Diffusion XL ✨
|
|
| 22 |
We are experimenting with training smaller ControlNets that can still retain their control capabilities! This is the [training script used](https://github.com/huggingface/diffusers/blob/7b93c2a882d8e12209fbaeffa51ee2b599ab5349/examples/research_projects/controlnet/train_controlnet_webdataset.py).
|
| 23 |
Please check the models released, and consider giving us feedback on our [Discord server](https://t.co/1n75wi976V?amp=1):
|
| 24 |
|
| 25 |
-
| ControlNet
|
| 26 |
-
|
| 27 |
-
| [`controlnet-canny-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-small) | 320MB
|
| 28 |
-
| [`controlnet-canny-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-mid)
|
| 29 |
-
| [`controlnet-depth-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-small) | 320MB
|
| 30 |
-
| [`controlnet-depth-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-mid)
|
| 31 |
|
| 32 |
### Full sized ControlNets 💪
|
| 33 |
|
| 34 |
The team has also trained full sized ControlNets - as big as the SDXL model (5GB in fp32). We have provided a [ControlNet training script and guide here](https://github.com/huggingface/diffusers/blob/main/examples/controlnet/README_sdxl.md)
|
| 35 |
|
| 36 |
-
| ControlNet
|
| 37 |
-
|
| 38 |
-
| [`controlnet-canny-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0)
|
| 39 |
-
| [`controlnet-depth-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0)
|
| 40 |
| [`controlnet-zoe-depth-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-zoe-depth-sdxl-1.0) |
|
| 41 |
|
| 42 |
### Utilities 🔧
|
|
|
|
| 43 |
- [Convert Stable Diffusion XL weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sdxl-to-diffusers)
|
| 44 |
- [Convert Stable Diffusion weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sd-to-diffusers)
|
| 45 |
- [Convert diffusers models to `safetensors` format](https://huggingface.co/spaces/diffusers/convert)
|
| 46 |
|
| 47 |
-
More coming soon ✨
|
|
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# Welcome to the 🧨 `diffusers` organization!
|
| 11 |
+
|
| 12 |
`diffusers` is the go-to library for state-of-the-art pretrained diffusion models for multi-modal generative AI.
|
| 13 |
|
| 14 |
[GitHub](https://github.com/huggingface/diffusers), [Docs](https://huggingface.co/docs/diffusers/index)
|
| 15 |
|
| 16 |
+
In this organization, you can find some utilities and models we have made for you 🫶
|
| 17 |
+
|
| 18 |
+
## 🆕 SDXL ControlNets
|
| 19 |
|
|
|
|
| 20 |
We are training ControlNets for Stable Diffusion XL ✨
|
| 21 |
|
| 22 |
### Small sized ControlNets 🤏
|
|
|
|
| 24 |
We are experimenting with training smaller ControlNets that can still retain their control capabilities! This is the [training script used](https://github.com/huggingface/diffusers/blob/7b93c2a882d8e12209fbaeffa51ee2b599ab5349/examples/research_projects/controlnet/train_controlnet_webdataset.py).
|
| 25 |
Please check the models released, and consider giving us feedback on our [Discord server](https://t.co/1n75wi976V?amp=1):
|
| 26 |
|
| 27 |
+
| ControlNet | Size in fp16 |
|
| 28 |
+
| ----------------------------------------------------------------------------------------------------- | ------------ |
|
| 29 |
+
| [`controlnet-canny-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-small) | 320MB |
|
| 30 |
+
| [`controlnet-canny-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-mid) | 545MB |
|
| 31 |
+
| [`controlnet-depth-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-small) | 320MB |
|
| 32 |
+
| [`controlnet-depth-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-mid) | 545MB |
|
| 33 |
|
| 34 |
### Full sized ControlNets 💪
|
| 35 |
|
| 36 |
The team has also trained full sized ControlNets - as big as the SDXL model (5GB in fp32). We have provided a [ControlNet training script and guide here](https://github.com/huggingface/diffusers/blob/main/examples/controlnet/README_sdxl.md)
|
| 37 |
|
| 38 |
+
| ControlNet |
|
| 39 |
+
| ------------------------------------------------------------------------------------------------- |
|
| 40 |
+
| [`controlnet-canny-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0) |
|
| 41 |
+
| [`controlnet-depth-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0) |
|
| 42 |
| [`controlnet-zoe-depth-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-zoe-depth-sdxl-1.0) |
|
| 43 |
|
| 44 |
### Utilities 🔧
|
| 45 |
+
|
| 46 |
- [Convert Stable Diffusion XL weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sdxl-to-diffusers)
|
| 47 |
- [Convert Stable Diffusion weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sd-to-diffusers)
|
| 48 |
- [Convert diffusers models to `safetensors` format](https://huggingface.co/spaces/diffusers/convert)
|
| 49 |
|
| 50 |
+
More coming soon ✨
|