Spaces:
Runtime error
Runtime error
File size: 1,953 Bytes
e08094e a08b48c e08094e a637d5e e08094e a637d5e e08094e a637d5e e08094e a08b48c a637d5e a08b48c a637d5e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 |
---
title: ControlnetOverMask
emoji: 🌖
colorFrom: gray
colorTo: blue
sdk: gradio
sdk_version: 3.28.2
app_file: app.py
pinned: false
license: mit
tags:
- jax-diffusers-event
---
# ControlnetOverMask
### Controlnet
### Inpainting
### Stable diffusion
Use controlnet to generate sketches and characters, and keep the background unchanged.
Usually when we generate a very perfect background image, we want to add image elements, but using controlnet directly will affect the original background. This project aims to add elements to the page while keeping the background unchanged, and can directly operate on the original background.
Support skeletal character generation and sketch generation.
Optimize an inpaint model for the general domain against the stablediffusion-inpaint model.
models already upload huggingface model space.
- hirol/Any-inpainting
- hirol/control_any5_openpose
### Two modes, openpose control and manuscript control
#### openpose control
Add character skeletons to a forest scene generated by SD, and keep the background unchanged to generate controllable characters
<img src="https://huggingface.co/spaces/hirol/ControlnetWithBackground/resolve/main/person.png" width="400" height="300">
<video width="320" height="240" controls>
<source src="https://huggingface.co/spaces/hirol/ControlnetWithBackground/resolve/main/person_control.mp4" type="video/mp4">
</video>
#### manuscript control
Added manuscript houses to an SD generated forest scene
<img src="https://huggingface.co/spaces/hirol/ControlnetWithBackground/resolve/main/house.png" width="600" height="300">
<video width="320" height="240" controls>
<source src="https://huggingface.co/spaces/hirol/ControlnetWithBackground/resolve/main/house.mp4" type="video/mp4">
</video>
Added manuscript chairs to an SD generated snow scene
<img src="https://huggingface.co/spaces/hirol/ControlnetWithBackground/resolve/main/chair.png" width="600" height="300">
|