---
license: mit
---
<div align="center">

# LaCon: Late-Constraint Diffusion for Steerable Guided Image Synthesis

Chang Liu, Rui Li, Kaidong Zhang, Xin Luo, Dong Liu

[[`Paper`]]((https://arxiv.org/pdf/2305.11520)) / [[`Project`]](https://alonzoleeeooo.github.io/LCDG/) / [[`GitHub`]](https://github.com/AlonzoLeeeooo/LCDG) / [[`ModelScope`]](https://modelscope.cn/models/AlonzoLeeeoooo/LaCon) / [`Demo`]
</div>

Official pre-trained model weights of the paper titled "LaCon: Late-Constraint Diffusion for Steerable Guided Image Synthesis".

# Model Weights Structure
```
LaCon/
└── data-preprocessing
    ├── bdcn.pth                      <----- Model weights of BDCN edge detector (Place in `data-preprocessing/bdcn-edge-detection/checkpoints`)
    ├── vgg16.pth                     <----- Preresquisites of BDCN edge detector (Place in `data-preprocessing/bdcn-edge-detection/checkpoints`)
    └── u2net.pth                     <----- Model weights of U2-Net saliency detector (Place in `data-preprocessing/u2net-saliency-detection/checkpoints`)
└── sd-checkpoints
    ├── sd-v1-4.ckpt                  <----- SD v1.4
    ├── kl-f8.ckpt                    <----- VAE model of SD v1.4
    ├── sd-celebahq.ckpt              <----- SD CelebA-HQ
    └── vq-f4.ckpt                    <----- VAE model of SD CelebA-HQ
├── sdv14_edge.pth                    <----- Condition aligner based on SD v1.4, for edge conditions
├── sdv14_color.pth                   <----- Condition aligner based on SD v1.4, for color conditions
├── sdv14_mask.pth                    <----- Condition aligner based on SD v1.4, for mask conditions
├── sd_celeb_edge.pth                 <----- Condition aligner based on SD CelebA-HQ, for edge conditions
└── sd_celeb_stroke.pth               <----- Condition aligner based on SD CelebA-HQ, for color conditions