Edit model card

Magic Clothing

This repository is the official implementation of Magic Clothing

Magic Clothing is a branch version of OOTDiffusion, focusing on controllable garment-driven image synthesis

Magic Clothing: Controllable Garment-Driven Image Synthesis [arXiv paper]
Weifeng Chen*, Tao Gu*, Yuhao Xu, Chengcai Chen
* Equal contribution
Xiao-i Research


πŸ”₯ [2024/4/19] An 1024 version trained on both VTON-HD and DressCode for early access branch is avaliable now!

πŸ”₯ [2024/4/19] We support AnimateDiff now for generating GIF!

πŸ”₯ [2024/4/16] Our paper is available now!

πŸ”₯ [2024/3/8] We released the model weights trained on the 768 resolution. The strength of clothing and text prompts can be independently adjusted.

πŸ€— Hugging Face link

πŸ”₯ [2024/2/28] We support IP-Adapter-FaceID with ControlNet-Openpose! A portrait and a reference pose image can be used as additional conditions.

Have fun with gradio_ipadapter_openpose.py

πŸ”₯ [2024/2/23] We support IP-Adapter-FaceID now! A portrait image can be used as an additional condition.

Have fun with gradio_ipadapter_faceid.py



  1. Clone the repository
git clone https://github.com/ShineChen1024/MagicClothing.git
  1. Create a conda environment and install the required packages
conda create -n magicloth python==3.10
conda activate magicloth
pip install torch==2.0.1 torchvision==0.15.2 numpy==1.25.1 diffusers==0.25.1 opencv-python==  transformers==4.31.0 gradio==4.16.0 safetensors==0.3.1 controlnet-aux==0.0.6 accelerate==0.21.0


  1. Python demo

512 weights

python inference.py --cloth_path [your cloth path] --model_path [your model checkpoints path]

768 weights

python inference.py --cloth_path [your cloth path] --model_path [your model checkpoints path] --enable_cloth_guidance
  1. Gradio demo

512 weights

python gradio_generate.py --model_path [your model checkpoints path] 

768 weights

python gradio_generate.py --model_path [your model checkpoints path] --enable_cloth_guidance


  title={Magic Clothing: Controllable Garment-Driven Image Synthesis},
  author={Chen, Weifeng and Gu, Tao and Xu, Yuhao and Chen, Chengcai},
  journal={arXiv preprint arXiv:2404.09512},


  • Paper
  • Gradio demo
  • Inference code
  • Model weights
  • Training code
Downloads last month


Downloads are not tracked for this model. How to track
Unable to determine this model's library. Check the docs .