README.md

---
license: mit
---
Thanks for Tencent release the controlenet training code, so Just a test version for Hunyuan tile model. More test is on going. join my personal qq group 294060503 for more discussion

Please follow https://github.com/Tencent/HunyuanDiT/blob/main/controlnet/README.md to run the model.

![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/928OhsRzsu7azmoWLGUXx.jpeg)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/641edd91eefe94aff6de024c/yQ9PSkdpP9hss8Y4CXwAO.png)

Inference
You can use the following command line for inference.

a. Using canny ControlNet during inference

python3 sample_controlnet.py  --no-enhance --load-key distill --infer-steps 50 --control-type canny --prompt "在夜晚的酒店门前，一座古老的中国风格的狮子雕像矗立着，它的眼睛闪烁着光芒，仿佛在守护着这座建筑。背景是夜晚的酒店前，构图方式是特写，平视，居中构图。这张照片呈现了真实摄影风格，蕴含了中国雕塑文化，同时展现了神秘氛围" --condition-image-path controlnet/asset/input/canny.jpg --control-weight 1.0
b. Using pose ControlNet during inference

python3 sample_controlnet.py  --no-enhance --load-key distill --infer-steps 50 --control-type depth --prompt "在茂密的森林中，一只黑白相间的熊猫静静地坐在绿树红花中，周围是山川和海洋。背景是白天的森林，光线充足" --condition-image-path controlnet/asset/input/depth.jpg --control-weight 1.0
c. Using depth ControlNet during inference

python3 sample_controlnet.py  --no-enhance --load-key distill --infer-steps 50 --control-type pose --prompt "一位亚洲女性，身穿绿色上衣，戴着紫色头巾和紫色围巾，站在黑板前。背景是黑板。照片采用近景、平视和居中构图的方式呈现真实摄影风格" --condition-image-path controlnet/asset/input/pose.jpg --control-weight 1.0

you need to add the tile into the config.json file and place it in the cpkts/t2i/models/controlnet
and rename to pytorch_model_ema.pt