---
license: apache-2.0
pipeline_tag: text-to-video
---
# ID-Animator

This repository is the official checkpoint of [ID-Animator](https://id-animator.github.io/).
It is a Zero-shot ID-Preserving Human Video Generation framework. It can generate high-quality ID-specific human video with only one ID image as reference.


**[ID-Animator: Zero-Shot Identity-Preserving Human Video Generation](https://id-animator.github.io/)** 
</br>
[Xuanhua He](https://scholar.google.com/citations?user=-bDAN2YAAAAJ&hl=en&oi=ao),
[Quande Liu*](https://liuquande.github.io/),
[Shengju Qian](https://scholar.google.com/citations?user=QNnWmasAAAAJ&hl=zh-CN),
Xin Wang,
Tao Hu,
[Ke Cao](https://scholar.google.com/citations?user=3qMrWmgAAAAJ&hl=en&oi=ao),
Keyu Yan,
Jie Zhang*
(*Corresponding Author)

[![arXiv](https://img.shields.io/badge/arXiv-2404.15275-b31b1b.svg)](https://arxiv.org/abs/2404.15275)
[![Project Page](https://img.shields.io/badge/Project-Website-green)](https://id-animator.github.io/)
[![Online Demo](https://img.shields.io/badge/%F0%9F%A4%97online%20demo-yellow)](https://huggingface.co/spaces/ID-Animator/ID-Animator)

## Human Video Generation Demos
### Recontextualization
<table class="center">
    <tr style="line-height: 0">
    <td width=25% style="border: none; text-align: center">Reference Image</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    </tr>
    <tr>
    <td width=25% style="border: none"><img src="./__assets__/ref/lecun1.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/first_part/lecun/2.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/first_part/lecun/3.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/first_part/lecun/4.gif" style="width:100%"></td>
    </tr>
</table>
<table class="center">
    <tr style="line-height: 0">
    <td width=25% style="border: none; text-align: center">Reference Image</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    </tr>
    <tr>
    <td width=25% style="border: none"><img src="./__assets__/ref/fbb.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/first_part/ann/1.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/first_part/ann/4.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/first_part/ann/6.gif" style="width:100%"></td>
    </tr>
</table>

### Inference with Community Models
<table class="center">
    <tr style="line-height: 0">
    <td width=25% style="border: none; text-align: center">Reference Image</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    </tr>
    <tr>
    <td width=25% style="border: none"><img src="./__assets__/ref/hinton.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/second/hinton/2.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/second/hinton/3.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/second/hinton/6.gif" style="width:100%"></td>
    </tr>
</table>
<table class="center">
    <tr style="line-height: 0">
    <td width=25% style="border: none; text-align: center">Reference Image</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    </tr>
    <tr>
    <td width=25% style="border: none"><img src="./__assets__/ref/taylor.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/second/taylor/4.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/second/taylor/5.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/second/taylor/6.gif" style="width:100%"></td>
    </tr>
</table>

### Identity Mixing
<table class="center">
    <tr style="line-height: 0">
    <td width=25% style="border: none; text-align: center">Reference Image 1</td>
    <td width=25% style="border: none; text-align: center">Reference Image 2</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    </tr>
    <tr>
    <td width=25% style="border: none"><img src="./__assets__/ref/cl.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/ref/sms.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/third/1/1.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/third/1/6.gif" style="width:100%"></td>
    </tr>
</table>
<table class="center">
    <tr style="line-height: 0">
    <td width=25% style="border: none; text-align: center">Reference Image 1</td>
    <td width=25% style="border: none; text-align: center">Reference Image 2</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    </tr>
    <tr>
    <td width=25% style="border: none"><img src="./__assets__/ref/sansa.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/ref/musk.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/third/2/2.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/third/2/6.gif" style="width:100%"></td>
    </tr>
</table>

### Combination with ControlNet
<table class="center">
    <tr style="line-height: 0">
    <td width=25% style="border: none; text-align: center">Reference Image</td>
    <td width=25% style="border: none; text-align: center">Sketch Image</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    </tr>
    <tr>
    <td width=25% style="border: none"><img src="./__assets__/ref/fbb.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/ref/sketch.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/fourth/1.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/fourth/2.gif" style="width:100%"></td>
    </tr>
</table>
<table class="center">
    <tr style="line-height: 0">
    <td width=25% style="border: none; text-align: center">Reference Image</td>
    <td width=25% style="border: none; text-align: center">Sketch Sequence</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    <td width=25% style="border: none; text-align: center">Output Video</td>
    </tr>
    <tr>
    <td width=25% style="border: none"><img src="./__assets__/ref/fbb.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/ref/sketch_sequence.png" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/fourth/3.gif" style="width:100%"></td>
    <td width=25% style="border: none"><img src="./__assets__/fourth/4.gif" style="width:100%"></td>
    </tr>
</table>

## Contact Us

**Xuanhua He**: hexuanhua@mail.ustc.edu.cn

**Quande Liu**: qdliu0226@gmail.com

**Shengju Qian**: thesouthfrog@gmail.com