Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ Terminal Technology Department, Alipay, Ant Group.
|
|
16 |
<a href='https://antgroup.github.io/ai/echomimic_v2/'><img src='https://img.shields.io/badge/Project-Page-blue'></a>
|
17 |
<a href='https://huggingface.co/BadToBest/EchoMimicV2'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow'></a>
|
18 |
<!--<a href='https://antgroup.github.io/ai/echomimic_v2/'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Demo-yellow'></a>-->
|
19 |
-
<a href='https://
|
20 |
<!--<a href='https://antgroup.github.io/ai/echomimic_v2/'><img src='https://img.shields.io/badge/ModelScope-Demo-purple'></a>-->
|
21 |
<a href='https://arxiv.org/abs/2411.10061'><img src='https://img.shields.io/badge/Paper-Arxiv-red'></a>
|
22 |
<a href='https://github.com/antgroup/echomimic_v2/blob/main/assets/halfbody_demo/wechat_group.png'><img src='https://badges.aleen42.com/src/wechat.svg'></a>
|
@@ -27,6 +27,7 @@ Terminal Technology Department, Alipay, Ant Group.
|
|
27 |
* EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation. [GitHub](https://github.com/antgroup/echomimic_v2)
|
28 |
|
29 |
## 📣 Updates
|
|
|
30 |
* [2024.11.19] π₯ We release the EMTD dataset list and processing scripts.
|
31 |
* [2024.11.19] π₯ We release our [EchoMimicV2](https://github.com/antgroup/echomimic_v2) codes and models.
|
32 |
* [2024.11.15] π₯ Our [paper](https://arxiv.org/abs/2411.10061) is in public on arxiv.
|
@@ -142,7 +143,7 @@ Terminal Technology Department, Alipay, Ant Group.
|
|
142 |
Create conda environment (Recommended):
|
143 |
|
144 |
```bash
|
145 |
-
conda create -n echomimic python=3.
|
146 |
conda activate echomimic
|
147 |
```
|
148 |
|
@@ -180,7 +181,7 @@ The **pretrained_weights** is organized as follows.
|
|
180 |
βββ whisper_tiny.pt
|
181 |
```
|
182 |
|
183 |
-
In which **denoising_unet.pth** / **reference_unet.pth** / **motion_module.pth** / **
|
184 |
- [sd-vae-ft-mse](https://huggingface.co/stabilityai/sd-vae-ft-mse)
|
185 |
- [sd-image-variations-diffusers](https://huggingface.co/lambdalabs/sd-image-variations-diffusers)
|
186 |
- [audio_processor(whisper)](https://openaipublic.azureedge.net/main/whisper/models/65147644a518d12f04e32d6f3b26facc3f8dd46e5390956a9424a650c0ce22b9/tiny.pt)
|
|
|
16 |
<a href='https://antgroup.github.io/ai/echomimic_v2/'><img src='https://img.shields.io/badge/Project-Page-blue'></a>
|
17 |
<a href='https://huggingface.co/BadToBest/EchoMimicV2'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow'></a>
|
18 |
<!--<a href='https://antgroup.github.io/ai/echomimic_v2/'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Demo-yellow'></a>-->
|
19 |
+
<a href='https://modelscope.cn/models/BadToBest/EchoMimicV2'><img src='https://img.shields.io/badge/ModelScope-Model-purple'></a>
|
20 |
<!--<a href='https://antgroup.github.io/ai/echomimic_v2/'><img src='https://img.shields.io/badge/ModelScope-Demo-purple'></a>-->
|
21 |
<a href='https://arxiv.org/abs/2411.10061'><img src='https://img.shields.io/badge/Paper-Arxiv-red'></a>
|
22 |
<a href='https://github.com/antgroup/echomimic_v2/blob/main/assets/halfbody_demo/wechat_group.png'><img src='https://badges.aleen42.com/src/wechat.svg'></a>
|
|
|
27 |
* EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation. [GitHub](https://github.com/antgroup/echomimic_v2)
|
28 |
|
29 |
## 📣 Updates
|
30 |
+
* [2024.11.22] π₯ [ComfyUI](https://github.com/smthemex/ComfyUI_EchoMimic) is now available. Thanks @smthemex for the contribution.
|
31 |
* [2024.11.19] π₯ We release the EMTD dataset list and processing scripts.
|
32 |
* [2024.11.19] π₯ We release our [EchoMimicV2](https://github.com/antgroup/echomimic_v2) codes and models.
|
33 |
* [2024.11.15] π₯ Our [paper](https://arxiv.org/abs/2411.10061) is in public on arxiv.
|
|
|
143 |
Create conda environment (Recommended):
|
144 |
|
145 |
```bash
|
146 |
+
conda create -n echomimic python=3.10
|
147 |
conda activate echomimic
|
148 |
```
|
149 |
|
|
|
181 |
βββ whisper_tiny.pt
|
182 |
```
|
183 |
|
184 |
+
In which **denoising_unet.pth** / **reference_unet.pth** / **motion_module.pth** / **pose_encoder.pth** are the main checkpoints of **EchoMimic**. Other models in this hub can be also downloaded from it's original hub, thanks to their brilliant works:
|
185 |
- [sd-vae-ft-mse](https://huggingface.co/stabilityai/sd-vae-ft-mse)
|
186 |
- [sd-image-variations-diffusers](https://huggingface.co/lambdalabs/sd-image-variations-diffusers)
|
187 |
- [audio_processor(whisper)](https://openaipublic.azureedge.net/main/whisper/models/65147644a518d12f04e32d6f3b26facc3f8dd46e5390956a9424a650c0ce22b9/tiny.pt)
|