Update README.md
Browse files
README.md
CHANGED
|
@@ -2,8 +2,145 @@
|
|
| 2 |
license: mit
|
| 3 |
---
|
| 4 |
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
<
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
license: mit
|
| 3 |
---
|
| 4 |
|
| 5 |
+
# AniGen_Weights
|
| 6 |
+
|
| 7 |
+
Pretrained checkpoints for [AniGen](https://github.com/VAST-AI-Research/AniGen), a unified framework for generating animatable 3D assets from a single image.
|
| 8 |
+
|
| 9 |
+
<p align="center">
|
| 10 |
+
<a href="https://arxiv.org/pdf/2604.08746"><img src="https://img.shields.io/badge/arXiv-Paper-red?logo=arxiv&logoColor=white" alt="arXiv"></a>
|
| 11 |
+
<a href="https://yihua7.github.io/AniGen-web/"><img src="https://img.shields.io/badge/Project_Page-Website-green?logo=googlechrome&logoColor=white" alt="Project Page"></a>
|
| 12 |
+
<a href="https://huggingface.co/spaces/VAST-AI/AniGen"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Live_Demo-blue" alt="Hugging Face Demo"></a>
|
| 13 |
+
<a href="https://github.com/VAST-AI-Research/AniGen"><img src="https://img.shields.io/badge/GitHub-Repository-black?logo=github&logoColor=white" alt="GitHub"></a>
|
| 14 |
+
</p>
|
| 15 |
+
|
| 16 |
+
This repository stores the contents of the `ckpts/` directory used by the AniGen codebase, including:
|
| 17 |
+
|
| 18 |
+
- AniGen stage checkpoints
|
| 19 |
+
- DINOv2 vision encoder weights
|
| 20 |
+
- DSINE normal estimation weights
|
| 21 |
+
- VGG backbone weights
|
| 22 |
+
|
| 23 |
+
## What Is Included
|
| 24 |
+
|
| 25 |
+
The repository is organized exactly like the `ckpts/` folder expected by the main AniGen repo:
|
| 26 |
+
|
| 27 |
+
```text
|
| 28 |
+
ckpts/
|
| 29 |
+
βββ anigen/
|
| 30 |
+
β βββ ss_dae/
|
| 31 |
+
β βββ slat_dae/
|
| 32 |
+
β βββ ss_flow_duet/
|
| 33 |
+
β βββ ss_flow_epic/
|
| 34 |
+
β βββ ss_flow_solo/
|
| 35 |
+
β βββ slat_flow_auto/
|
| 36 |
+
β βββ slat_flow_control/
|
| 37 |
+
β βββ slat_flow_gsn_auto/
|
| 38 |
+
βββ dinov2/
|
| 39 |
+
βββ dsine/
|
| 40 |
+
βββ vgg/
|
| 41 |
+
```
|
| 42 |
+
|
| 43 |
+
Approximate total size: about 23 GB.
|
| 44 |
+
|
| 45 |
+
## Recommended Checkpoints
|
| 46 |
+
|
| 47 |
+
For most users, we recommend:
|
| 48 |
+
|
| 49 |
+
- `ss_flow_duet` for sparse structure generation
|
| 50 |
+
- `slat_flow_auto` for structured latent generation
|
| 51 |
+
|
| 52 |
+
This combination is also the default setup used by the AniGen inference example.
|
| 53 |
+
|
| 54 |
+
## Checkpoint Overview
|
| 55 |
+
|
| 56 |
+
### Core AniGen checkpoints
|
| 57 |
+
|
| 58 |
+
| Folder | Purpose |
|
| 59 |
+
| --- | --- |
|
| 60 |
+
| `ckpts/anigen/ss_dae` | Sparse Structure autoencoder |
|
| 61 |
+
| `ckpts/anigen/slat_dae` | Structured Latent autoencoder |
|
| 62 |
+
| `ckpts/anigen/ss_flow_duet` | SS flow model with stronger skeleton detail |
|
| 63 |
+
| `ckpts/anigen/ss_flow_epic` | SS flow model balancing geometry and skeleton quality |
|
| 64 |
+
| `ckpts/anigen/ss_flow_solo` | SS flow model with stronger geometry generalization |
|
| 65 |
+
| `ckpts/anigen/slat_flow_auto` | SLAT flow model with automatic joint-count prediction |
|
| 66 |
+
| `ckpts/anigen/slat_flow_control` | SLAT flow model with controllable joint density |
|
| 67 |
+
| `ckpts/anigen/slat_flow_gsn_auto` | Additional SLAT variant included in the release |
|
| 68 |
+
|
| 69 |
+
### Dependency checkpoints
|
| 70 |
+
|
| 71 |
+
| Folder | Purpose |
|
| 72 |
+
| --- | --- |
|
| 73 |
+
| `ckpts/dinov2` | DINOv2 encoder files and pretrained ViT-L/14 weights |
|
| 74 |
+
| `ckpts/dsine` | DSINE normal estimation weights |
|
| 75 |
+
| `ckpts/vgg` | VGG weights used by the pipeline |
|
| 76 |
+
|
| 77 |
+
## How To Use
|
| 78 |
+
|
| 79 |
+
Clone the main AniGen repository first:
|
| 80 |
+
|
| 81 |
+
```bash
|
| 82 |
+
git clone --recurse-submodules https://github.com/VAST-AI-Research/AniGen.git
|
| 83 |
+
cd AniGen
|
| 84 |
+
```
|
| 85 |
+
|
| 86 |
+
Then download this weights repository so that the folder structure is preserved under the project root.
|
| 87 |
+
|
| 88 |
+
### Option 1: Download with `huggingface_hub`
|
| 89 |
+
|
| 90 |
+
```bash
|
| 91 |
+
python -c "from huggingface_hub import snapshot_download; snapshot_download(repo_id='VAST-AI/AniGen_Weights', repo_type='model', local_dir='.', local_dir_use_symlinks=False)"
|
| 92 |
+
```
|
| 93 |
+
|
| 94 |
+
After download, you should have paths like:
|
| 95 |
+
|
| 96 |
+
```text
|
| 97 |
+
ckpts/anigen/ss_flow_duet/ckpts/denoiser.pt
|
| 98 |
+
ckpts/anigen/slat_flow_auto/ckpts/denoiser.pt
|
| 99 |
+
ckpts/dsine/dsine.pt
|
| 100 |
+
ckpts/vgg/vgg16-397923af.pth
|
| 101 |
+
```
|
| 102 |
+
|
| 103 |
+
### Option 2: Download from the web UI
|
| 104 |
+
|
| 105 |
+
You can also download this repository from the Hugging Face file browser and place the entire `ckpts/` folder at the root of the AniGen project.
|
| 106 |
+
|
| 107 |
+
## Run AniGen With These Weights
|
| 108 |
+
|
| 109 |
+
Once the `ckpts/` folder is in place, you can run:
|
| 110 |
+
|
| 111 |
+
```bash
|
| 112 |
+
python example.py --image_path assets/cond_images/trex.png
|
| 113 |
+
```
|
| 114 |
+
|
| 115 |
+
Or launch the Gradio demo:
|
| 116 |
+
|
| 117 |
+
```bash
|
| 118 |
+
python app.py
|
| 119 |
+
```
|
| 120 |
+
|
| 121 |
+
## Notes
|
| 122 |
+
|
| 123 |
+
- Keep the directory names unchanged. The AniGen code expects the exact `ckpts/...` layout shown above.
|
| 124 |
+
- The code repository may automatically fetch missing files in some setups, but this weights repository is the recommended way to pre-download and manage checkpoints explicitly.
|
| 125 |
+
- `slat_flow_control` supports joint density control, while `slat_flow_auto` is the best default for general use.
|
| 126 |
+
|
| 127 |
+
## Related Links
|
| 128 |
+
|
| 129 |
+
- Best AI 3D studio -- Tripo: https://www.tripo3d.ai/zh
|
| 130 |
+
- Main code repository: https://github.com/VAST-AI-Research/AniGen
|
| 131 |
+
- Project page: https://yihua7.github.io/AniGen-web/
|
| 132 |
+
- Demo: https://huggingface.co/spaces/VAST-AI/AniGen
|
| 133 |
+
- Paper: https://arxiv.org/pdf/2604.08746
|
| 134 |
+
|
| 135 |
+
## Citation
|
| 136 |
+
|
| 137 |
+
```bibtex
|
| 138 |
+
@article{huang2026anigen,
|
| 139 |
+
title = {AniGen: Unified $S^3$ Fields for Animatable 3D Asset Generation},
|
| 140 |
+
author = {Huang, Yi-Hua and Zhou, Zi-Xin and He, Yuting and Chang, Chirui
|
| 141 |
+
and Pu, Cheng-Feng and Yang, Ziyi and Guo, Yuan-Chen
|
| 142 |
+
and Cao, Yan-Pei and Qi, Xiaojuan},
|
| 143 |
+
journal = {ACM SIGGRAPH},
|
| 144 |
+
year = {2026}
|
| 145 |
+
}
|
| 146 |
+
```
|