Yihua7 commited on
Commit
96d123b
Β·
verified Β·
1 Parent(s): b6ca791

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +142 -5
README.md CHANGED
@@ -2,8 +2,145 @@
2
  license: mit
3
  ---
4
 
5
- <p align="center"><a href="https://arxiv.org/pdf/2604.08746"><img src='https://img.shields.io/badge/arXiv-Paper-red?logo=arxiv&logoColor=white' alt='arXiv'></a>
6
- <a href='https://yihua7.github.io/AniGen-web/'><img src='https://img.shields.io/badge/Project_Page-Website-green?logo=googlechrome&logoColor=white' alt='Project Page'></a>
7
- <a href='https://huggingface.co/spaces/VAST-AI/AniGen'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Live_Demo-blue'></a>
8
- <a href='https://github.com/VAST-AI-Research/AniGen'><img src='https://img.shields.io/badge/GitHub-Repository-black?logo=github&logoColor=white' alt='GitHub'></a>
9
- </p>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: mit
3
  ---
4
 
5
+ # AniGen_Weights
6
+
7
+ Pretrained checkpoints for [AniGen](https://github.com/VAST-AI-Research/AniGen), a unified framework for generating animatable 3D assets from a single image.
8
+
9
+ <p align="center">
10
+ <a href="https://arxiv.org/pdf/2604.08746"><img src="https://img.shields.io/badge/arXiv-Paper-red?logo=arxiv&logoColor=white" alt="arXiv"></a>
11
+ <a href="https://yihua7.github.io/AniGen-web/"><img src="https://img.shields.io/badge/Project_Page-Website-green?logo=googlechrome&logoColor=white" alt="Project Page"></a>
12
+ <a href="https://huggingface.co/spaces/VAST-AI/AniGen"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Live_Demo-blue" alt="Hugging Face Demo"></a>
13
+ <a href="https://github.com/VAST-AI-Research/AniGen"><img src="https://img.shields.io/badge/GitHub-Repository-black?logo=github&logoColor=white" alt="GitHub"></a>
14
+ </p>
15
+
16
+ This repository stores the contents of the `ckpts/` directory used by the AniGen codebase, including:
17
+
18
+ - AniGen stage checkpoints
19
+ - DINOv2 vision encoder weights
20
+ - DSINE normal estimation weights
21
+ - VGG backbone weights
22
+
23
+ ## What Is Included
24
+
25
+ The repository is organized exactly like the `ckpts/` folder expected by the main AniGen repo:
26
+
27
+ ```text
28
+ ckpts/
29
+ β”œβ”€β”€ anigen/
30
+ β”‚ β”œβ”€β”€ ss_dae/
31
+ β”‚ β”œβ”€β”€ slat_dae/
32
+ β”‚ β”œβ”€β”€ ss_flow_duet/
33
+ β”‚ β”œβ”€β”€ ss_flow_epic/
34
+ β”‚ β”œβ”€β”€ ss_flow_solo/
35
+ β”‚ β”œβ”€β”€ slat_flow_auto/
36
+ β”‚ β”œβ”€β”€ slat_flow_control/
37
+ β”‚ └── slat_flow_gsn_auto/
38
+ β”œβ”€β”€ dinov2/
39
+ β”œβ”€β”€ dsine/
40
+ └── vgg/
41
+ ```
42
+
43
+ Approximate total size: about 23 GB.
44
+
45
+ ## Recommended Checkpoints
46
+
47
+ For most users, we recommend:
48
+
49
+ - `ss_flow_duet` for sparse structure generation
50
+ - `slat_flow_auto` for structured latent generation
51
+
52
+ This combination is also the default setup used by the AniGen inference example.
53
+
54
+ ## Checkpoint Overview
55
+
56
+ ### Core AniGen checkpoints
57
+
58
+ | Folder | Purpose |
59
+ | --- | --- |
60
+ | `ckpts/anigen/ss_dae` | Sparse Structure autoencoder |
61
+ | `ckpts/anigen/slat_dae` | Structured Latent autoencoder |
62
+ | `ckpts/anigen/ss_flow_duet` | SS flow model with stronger skeleton detail |
63
+ | `ckpts/anigen/ss_flow_epic` | SS flow model balancing geometry and skeleton quality |
64
+ | `ckpts/anigen/ss_flow_solo` | SS flow model with stronger geometry generalization |
65
+ | `ckpts/anigen/slat_flow_auto` | SLAT flow model with automatic joint-count prediction |
66
+ | `ckpts/anigen/slat_flow_control` | SLAT flow model with controllable joint density |
67
+ | `ckpts/anigen/slat_flow_gsn_auto` | Additional SLAT variant included in the release |
68
+
69
+ ### Dependency checkpoints
70
+
71
+ | Folder | Purpose |
72
+ | --- | --- |
73
+ | `ckpts/dinov2` | DINOv2 encoder files and pretrained ViT-L/14 weights |
74
+ | `ckpts/dsine` | DSINE normal estimation weights |
75
+ | `ckpts/vgg` | VGG weights used by the pipeline |
76
+
77
+ ## How To Use
78
+
79
+ Clone the main AniGen repository first:
80
+
81
+ ```bash
82
+ git clone --recurse-submodules https://github.com/VAST-AI-Research/AniGen.git
83
+ cd AniGen
84
+ ```
85
+
86
+ Then download this weights repository so that the folder structure is preserved under the project root.
87
+
88
+ ### Option 1: Download with `huggingface_hub`
89
+
90
+ ```bash
91
+ python -c "from huggingface_hub import snapshot_download; snapshot_download(repo_id='VAST-AI/AniGen_Weights', repo_type='model', local_dir='.', local_dir_use_symlinks=False)"
92
+ ```
93
+
94
+ After download, you should have paths like:
95
+
96
+ ```text
97
+ ckpts/anigen/ss_flow_duet/ckpts/denoiser.pt
98
+ ckpts/anigen/slat_flow_auto/ckpts/denoiser.pt
99
+ ckpts/dsine/dsine.pt
100
+ ckpts/vgg/vgg16-397923af.pth
101
+ ```
102
+
103
+ ### Option 2: Download from the web UI
104
+
105
+ You can also download this repository from the Hugging Face file browser and place the entire `ckpts/` folder at the root of the AniGen project.
106
+
107
+ ## Run AniGen With These Weights
108
+
109
+ Once the `ckpts/` folder is in place, you can run:
110
+
111
+ ```bash
112
+ python example.py --image_path assets/cond_images/trex.png
113
+ ```
114
+
115
+ Or launch the Gradio demo:
116
+
117
+ ```bash
118
+ python app.py
119
+ ```
120
+
121
+ ## Notes
122
+
123
+ - Keep the directory names unchanged. The AniGen code expects the exact `ckpts/...` layout shown above.
124
+ - The code repository may automatically fetch missing files in some setups, but this weights repository is the recommended way to pre-download and manage checkpoints explicitly.
125
+ - `slat_flow_control` supports joint density control, while `slat_flow_auto` is the best default for general use.
126
+
127
+ ## Related Links
128
+
129
+ - Best AI 3D studio -- Tripo: https://www.tripo3d.ai/zh
130
+ - Main code repository: https://github.com/VAST-AI-Research/AniGen
131
+ - Project page: https://yihua7.github.io/AniGen-web/
132
+ - Demo: https://huggingface.co/spaces/VAST-AI/AniGen
133
+ - Paper: https://arxiv.org/pdf/2604.08746
134
+
135
+ ## Citation
136
+
137
+ ```bibtex
138
+ @article{huang2026anigen,
139
+ title = {AniGen: Unified $S^3$ Fields for Animatable 3D Asset Generation},
140
+ author = {Huang, Yi-Hua and Zhou, Zi-Xin and He, Yuting and Chang, Chirui
141
+ and Pu, Cheng-Feng and Yang, Ziyi and Guo, Yuan-Chen
142
+ and Cao, Yan-Pei and Qi, Xiaojuan},
143
+ journal = {ACM SIGGRAPH},
144
+ year = {2026}
145
+ }
146
+ ```