Image-to-3D
zouzx commited on
Commit
c5132ba
0 Parent(s):

init commit

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: image-to-3d
4
+ ---
5
+
6
+ # TriplaneGuassian Model Card
7
+
8
+ <div align="center">
9
+
10
+ [**Project Page**](https://zouzx.github.io/TriplaneGaussian/) **|** [**Paper (ArXiv)**](https://arxiv.org/abs/2312.09147) **|** [**Code**](https://github.com/VAST-AI-Research/TriplaneGaussian) **|** [**Gradio demo**](https://huggingface.co/spaces/VAST-AI/TriplaneGaussian)
11
+ </div>
12
+
13
+ ## Introduction
14
+ TGS enables fast reconstruction from single-view image in a few seconds based on a hybrid Triplane-Gaussian 3D representation.
15
+
16
+ ## Examples
17
+
18
+ ### Results on Images Generated by [Midjourney](https://www.midjourney.com/)
19
+
20
+ <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/644dbf6453ad80c6593bf748/BcJp8alZRXAIdPmfbVGdx.qt"></video>
21
+
22
+ ### Results on Captured Real-world Images
23
+
24
+ <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/644dbf6453ad80c6593bf748/bgAxqUQpnisQAmsGZ9Q_0.qt"></video>
25
+
26
+ ## Model Details
27
+ The model `model_lvis_rel.ckpt` is trained on Objaverse-LVIS dataset, which only includes ~45K synthetic objects.
28
+
29
+ ## Usage
30
+ You can directly download the model in this repository or employ the model in python script by:
31
+ ```python
32
+ from huggingface_hub import hf_hub_download
33
+ MODEL_CKPT_PATH = hf_hub_download(repo_id="VAST-AI/TriplaneGaussian", filename="model_lvis_rel.ckpt", repo_type="model")
34
+ ```
35
+
36
+ More details can be found in our [Github repository](https://github.com/VAST-AI-Research/TriplaneGaussian).
37
+
38
+ ## Citation
39
+ If you find this work helpful, please consider citing our paper:
40
+ ```bibtex
41
+ @article{zou2023triplane,
42
+ title={Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers},
43
+ author={Zou, Zi-Xin and Yu, Zhipeng and Guo, Yuan-Chen and Li, Yangguang and Liang, Ding and Cao, Yan-Pei and Zhang, Song-Hai},
44
+ journal={arXiv preprint arXiv:2312.09147},
45
+ year={2023}
46
+ }
47
+ ```