PeterDAI commited on
Commit
34c4075
·
verified ·
1 Parent(s): 61a1dbb

Create README.md

Browse files

<div align="center">

<h1 style="text-align:center;">
Free Geometry: Refining 3D Reconstruction from Longer Versions of Itself
</h1>

_Test-time self-evolution for feed-forward 3D reconstruction without 3D ground truth_

<p align="center">
<a href="https://arxiv.org/abs/2604.14048" target="_blank">
<img alt="Paper" src="https://img.shields.io/badge/arXiv-2604.14048-red?logo=arxiv" height="20" />
</a>
<a href="https://github.com/hiteacherIamhumble/Free-Geometry" target="_blank">
<img alt="Code" src="https://img.shields.io/badge/GitHub-Free--Geometry-181717?logo=github" height="20" />
</a>
<a href="https://huggingface.co/PeterDAI/Free-Geometry" target="_blank">
<img alt="Model Weights" src="https://img.shields.io/badge/HuggingFace-Model_Weights-yellow?logo=huggingface" height="20" />
</a>
<a href="./LICENSE" target="_blank">
<img alt="License" src="https://img.shields.io/badge/License-CC_BY_4.0-lightgrey.svg" height="20" />
</a>
</p>

</div>

# Model Description

This repository provides a **LoRA / PEFT adapter** for **Free-Geometry** fine-tuning on top of a pretrained base model (VGGT and DepthAnything3).

This is **not** a full standalone model checkpoint. The repository only contains the adapter weights and configuration needed to apply the fine-tuned update to the original base model.

Use this adapter if you want the Free-Geo fine-tuned behavior while keeping the original base model separate.

# What Is In This Repository?

This repository is expected to contain:

- `adapter_config.json`
- `adapter_model.safetensors`
- `README.md`

These files define the PEFT adapter and tell PEFT how to attach the LoRA weights to the base model.

# Base Model

This adapter was trained on top of:

- (zoooooooyuan/VGGT-1B)[https://huggingface.co/zoooooooyuan/VGGT-1B]
- (depth-anything/DA3-GIANT-1.1)[https://huggingface.co/depth-anything/DA3-GIANT-1.1]


# Training Setup

This adapter corresponds to:

- Backbone: `DA3` or `VGGT`
- Method: `Free-Geo`
- Dataset: `eth3d`, `7scenes`, `hiroom`, or `scannetpp` (all come from (depth-anything/DA3-BENCH)[https://huggingface.co/depth-anything/DA3-BENCH]

# How To Use With PEFT

```python
from transformers import AutoModel, AutoProcessor
from peft import PeftModel

base_model_id = "YOUR_BASE_MODEL_ID"
adapter_repo = "YOUR_USERNAME/YOUR_ADAPTER_REPO"

processor = AutoProcessor.from_pretrained(base_model_id)
base_model = AutoModel.from_pretrained(base_model_id)
model = PeftModel.from_pretrained(base_model, adapter_repo)

# Optional: merge adapter into the base model for inference
# model = model.merge_and_unload()
```

# Repository Variants

Free Geometry is designed for test-time adaptation, so you can find different model variants for each datasets.

- `DA3-Free-Geo-eth3d`
- `DA3-Free-Geo-7scenes`
- `DA3-Free-Geo-hiroom`
- `DA3-Free-Geo-scannetpp`
- `VGGT-Free-Geo-eth3d`
- `VGGT-Free-Geo-7scenes`
- `VGGT-Free-Geo-hiroom`
- `VGGT-Free-Geo-scannetpp`

# Citation

If you use this model, please cite the corresponding project or paper:

```bibtex
@misc {dai2026freegeometryrefining3d,
title={Free Geometry: Refining 3D Reconstruction from Longer Versions of Itself},
author={Yuhang Dai and Xingyi Yang},
year={2026},
eprint={2604.14048},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2604.14048},
}
```

Files changed (1) hide show
  1. README.md +16 -0
README.md ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - depth-anything/DA3-BENCH
4
+ base_model:
5
+ - zoooooooyuan/VGGT-1B
6
+ - depth-anything/DA3-GIANT-1.1
7
+ pipeline_tag: image-to-3d
8
+ library_name: peft
9
+ tags:
10
+ - 3D-reconstruction
11
+ - test-time-adaptation
12
+ - self-supervised-learning
13
+ - depth-estimation
14
+ - 3d-vision
15
+ - peft
16
+ ---