Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining
Paper โข 2302.02318 โข Published
A ReCon point cloud classification model (masked point transformer with cross-modal contrastive queries). Trained on ScanObjectNN (OBJ_BG).
pip install torch-pointcloud
import torch
import torch_pointcloud as tp
from torch_pointcloud.utils.data import collate
model, info = tp.create_model(
"recon.scanobjectnn-objbg.zekun-qi",
pretrained=True,
return_info=True,
)
model = model.eval()
# synthetic sample with the keys a dataset provides
num_points = 8192
sample = {
"pos": torch.randn(num_points, 3),
}
data = collate([sample])
with torch.no_grad():
logits = model(data.get("x"), data["pos"], data["batch"])
with torch.no_grad():
embeddings = model.forward_features(data.get("x"), data["pos"], data["batch"])
model.reset_classifier(num_classes=0)
with torch.no_grad():
embeddings = model(data.get("x"), data["pos"], data["batch"]) # (B, 1536)
@inproceedings{qi2023recon,
title = {Contrast with Reconstruct: Contrastive {3D} Representation Learning Guided by Generative Pretraining},
author = {Qi, Zekun and Dong, Runpei and Fan, Guofan and Ge, Zheng and Zhang, Xiangyu and Ma, Kaisheng and Yi, Li},
booktitle = {ICML},
year = {2023}
}
@inproceedings{uy2019scanobjectnn,
title = {Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Data},
author = {Mikaela Angelina Uy and Quang-Hieu Pham and Binh-Son Hua and Duc Thanh Nguyen and Sai-Kit Yeung},
booktitle = {ICCV},
year = {2019}
}
@software{dujardin2026pytorchpointcloud,
author = {Arthur Dujardin},
title = {PyTorch PointCloud},
year = {2026},
doi = {10.5281/zenodo.22159632},
url = {https://github.com/arthurdjn/pytorch-pointcloud},
}
Base model
torch-pointcloud/recon.pretrain.zekun-qi