Model card for 3detr-m.scannet.fair

A 3DETR 3D object detection model (end-to-end set-prediction transformer detector). Trained on ScanNet.

Model Details

• Model Type: 3D object detection
• Model Stats:
  • Params (M): 7.4
  • Classes: 18
  • Features: 256
• Dataset: ScanNet
• Metrics: mAP@0.25 65.46, mAP@0.5 47.26 (reference 65.0)
• Paper: An End-to-End Transformer Model for 3D Object Detection
• Converted from: facebookresearch/3detr (Apache-2.0)
• Library: torch-pointcloud

Install

pip install torch-pointcloud

Usage

import torch
import torch_pointcloud as tp
from torch_pointcloud.utils.data import collate

model, info = tp.create_model(
    "3detr-m.scannet.fair",
    task="detection",
    pretrained=True,
    return_info=True,
)
model = model.eval()

# synthetic sample with the keys a dataset provides
num_points = 8192
sample = {
    "pos": torch.randn(num_points, 3),
    "color": torch.rand(num_points, 3) * 255,
    "normal": torch.randn(num_points, 3),
    "segment": torch.zeros(num_points, dtype=torch.long),
    "instance": torch.zeros(num_points, dtype=torch.long),
}
data = info["transform"](sample)
data = collate([data])

with torch.no_grad():
    out = model(data.get("x"), data["pos"], data["batch"])

Feature extraction

with torch.no_grad():
    features = model.forward_features(data.get("x"), data["pos"], data["batch"])  # 256 channels

Citation

@inproceedings{misra2021detr3d,
  title   = {An End-to-End Transformer Model for 3D Object Detection},
  author  = {Ishan Misra and Rohit Girdhar and Armand Joulin},
  booktitle = {ICCV},
  year    = {2021}
}

@inproceedings{dai2017scannet,
  title   = {ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes},
  author  = {Angela Dai and Angel X. Chang and Manolis Savva and Maciej Halber and Thomas Funkhouser and Matthias Nießner},
  booktitle = {CVPR},
  year    = {2017}
}

@software{dujardin2026pytorchpointcloud,
  author  = {Arthur Dujardin},
  title   = {PyTorch PointCloud},
  year    = {2026},
  doi     = {10.5281/zenodo.22159632},
  url     = {https://github.com/arthurdjn/pytorch-pointcloud},
}