Model card for pointpillars-multihead.nuscenes.openpcdet

A PointPillars 3D object detection model (pillar encoder with a 2D backbone). Trained on nuScenes.

Model Details

Install

pip install torch-pointcloud

Usage

import torch
import torch_pointcloud as tp
from torch_pointcloud.utils.data import collate

model, info = tp.create_model(
    "pointpillars-multihead.nuscenes.openpcdet",
    task="detection",
    pretrained=True,
    return_info=True,
)
model = model.eval()

# synthetic sample with the keys a dataset provides
num_points = 8192
sample = {
    "pos": torch.randn(num_points, 3),
    "intensity": torch.rand(num_points, 1),
    "timestamp": torch.zeros(num_points, 1),
}
data = info["transform"](sample)
data = collate([data], batch_from="pos_voxel")

with torch.no_grad():
    out = model(data["voxel"], data["pos_voxel"], data["voxel_num_points"], data["batch"])

Feature extraction

with torch.no_grad():
    features = model.forward_features(
        data["voxel"],
        data["pos_voxel"],
        data["voxel_num_points"],
        data["batch"],
    )  # 384 channels

Citation

@inproceedings{lang2019pointpillars,
  title   = {PointPillars: Fast Encoders for Object Detection from Point Clouds},
  author  = {Alex H. Lang and Sourabh Vora and Holger Caesar and Lubing Zhou and Jiong Yang and Oscar Beijbom},
  booktitle = {CVPR},
  year    = {2019}
}

@inproceedings{caesar2020nuscenes,
  title   = {nuScenes: A multimodal dataset for autonomous driving},
  author  = {Holger Caesar and Varun Bankiti and Alex H. Lang and Sourabh Vora and Venice Erin Liong and Qiang Xu and Anush Krishnan and Yu Pan and Giancarlo Baldan and Oscar Beijbom},
  booktitle = {CVPR},
  year    = {2020}
}

@software{dujardin2026pytorchpointcloud,
  author  = {Arthur Dujardin},
  title   = {PyTorch PointCloud},
  year    = {2026},
  doi     = {10.5281/zenodo.22159632},
  url     = {https://github.com/arthurdjn/pytorch-pointcloud},
}
Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
6.09M params
Tensor type
I64
·
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collections including torch-pointcloud/pointpillars-multihead.nuscenes.openpcdet

Paper for torch-pointcloud/pointpillars-multihead.nuscenes.openpcdet