neurocuda/robotics-perception-snn βœ…

Full robotics perception pipeline β€” event camera β†’ SNN β†’ deploy. 99.95% accuracy (beats ANN). 92% sparse. 49% energy reduction vs ANN. NIR-exported and ready for Loihi 2 / SpiNNaker / FPGA deployment.

Model Details

  • Task: robotics-perception
  • Dataset: N-MNIST (event camera)
  • Architecture: 3-layer CNN (2 input channels, 34Γ—34), 5D-native
  • Training: ANN β†’ CS-QCFS β†’ IF + BPTT FT (conversion, 5 epochs, 20K data)
  • Status: production

Performance

  • SNN Accuracy: 99.95% | Gap: -0.25% (BETTER than ANN)
  • Sparsity: 92.06%
  • Energy/Inference: 13.02 Β΅J
  • Energy vs ANN: 49% reduction
  • Parameters: 147,466 (576 KB)
  • Timesteps: T=16

Usage

import neurocuda as nc

# Load the pre-converted spiking model
snn, info = nc.hub.load("neurocuda/robotics-perception-snn")

# The model is already spiking β€” binary IF/LIF spikes, stateful membrane
snn.eval()

# 4D input (single frame)
import torch
x = torch.randn(1, 2, 34, 34)  # Adjust channels/size for your model
output = snn(x)

# 5D input (temporal β€” event cameras, video)
x5 = torch.randn(2, 16, 2, 34, 34)  # (Batch, Timesteps, Channels, H, W)
output5 = snn(x5)

Hardware Compatibility

  • Validated on: GPU, CPU, Loihi 2 simulator, NIR-exported
  • NIR Export: Yes β€” deployable to Loihi 2, SpiNNaker, FPGA

Conversion Method

ANN β†’ CS-QCFS β†’ IF + BPTT FT (conversion, 5 epochs, 20K data)

Citation

@software{neurocuda2026,
  title    = {NeuroCUDA: A PyTorch-to-Neuromorphic Compiler},
  author   = {Krishna Varma},
  year     = {2026},
  url      = {https://github.com/neurocuda/neurocuda}
}

Limitations

This is a converted spiking neural network. Accuracy was measured on the full test set with β‰₯3 seeds (where noted). Performance may vary on different hardware backends. See the NeuroCUDA README for detailed benchmarking methodology.

Downloads last month
3
Video Preview
loading