C-RADIOv4-H-3.5-Bolt
This repository packages the C-RADIOv4-H Tower and Projector from Nemotron 3.5 Bolt.
Contents
| File | Tensors | What it holds |
|---|---|---|
model.safetensors |
391 | RADIO Tower from Bolt vision_model.*, including summary_idxs |
projector.safetensors |
3 | Bolt mlp1 Projector |
config.json, inventory.json |
Source and code pins, widths, and the shape, dtype and SHA256 of every tensor | |
vision.py |
Loader used by examples/inference.py |
Architecture
| Component | Details |
|---|---|
| Tower | C-RADIOv4-H, 32 layers, 1280 hidden, patch size 16, ten prefix tokens |
| Token compression | InternVL v2 2x2 pixel shuffle, scale 0.5, no learned parameters |
Projector (mlp1) |
RMSNorm(5120), Linear(5120, 20480) no bias, SquaredReLU, Linear(20480, 4096) no bias |
At 448 the bench reports 784 Tower tokens of width 1280, 196 merged tokens of
width 5120, and 196 projected tokens of width 4096.
Usage
See examples/inference.py for image feature extraction.
Validation
The release parity test compares every exported tensor with the pinned parent using torch.equal, then checks all stages against the parent's own RadioModel and VisionProjector code.
Reproduction
The export script reads vision_model.* and mlp1.* from the pinned parent and writes the original BF16 tensors.
Credits
NVIDIA released Nemotron 3.5 Bolt and C-RADIOv4-H.
License
OpenMDW-1.1, the license from the source model card.
- Downloads last month
- 19
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support