C-RADIOv4-H

This repository packages the C-RADIOv4-H copy inside Nemotron 3 Nano Omni. It is not a clone of NVIDIA's standalone encoder nvidia/C-RADIOv4-H.

Contents

File	Tensors	What it holds
model.safetensors	390	RADIO Tower, extracted from Omni vision_model.*
projector.safetensors	3	Omni mlp1 Projector
config.json		Vision-only RADIOModel config, with source and revision
projector_config.json, projector.py		Projector shapes and loader

Architecture

Component	Details
Tower	C-RADIOv4-H, 1280 hidden, patch size 16
Token compression	InternVL v2 2x2 pixel shuffle, scale 0.5, no learned parameters
Projector (mlp1)	RMSNorm(5120), Linear(5120, 20480) no bias, SquaredReLU, Linear(20480, 2688) no bias
Extra	video_embedder Linear on the RADIO patch generator (2-frame tubelets)

The standalone encoder does not ship this Omni Projector path. Omni SFT later stages train more than the Projector, so the ViT tensors can differ from nvidia/C-RADIOv4-H.

Usage

See examples/inference.py for image feature extraction. AutoModel.from_pretrained on this repository will fail. The example builds RADIO from the Omni vision_config (trust_remote_code=True) and loads the weights here.

Validation

The parity script compares all 390 Tower tensors and three Projector tensors with the pinned Omni parent using torch.equal. That is bit-identity with Omni vision_model.* and mlp1.*, not with nvidia/C-RADIOv4-H.

Reproduction

The export script reads vision_model.* (390 tensors) and mlp1.* (3 tensors) from shard 1 of nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16. It removes the prefixes and writes the original BF16 tensors.

Credits

NVIDIA released C-RADIOv4-H and Nemotron 3 Nano Omni. The Omni paper is arXiv:2604.24954.

License

NVIDIA Open Model Agreement, the same license as the source model.