Hugging Face model: RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16
Author: RedHatAI
Created: 2026-06-04 22:17:21
Last modified: 2026-08-07 22:11:12
Pipeline: text-generation
Likes: 3 | Downloads: 693
Tags: safetensors, nemotron_h, int4, w4a16, quantized, llm-compressor, compressed-tensors, red hat, text-generation, conversational, base_model:nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16, base_model:quantized:nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16, license:other, region:us
Base model relation: quantized
Base models: id: nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16
Card metadata:
license: other
license_name: nvidia-open-model-license
pipeline_tag: text-generation
provider: NVIDIA
tool_calling_supported: yes
required_cli_args: --reasoning-parser nemotron_v3, --tool-call-parser qwen3_coder
chat_template_file_name: None
chat_template_path: None
tool_call_parser: qwen3_coder
validated_tasks: tool-calling
tasks: text-to-text, text-generation, reasoning, tool-calling
base_model: nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16
name: RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16
description: This model was obtained by quantizing the weights of nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 to INT4 (W4A16) data type.
readme: https://huggingface.co/RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16/blob/main/README.md
tags: int4, w4a16, quantized, llm-compressor, compressed-tensors, red hat
validated_on: RHOAI 3.5, RHAIIS 3.5, vLLM 0.24.0