Hugging Face model: RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16
Author: RedHatAI
Created: 2025-10-22 07:48:00
Last modified: 2026-04-28 22:25:27
Pipeline: text-generation
Library: transformers
Likes: 5 | Downloads: 315
Tags: transformers, safetensors, nemotron_h, text-generation, nvidia, pytorch, int4, quantized, llm-compressor, compressed-tensors, red hat, conversational, custom_code, en, es, fr, de, it, ja, arxiv:2210.17323, license:other, endpoints_compatible, region:us
Card metadata:
license: other
license_name: nvidia-open-model-license
license_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/
pipeline_tag: text-generation
language: en, es, fr, de, it, ja
library_name: transformers
name: RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16
description: This model was obtained by quantizing weights of NVIDIA-Nemotron-Nano-9B-v2 to INT4 data type.
readme: https://huggingface.co/RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16/main/README.md
tags: nvidia, pytorch, int4, quantized, llm-compressor, compressed-tensors, red hat
track_downloads: yes
base_model: nvidia/NVIDIA-Nemotron-Nano-9B
validated_on: RHOAI 2.25, RHAIIS 3.2.2, vLLM 0.10.1.1
provider: NVIDIA
tasks: text-to-text