Hugging Face model: majentik/Nemotron-3-Nano-4B-RotorQuant-MLX-8bit
Author: majentik
Created: 2026-04-13 20:36:43
Last modified: 2026-07-20 16:38:49
Pipeline: text-generation
Library: mlx
Likes: 0 | Downloads: 120
Tags: mlx, safetensors, nemotron_h, rotorquant, kv-cache-quantization, nemotron, nvidia, mamba2, hybrid, quantized, 8bit, text-generation, conversational, custom_code, arxiv:2504.19874, base_model:nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16, base_model:quantized:nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16, license:other, 8-bit, region:us
Base model relation: quantized
Base models: id: nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16
Card metadata:
base_model: nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16
library_name: mlx
tags: rotorquant, kv-cache-quantization, nemotron, nvidia, mamba2, hybrid, quantized, mlx, 8bit
license: other
license_name: nvidia-open-model-license
license_link: https://developer.download.nvidia.com/licenses/nvidia-open-model-license-agreement-june-2024.pdf
pipeline_tag: text-generation