Hugging Face model: BareMetalAI/Llama-3.1-Nemotron-Nano-8B-W4A16-AWQ
Author: BareMetalAI
Created: 2026-06-12 18:53:33
Last modified: 2026-06-12 18:56:26
Pipeline: text-generation
Library: tensorrt-llm
Likes: 0 | Downloads: 15
Tags: tensorrt-llm, safetensors, llama, int4, w4a16, awq, modelopt, baremetalrt, nemotron, text-generation, conversational, base_model:nvidia/Llama-3.1-Nemotron-Nano-8B-v1, base_model:quantized:nvidia/Llama-3.1-Nemotron-Nano-8B-v1, license:other, 8-bit, region:us
Base model relation: quantized
Base models: id: nvidia/Llama-3.1-Nemotron-Nano-8B-v1
Card metadata:
license: other
license_name: nvidia-open-model-license
license_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/
base_model: nvidia/Llama-3.1-Nemotron-Nano-8B-v1
base_model_relation: quantized
tags: int4, w4a16, awq, modelopt, tensorrt-llm, baremetalrt, nemotron, llama
library_name: tensorrt-llm
pipeline_tag: text-generation