Hugging Face model: BareMetalAI/Qwen3-4B-W4A16-AWQ
Author: BareMetalAI
Created: 2026-06-09 16:36:42
Last modified: 2026-06-09 16:38:17
Pipeline: text-generation
Library: tensorrt-llm
Likes: 0 | Downloads: 7
Tags: tensorrt-llm, safetensors, qwen3, int4, w4a16, awq, modelopt, baremetalrt, text-generation, conversational, base_model:Qwen/Qwen3-4B, base_model:quantized:Qwen/Qwen3-4B, license:apache-2.0, 8-bit, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen3-4B
Card metadata:
license: apache-2.0
base_model: Qwen/Qwen3-4B
base_model_relation: quantized
tags: int4, w4a16, awq, modelopt, tensorrt-llm, baremetalrt
library_name: tensorrt-llm
pipeline_tag: text-generation