Hugging Face model: BareMetalAI/Qwen3-8B-W4A16-AWQ
Author: BareMetalAI
Created: 2026-06-12 06:41:19
Last modified: 2026-06-12 06:43:20
Pipeline: text-generation
Library: tensorrt-llm
Likes: 0 | Downloads: 10
Tags: tensorrt-llm, safetensors, qwen3, int4, w4a16, awq, modelopt, baremetalrt, text-generation, conversational, base_model:Qwen/Qwen3-8B, base_model:quantized:Qwen/Qwen3-8B, license:apache-2.0, 8-bit, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen3-8B
Card metadata:
license: apache-2.0
base_model: Qwen/Qwen3-8B
base_model_relation: quantized
tags: int4, w4a16, awq, modelopt, tensorrt-llm, baremetalrt
library_name: tensorrt-llm
pipeline_tag: text-generation