Hugging Face model: BareMetalAI/Mistral-7B-Instruct-v0.3-W4A16-AWQ
Author: BareMetalAI
Created: 2026-06-12 21:03:02
Last modified: 2026-06-12 21:04:51
Pipeline: text-generation
Library: tensorrt-llm
Likes: 0 | Downloads: 3
Tags: tensorrt-llm, safetensors, mistral, int4, w4a16, awq, modelopt, baremetalrt, text-generation, conversational, base_model:mistralai/Mistral-7B-Instruct-v0.3, base_model:quantized:mistralai/Mistral-7B-Instruct-v0.3, license:apache-2.0, 8-bit, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-7B-Instruct-v0.3
Card metadata:
license: apache-2.0
base_model: mistralai/Mistral-7B-Instruct-v0.3
base_model_relation: quantized
tags: int4, w4a16, awq, modelopt, tensorrt-llm, baremetalrt, mistral
library_name: tensorrt-llm
pipeline_tag: text-generation