Hugging Face model: amd/Mistral-7B-Instruct-v0.3-w4a16-llmcompressor-v0.10.0.2
Author: amd
Created: 2026-06-15 11:03:29
Last modified: 2026-06-17 13:40:41
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 4
Tags: transformers, safetensors, mistral, text-generation, quantized, int4, w4a16, weight-only, 4-bit, llm-compressor, zendnn, compressed-tensors, amd, cpu-inference, conversational, en, base_model:mistralai/Mistral-7B-Instruct-v0.3, base_model:quantized:mistralai/Mistral-7B-Instruct-v0.3, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-7B-Instruct-v0.3
Card metadata:
license: apache-2.0
base_model: mistralai/Mistral-7B-Instruct-v0.3
base_model_relation: quantized
library_name: transformers
pipeline_tag: text-generation
tags: quantized, int4, w4a16, weight-only, 4-bit, llm-compressor, zendnn, llm-compressor, compressed-tensors, amd, cpu-inference
language: en