Hugging Face model: EliasOenal/Mistral-Small-24B-Instruct-2501-W8A8-dynamic
Author: EliasOenal
Created: 2025-02-12 10:56:06
Last modified: 2025-02-12 11:44:06
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 13
Tags: transformers, safetensors, mistral, text-generation, mistral-small, w8a8, vllm, conversational, en, dataset:neuralmagic/LLM_compression_calibration, base_model:mistralai/Mistral-Small-24B-Instruct-2501, base_model:quantized:mistralai/Mistral-Small-24B-Instruct-2501, license:apache-2.0, text-generation-inference, endpoints_compatible, 8-bit, compressed-tensors, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-Small-24B-Instruct-2501
Card metadata:
license: apache-2.0
language: en
tags: mistral, mistral-small, w8a8, vllm
base_model: mistralai/Mistral-Small-24B-Instruct-2501
library_name: transformers
datasets: neuralmagic/LLM_compression_calibration