Model: EliasOenal/Mistral-Small-24B-Instruct-2501-W8A8-dynamic
Author: EliasOenal
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, mistral, text-generation, mistral-small, w8a8, vllm, conversational, en, dataset:neuralmagic/LLM_compression_calibration, base_model:mistralai/Mistral-Small-24B-Instruct-2501, base_model:quantized:mistralai/Mistral-Small-24B-Instruct-2501, license:apache-2.0, text-generation-inference, endpoints_compatible, 8-bit, compressed-tensors, region:us
Base models (quantized): id: mistralai/Mistral-Small-24B-Instruct-2501
Card metadata: license: apache-2.0
language: en
tags: mistral, mistral-small, w8a8, vllm
base_model: mistralai/Mistral-Small-24B-Instruct-2501
library_name: transformers
datasets: neuralmagic/LLM_compression_calibration
Likes: 3 | All-time downloads: 714
Created: 2025-02-12 10:56:06