Hugging Face model: fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int8-gs128-asym
Author: fbaldassarri
Created: 2025-03-27 20:51:18
Last modified: 2025-03-27 20:58:04
Pipeline: text-generation
Likes: 0 | Downloads: 5
Tags: safetensors, mistral, pytorch, causal-lm, autoround, auto-round, intel-autoround, gptq, autogptq, auto-gptq, woq, intel, mistralai, text-generation, conversational, en, fr, base_model:mistralai/Mistral-Small-24B-Instruct-2501, base_model:quantized:mistralai/Mistral-Small-24B-Instruct-2501, license:apache-2.0, 8-bit, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-Small-24B-Instruct-2501
Card metadata:
language: en, fr
tags: pytorch, causal-lm, mistral, autoround, auto-round, intel-autoround, gptq, autogptq, auto-gptq, woq, intel, pytorch, mistralai
license: apache-2.0
model_name: Mistral Small 24B Instruct 2501
base_model: mistralai/Mistral-Small-24B-Instruct-2501
inference: no
model_creator: mistralai
pipeline_tag: text-generation
prompt_template: {prompt} 
quantized_by: fbaldassarri