Hugging Face model: NeoChen1024/Ministral-8B-Instruct-2410-W8A8
Author: NeoChen1024
Created: 2025-01-17 12:38:19
Last modified: 2025-01-17 14:33:30
Library: vllm
Likes: 2 | Downloads: 13
Tags: vllm, safetensors, mistral, int8, w8a8, en, fr, de, es, it, pt, zh, ja, ru, ko, base_model:mistralai/Ministral-8B-Instruct-2410, base_model:quantized:mistralai/Ministral-8B-Instruct-2410, license:other, 8-bit, compressed-tensors, region:us
Base model relation: quantized
Base models: id: mistralai/Ministral-8B-Instruct-2410
Card metadata:
tags: int8, w8a8
language: en, fr, de, es, it, pt, zh, ja, ru, ko
license: other
license_name: mrl
inference: no
license_link: https://mistral.ai/licenses/MRL-0.1.md
library_name: vllm
base_model: mistralai/Ministral-8B-Instruct-2410