Hugging Face model: majentik/Mistral-Small-4-119B-TurboQuant-MLX-8bit
Author: majentik
Created: 2026-04-13 11:40:15
Last modified: 2026-07-20 16:50:33
Pipeline: text-generation
Library: mlx
Likes: 0 | Downloads: 638
Tags: mlx, safetensors, mistral3, turboquant, kv-cache-quantization, mistral, moe, sparse-moe, multimodal, quantized, 8bit, apple-silicon, 256k-context, thinking, text-generation, conversational, en, arxiv:2504.19874, base_model:mistralai/Mistral-Small-4-119B-2603, base_model:quantized:mistralai/Mistral-Small-4-119B-2603, license:apache-2.0, 8-bit, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-Small-4-119B-2603
Card metadata:
base_model: mistralai/Mistral-Small-4-119B-2603
library_name: mlx
license: apache-2.0
tags: turboquant, kv-cache-quantization, mistral, moe, sparse-moe, multimodal, quantized, mlx, 8bit, apple-silicon, 256k-context, thinking
pipeline_tag: text-generation
language: en