Hugging Face model: majentik/Mistral-Small-4-119B-TurboQuant-MLX-4bit
Author: majentik
Created: 2026-04-13 02:04:42
Last modified: 2026-07-20 16:09:15
Pipeline: text-generation
Library: mlx
Likes: 0 | Downloads: 438
Tags: mlx, safetensors, mistral3, turboquant, kv-cache-quantization, mistral, moe, sparse-moe, multimodal, quantized, 4-bit, apple-silicon, 256k-context, thinking, text-generation, conversational, en, arxiv:2504.19874, base_model:mistralai/Mistral-Small-4-119B-2603, base_model:quantized:mistralai/Mistral-Small-4-119B-2603, license:apache-2.0, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-Small-4-119B-2603
Card metadata:
base_model: mistralai/Mistral-Small-4-119B-2603
library_name: mlx
license: apache-2.0
tags: turboquant, kv-cache-quantization, mistral, moe, sparse-moe, multimodal, quantized, mlx, 4-bit, apple-silicon, 256k-context, thinking
pipeline_tag: text-generation
language: en