Hugging Face model: majentik/Mistral-Small-4-119B-RotorQuant-MLX-8bit
Author: majentik
Created: 2026-04-13 11:42:43
Last modified: 2026-07-20 16:50:36
Pipeline: text-generation
Library: mlx
Likes: 0 | Downloads: 609
Tags: mlx, safetensors, mistral3, rotorquant, kv-cache-quantization, mistral, moe, sparse-moe, multimodal, quantized, 8bit, apple-silicon, 256k-context, thinking, text-generation, conversational, en, arxiv:2504.19874, base_model:mistralai/Mistral-Small-4-119B-2603, base_model:quantized:mistralai/Mistral-Small-4-119B-2603, license:apache-2.0, 8-bit, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-Small-4-119B-2603
Card metadata:
base_model: mistralai/Mistral-Small-4-119B-2603
library_name: mlx
license: apache-2.0
tags: rotorquant, kv-cache-quantization, mistral, moe, sparse-moe, multimodal, quantized, mlx, 8bit, apple-silicon, 256k-context, thinking
pipeline_tag: text-generation
language: en