Sarvam-M 24B (Sarvam)
Parameters: 24B
Mixture of experts: no
Q4_K_M size: 14.3 GB
Q8_0 size: 25.1 GB
FP16 size: 47.2 GB
Minimum RAM for Q4: 16 GB
Default context length: 32K
Modality: text
Release: 2025-05
Hugging Face: sarvamai/sarvam-m
HF downloads: 3873
HF likes: 346
Model license: Apache-2.0 (commercial use: yes)
Notes: Dense 24B fine-tuned from Mistral-Small-3.1-24B-Base. Hybrid thinking mode. Q4_K_M 14.3GB and Q8_0 25.1GB confirmed from two independent GGUF repos (lmstudio-community, Mungert) plus the official sarvamai Q8 repo. Context 32K from config.json.