Hugging Face's logo

turboderp
/
Mistral-Small-4-119B-2603-exl3

exl3
Model card Files
xet
 Community

EXL3 quants of mistralai/Mistral-Small-4-119B-2603

⚠️ Needs ExLlamav3 v1.4.1 (or dev branch)

2.03 bits per weight
3.03 bits per weight
4.03 bits per weight

qb_kld_spread_vram qb_kld_vram qb_kld_hist_combined

(Could not find any working GGUF quants to compare, sorry.)

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for turboderp/Mistral-Small-4-119B-2603-exl3

Base model

mistralai/Mistral-Small-4-119B-2603
Quantized
(31)
this model

Collection including turboderp/Mistral-Small-4-119B-2603-exl3