This is an mlx-OptiQ conversion of EldritchLabs/MN-Crimson-Cafe-12B.

This is an RP/Writing model. See the original model card for the details.

Downloads last month
36
Safetensors
Model size
2B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for jaithree/MN-Crimson-Cafe-12B-OptiQ-4bit

Quantized
(3)
this model