MiniMax-M3.1-Flash-oQ4e
This model was quantized using oQ (oMLX v0.7.3) mixed-precision quantization.
The effective average is 4.642 bits/weight for the model weights, or 4.663 bits/weight including the DSpark draft.
Quantization and Bit Distribution
| Storage format | Logical weights | Share of total | Tensor storage | Effective bits/weight |
|---|---|---|---|---|
| NVFP4, group 16 | 413.122B | 96.738% | 216.422 GiB | 4.50 |
| Affine 8-bit, group 64 | 2.458B | 0.576% | 2.433 GiB | 8.50 |
| MXFP8, group 32 | 10.560B | 2.473% | 10.142 GiB | 8.25 |
| BF16 | 0.866B | 0.203% | 1.614 GiB | 16.00 |
| FP32 | 0.045B | 0.011% | 0.167 GiB | 32.00 |
| Total | 427.052B | 100% | 230.778 GiB | 4.642 |
Storage Breakdown
| Component | Logical weights | Storage |
|---|---|---|
| Language model | 426.186B | 246.064 GB / 229.165 GiB |
| Vision | 0.866B | 1.731 GB / 1.612 GiB |
| DSpark draft (MTP) | 2.011B | 2.302 GB / 2.144 GiB |
| Total | 429.063B | 250.097 GB / 232.921 GiB |
- Downloads last month
- 164
Model size
427B params
Tensor type
U32
·
BF16 ·
F32 ·
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support