Sakura MiniMax-M3.1-Flash Q4_K_M GGUF
CPU requantization of the official MiniMax-M3.1-Flash hybrid NVFP4/MXFP8 checkpoint, using llama.cpp's standard mixed-type Q4_K_M policy. This is not a quantization from an unquantized BF16 checkpoint. No importance matrix or expert pruning is applied.
Runtime requirement: use the included runtime.patch with llama.cpp revision 970b51ce7c9ba5fff0726c5e9994f1c2f0e4eedc. These files use the explicit architecture identifier minimaxm31_sakura; unchanged stock runtimes reject it. M3.1 has sparse attention in all 60 layers, including its first three dense-MLP layers. The patch preserves that distinction in tensor loading, indexer KV caching and execution. A generic older M3 runtime must not silently substitute full attention in those layers.
Size comparison
The original 48 main safetensors shards total 250,116,419,880 bytes. The original DSpark file adds 2,301,867,426 bytes. The original source is already quantized: NVFP4 routed experts, MXFP8 attention paths, and retained BF16/F32 tensors.
| Checkpoint | Main GGUF shards | Main language files, GB | Including F16 projector and original DSpark, GB | Change vs official main + DSpark |
|---|---|---|---|---|
| Official hybrid safetensors + DSpark | โ | โ | 252.418 | โ |
| Sakura Q2_K | 4 | 155.983 | 160.017 | -36.61% |
| Sakura Q3_K_M | 5 | 203.571 | 207.605 | -17.75% |
| Sakura Q4_K_M | 6 | 258.095 | 262.129 | +3.85% |
| Sakura Q5_K_M | 7 | 302.930 | 306.965 | +21.61% |
GB = 10^9 bytes. Auxiliary-file totals include the same 1.732-GB F16 projector and 2.302-GB unchanged DSpark file in each release. Small JSON, license and runtime source files are excluded. GGUF main sizes include their metadata. The official main checkpoint includes the vision tower, which is separated into mmproj here. Q4/Q5 may be larger than the released low-precision source; increasing stored precision does not recover information lost during the source's quantization. These are file sizes, not complete RAM/VRAM requirements or speed/quality results.
Released files
| File | Bytes | SHA256 |
|---|---|---|
Sakura-MiniMax-M3.1-Flash-Q4_K_M-00001-of-00006.gguf |
47,181,052,736 | 5d56bc32217968723fef55cc92ae8a21e6d56d39919a011dc7e89db322e9c4f4 |
Sakura-MiniMax-M3.1-Flash-Q4_K_M-00002-of-00006.gguf |
47,133,035,264 | d8d6724fc2c7571d7904fb9137696bac6760f2adf5dab94c16d9b52107c520df |
Sakura-MiniMax-M3.1-Flash-Q4_K_M-00003-of-00006.gguf |
47,741,164,896 | 663268a70b78e665a24427f948e049fff448840bcebe76fd3aa64287ddfeb1f3 |
Sakura-MiniMax-M3.1-Flash-Q4_K_M-00004-of-00006.gguf |
46,606,396,256 | 89b8679d015789c0a0c403e5c5146e837f18faebd5b6269d64ad72b3534cd1c7 |
Sakura-MiniMax-M3.1-Flash-Q4_K_M-00005-of-00006.gguf |
47,229,250,400 | b4f14cde67a982aae58925f429d5e9c36f997c52f0673d0f6336654bcb2f8e80 |
Sakura-MiniMax-M3.1-Flash-Q4_K_M-00006-of-00006.gguf |
22,204,321,728 | 5860796d9f61a13be46cd6f6a3e2801f3c9450175c16764b941481c752b4bc94 |
MiniMax-M3.1-Flash-mmproj-f16.gguf |
1,732,284,000 | 022200a62d8821a4350bdd059b47446d7c6aebd0cdd7865db1577129543bf107 |
dspark/model-dspark-00001.safetensors |
2,301,867,426 | a27aed923fa17697997b30f44da0cd098460a60fee06498175e6d0c880308b69 |
Download every main GGUF shard and keep the names together; load the first shard. Each main shard is under 48 GB. SHA256SUMS records all released weight files. build-manifest.json records pinned source checksums, all target tensor types, every output tensor checksum, independent stream checksums and native Xet verification.
Source and preserved components
| Property | MiniMax-M3.1-Flash |
|---|---|
| Developer | MiniMax |
| Total / active parameters | Approximately 428B / 23B per token, developer-stated |
| Layers | 60, all using MiniMax Sparse Attention |
| Dense / MoE MLP layers | 3 leading dense MLP layers, followed by 57 MoE layers |
| Routed experts | 128 per MoE layer; 4 selected per token, plus shared expert |
| Configured context | 1,048,576 tokens |
| Modalities | Text, image and video input; text output |
| Main output tensors | 1188 (Q6_K: 88, Q4_K: 505, F32: 595) |
The standard upstream MiniMax vision converter produces the separate F16 projector. The complete original DSpark safetensors checkpoint, config and index are copied unchanged. DSpark execution is not integrated into this patched llama.cpp runtime; the original files are retained for compatible serving implementations and future integration. No speculative speedup is claimed.
Provenance and construction
- Source revision:
54e4e69dfc452b1e94a426c24a4fdeeaa8e3ad5e. - NVFP4 source weights are decoded with per-group FP8 scales and the released global-scale convention; MXFP8 uses E4M3 weights and UE8M0 block scales. Conversion uses BF16/F32 intermediates selected by the pinned upstream converter.
- Every complete source shard is SHA256-verified before its payload is used. Tiny verified scale/norm tensors are cached in RAM to avoid repeatedly reloading unrelated large shards.
- Main expert matrices are encoded one expert at a time; embeddings are encoded in bounded row blocks. No full decoded model or full output GGUF is materialized on disk.
- Full-model tensor type assignments match the unchanged native quantization planner. Real-row decoder checks match independent native ggml/PyTorch references. The patched all-sparse runtime passes a small synthetic CPU prefill/decode check. Those checks do not establish full-model response quality; no new benchmark scores are claimed.
- All final source/producer/upload checks must pass before an atomic model commit is published. An independent finalizer can recover a completed upload from its checksum-protected provenance checkpoint.
Build the compatible runtime and run
Use build-runtime.sh alongside runtime.patch. It checks out the pinned upstream revision and applies the included patch. CPU is the default; supported GPU backends can be selected when building for your own hardware. No model weights are downloaded by the runtime build script.
bash build-runtime.sh
./minimax-runtime-build/bin/llama-server -m Sakura-MiniMax-M3.1-Flash-Q4_K_M-00001-of-00006.gguf --mmproj MiniMax-M3.1-Flash-mmproj-f16.gguf -ngl 0 -c 32768 -fa on --parallel 1 --jinja --temp 1.0 --top-p 0.95
Flash Attention and a supported stream layout are required for this M3.1 path; unsupported settings fail instead of silently using full attention. Omit --mmproj for text-only use. Set context and offloading for available memory; the source's maximum context is not a claim that it fits a particular device. Preserve the original chat template and returned reasoning content. Do not add guessed DSpark flags to this runtime.
License and attribution
Original model: MiniMax-M3.1-Flash, Copyright (c) 2026 MiniMax. This redistribution retains the MINIMAX COMMUNITY LICENSE, including its attribution, commercial-use and prohibited-use conditions. It is not Apache-2.0 or MIT model licensing. Read LICENSE before use. llama.cpp runtime code is separately covered by its upstream MIT license. Sakura identifies this quantization and distribution, not original model training.
ไธญๆ่ฏดๆ๏ผ็นๅปๅฑๅผ๏ผ
Sakura MiniMax-M3.1-Flash Q4_K_M
ๆฌไปๅบๅฏน MiniMax ๅฎๆนๅๅธ็ NVFP4 ไธๅฎถๆ้ไธ MXFP8 ๆณจๆๅๆ้ๆททๅๆฃๆฅ็น่ฟ่ก CPU ๅ้ๅ๏ผ้็จๆ ๅ Q4_K_M ๆททๅ็ฒพๅบฆ็ญ็ฅ๏ผๆชไฝฟ็จ imatrix๏ผๆช่ฃๅชไธๅฎถใๅนถ้็ฑๆช้ๅ็ BF16 ๆฃๆฅ็น็ๆใไธป่ฏญ่จๆ้ๅ่ฎก 258.095 GB๏ผๅไธบ 6 ไธช GGUF ๅ็๏ผๆฏ็ๅฐไบ 48 GBใๅฆ้ F16 ่ง่งๆๅฝฑๅจๅไฟๆๅๆ ท็ DSpark ๆ้ใ้ ็ฝฎไธ็ดขๅผใ
ๅฟ
้กปไฝฟ็จๆฌไปๅบ้ๅธฆ็่ฟ่กๆถ่กฅไธๅๆๅฎ llama.cpp ็ๆฌ 970b51ce7c9ba5fff0726c5e9994f1c2f0e4eedcใ ๆไปถๆถๆๆ ่ฏไธบ minimaxm31_sakura๏ผๆชๆ่กฅไธ็ๅ็่ฟ่กๆถไผๆ็ปๅ ่ฝฝใM3.1 ็ๅ
จ้จ 60 ๅฑๅไฝฟ็จ็จ็ๆณจๆๅ๏ผๅ
ๆฌๅไธไธช็จ ๅฏ MLP ๅฑ๏ผไธ่ฝๆฒฟ็จๆง็ M3 ๅฏน่ฟไธๅฑ็ๅ
จๆณจๆๅๅ่ฎพใ่กฅไธๅๆถไฟฎๆญฃ็ดขๅผๅจๆ้ๅ ่ฝฝใKV ็ผๅญๅ้
ๅๆง่ก่ทฏๅพ๏ผๅนถ่ฆๆฑๅผๅฏ Flash Attentionใ
ๅๅงๆจกๅ็บฆ 4280 ไบฟๆปๅๆฐ๏ผๆฏไธช token ็บฆๆฟๆดป 230 ไบฟๅๆฐใๅ ๅซ 3 ไธช็จ ๅฏ MLP ๅฑๅ 57 ไธช MoE ๅฑ๏ผๆฏไธช MoE ๅฑๆ 128 ไธช่ทฏ็ฑไธๅฎถ๏ผ้ๆฉ 4 ไธชๅนถไฝฟ็จๅ ฑไบซไธๅฎถใๆบ้ ็ฝฎไธไธๆไธบ 1,048,576 tokenใไธป GGUF ไฟ็ 1188 ไธชๅผ ้ใๆไปถไฝ็งฏไธๆฏๅฎๆด่ฟ่กๅ ๅญ้ๆฑ๏ผQ4/Q5 ๅฏ่ฝๆฏๅๅงไฝ็ฒพๅบฆๆบๆดๅคง๏ผไนไธ่ฝๆขๅคๆบ้ๅๅทฒๆๅคฑ็ไฟกๆฏใ
ไธ่ฝฝๅ
จ้จๅ็ๅนถไฟๆๆไปถๅ๏ผๅ ่ฝฝ็ฌฌไธไธชๅ็ๅณๅฏใๅพ็ๅ่ง้ข่พๅ
ฅๅฆ้ mmprojใๅๅง DSpark ๆไปถไฟๆๅญ่ไธๅ๏ผไฝๆฌ่กฅไธ็ llama.cpp ๅฐๆช้ๆๅ
ถๆง่ก่ทฏๅพ๏ผไธ่ฝๆฎๆญคๅฃฐ็งฐๆจๆต่งฃ็ ๅ ้ใๅฏๅจๅฝไปค่ง่ฑๆ้จๅใ
ๆบ็ๆฌไธบ 54e4e69dfc452b1e94a426c24a4fdeeaa8e3ad5eใๆๅปบๅๆฃๆฅๅฎๆดๆบๅ็ SHA256๏ผๆไธๅฎถๅ่กๅๆตๅผ็ผ็ ๏ผ็ฌ็ซ้ช่ฏ่พๅบๆตใๅ็ Xet ๅ HF ๅทฒๆไบคๆไปถ็ๆ ก้ชๅผใ็ๅฎ่ก่งฃ็ ไธๅ็ ggml/PyTorch ๅ่ไธ่ด๏ผๅฎๆดๅผ ้็ฑปๅไธๅ็่งๅๅจไธ่ด๏ผๅฐๅๅๆ CPU ๆจกๅๅฏๅฎๆ prefill/decodeใ่ฟไบๆๅปบๆฃๆฅไธไปฃ่กจๅฎๆดๆจกๅ็ๅ็ญ่ดจ้่ฏๆต๏ผๆฌไปๅบไธๅฃฐ็งฐๆฐ็่ดจ้ๆ้ๅบฆๆ็ปฉใ่ฏฆๆ
่ง SHA256SUMS ไธ build-manifest.jsonใ
ๅๅงๆจกๅ็ๆๅฑไบ MiniMax๏ผ็ปง็ปญ้ตๅพช MINIMAX COMMUNITY LICENSEใ่ฏท้ ่ฏปๅ ถ็ฝฒๅใๅไธไฝฟ็จๅ็ฆๆญข็จ้ๆกๆฌพ๏ผๆจกๅ่ฎธๅฏ่ฏไธๆฏ Apache ๆ MITใllama.cpp ่ฟ่กๆถไปฃ็ ๅ็ฌ้ตๅพชไธๆธธ MIT ่ฎธๅฏ่ฏใ
- Downloads last month
- 33
4-bit
Model tree for mondk/MiniMax-M3.1-Flash-GGUF
Base model
MiniMaxAI/MiniMax-M3.1-Flash