AX-DeepSeek-V4-Flash-0731-MLX-AXQ-2bit-MTP

Development / experimental AXQuant 2-bit pack of deepseek-ai/DeepSeek-V4-Flash-0731 @ 7872f01b1d1fe23eabc4c98b48bffcef5a386062.

Converted on df-macstudio-m2 (Apple M2 Ultra, 192 GB) from the native FP8 0731 source (quant_method=fp8). Product class 2bit-experimental. Recipe: AXQuant manual deepseek-v4-experimental-2bit-v0.1.yaml (uniform 2-bit trunk). MTP sidecar is packaged (mtp.safetensors).

This is not the older DeepSeek-V4-Flash Hub pack. Do not treat AX-DeepSeek-V4-Flash-MLX-AXQ-2bit-MTP certificates as evidence for this 0731 revision.

Recipe (uniform v0.1)

This is the AXQuant assignment that scored best among 2-bit-class converts on the factory v-extract suite. Later mixed / attention-6 / shared-4-bit recipes scored worse and are not this pack.

Tensors Bits Method
Routed experts + MLP 2 affine, group 32
Attention 4 affine, group 32
Embeddings / routers 8 affine, group 32
Norms, LM head, MTP 16 bf16

Measured precision

Property Value
Target class 2bit-experimental
Measured main BPW 3.1328993873020314
Measured total BPW 3.2142055528774454
Weight bytes 122,212,298,775
Source deepseek-ai/DeepSeek-V4-Flash-0731@7872f01b1d1fe23eabc4c98b48bffcef5a386062
Convert host df-macstudio-m2
AXQuant 1.9.0

Claims

Claim Status
Converted on Studio from the pinned 0731 revision Yes
Official DSV4 chat_template.jinja In pack
Checkpoint Tier 1 (generation viability suite) Not certified — 7.1.5 native 15+15 combined 0.633; v-extract on AX Engine HEAD 80f2a3e6 combined 0.887 (floor 0.90). Distinct 2-bit recipe converts scored worse.
AX Engine 7.1.5 native load Passed on df-macstudio-m2 (Hub commit cb1a34b4, --stream-experts off, chat smoke Okay.)
Decode-128 (informational) 15.535 tok/s on 7.1.5; not a Tier 1 claim
MTP assets (mtp.safetensors) Packaged — Hub name uses -MTP
MTP acceleration Not certified (T1 below 0.90; MTP A/B not run)

Requires AX_ENGINE_2BIT_EXPERIMENTAL=1 for AX Engine native serve. Certificate: deepseek-v4-flash-0731-axq2-tier1.md. Comparison vs OptiQ 2-bit: optiq2-vs-axq2-v190.

Attribution

Base weights © DeepSeek. Quantization by AXQuant (development).

Downloads last month
776
Safetensors
Model size
38B params
Tensor type
BF16
·
F32
·
U32
·
I32
·
MLX
Hardware compatibility
Log In to add your hardware

2-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AutomatosX/AX-DeepSeek-V4-Flash-0731-MLX-AXQ-2bit-MTP

Quantized
(168)
this model

Collections including AutomatosX/AX-DeepSeek-V4-Flash-0731-MLX-AXQ-2bit-MTP