OpensourceWTF/Qwen3.8-Flash-Next-MTPLX-oQ4-MTP

Qwen3.8 Flash-Next MLX oQ4 + MTP for MTPLX

This repository republishes the unchanged model artifacts from Vontra/Qwen3.8-Flash-Next-MLX-oQ4-MTP at source revision 43a82b3f0ff64fa417fd09ca046580f08d19b0d6, together with MTPLX validation metadata and guarded run receipts.

No tensor was quantized, requantized, or repacked for this upload. Target MoEs and the embedded MTP MoEs remain resident through the normal MLX runner. Only ngram lookups use MTPLX's bounded exact-row SSD cache. The published ngram tensors retain the source-native affine Q4/group-32 storage.

MTPLX runtime

Implementation and review are in youssofal/MTPLX#368. The ngram cache has a configurable 10 GiB payload ceiling. Construction measures base residency once and selects the smaller safe payload after reserving KV/MTP, Metal working memory, safety margin, metadata, hash/route tables, alignment, and transient buffers. LRU eviction affects residency only; SSD rows remain authoritative. The server reserves its selected context and the full supported live prefill-chunk range before MLX load. Cache slots use a packed O(1) free chain/linked LRU, and each acquisition submits one bounded I/O task.

Guarded validation

Validated on Apple M5 Max unified memory through the canonical /tmp/mtplx-gpu-exclusive.lock wrapper:

Workload	Result
Prompt tokens	16,384
Generated tokens	1,024 exactly
MTP accepted by depth	[241, 126, 58]
Prefill	396.594 tok/s
Decode	27.186 tok/s
Wall time	102.297 s
Measured base residency	80,435,213,384 bytes
Selected ngram payload	1,677,721,600 bytes
Ngram cache overhead	892,502,016 bytes
KV/MTP reserve	637,046,792 bytes
Projected residency	87,937,451,088 bytes
Peak memory	85,222,315,432 bytes (79.37 GiB)
Runtime target	88,046,829,568 bytes (82 GiB)

The generated completion token hash is 4d876b2e83ed4f4ab63027955b3d7b5494200d837564c7077791927d69e8695f. Raw smoke and 16K/1K receipts are included under receipts/.

Download

mtplx pull OpensourceWTF/Qwen3.8-Flash-Next-MTPLX-oQ4-MTP

mtplx pull finalizes the manifest-backed ngram source files read-only so the retained-descriptor verifier can install the exact SSD row lane. Use the model with the Qwen4 path from MTPLX PR #368. Real MLX execution on the validation host was performed only through the canonical exclusive GPU guard.

Provenance

• Source repository: Vontra/Qwen3.8-Flash-Next-MLX-oQ4-MTP
• Source revision: 43a82b3f0ff64fa417fd09ca046580f08d19b0d6
• MTPLX receipt commit: 446c95f651663c390097bf05e09c7a66045756df
• Safetensor shards: 22
• Artifact bytes measured locally: 113,324,747,928
• Source files matching the pinned revision by size and Hub blob identity: 33
• Destination-only MTPLX manifest/validation/receipt files: 7

All 22 safetensor shards and the remaining source model/config files match the pinned source revision. The only source-named metadata differences are this MTPLX model card and Hub-generated .gitattributes.

See MTPLX_VALIDATION.json for machine-readable provenance and metrics.