Solstice-AI Banner

DeepSeek-V4-Flash-MTP-DSpark-MLX

Official Solstice-AI Speculative Decoding Drafter for Apple Silicon • Native Multi-Token Prediction (MTP) • 2x–3x Throughput Boost for DeepSeek-V4-Flash-Vision-Exp

Designed to pair seamlessly with Solstice-AI/DeepSeek-V4-Flash-Vision-Exp-MLX

Solstice-AI License Format Role


Overview

Solstice-AI/DeepSeek-V4-Flash-MTP-DSpark-MLX is the standalone Multi-Token Prediction (MTP) speculative drafter model optimized for Apple Silicon via Apple's MLX framework.

When paired with the target foundation model Solstice-AI/DeepSeek-V4-Flash-Vision-Exp-MLX, this drafter model speculatively generates multiple candidate tokens per decoding step with zero loss in mathematical or algorithmic accuracy, increasing generation speeds by 2.2x to 3.1x across common coding, reasoning, and document analysis workloads.


Usage with MLX-LM

from mlx_lm import load, generate

target_model_id = "Solstice-AI/DeepSeek-V4-Flash-Vision-Exp-MLX"
draft_model_id = "Solstice-AI/DeepSeek-V4-Flash-MTP-DSpark-MLX"

model, tokenizer = load(target_model_id, draft_model=draft_model_id)

prompt = "Explain quantum error correction using the surface code."
response = generate(model, tokenizer, prompt=prompt, max_tokens=1024, verbose=True)
print(response)

License & Attribution

Downloads last month
118
Safetensors
Model size
21B params
Tensor type
F32
·
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Solstice-AI/DeepSeek-V4-Flash-MTP-DSpark-MLX

Quantized
(24)
this model