GLM-5.3 One-Spark
Collection
Original models and the reproducible single-DGX-Spark deployment package. • 5 items • Updated
GLM-5.3-Flash EXL3 2.05 — One DGX Spark
A reproducible, production-capable deployment of GLM-5.3-Flash on one NVIDIA DGX Spark, using:
- Turboderp's 2.05-bpw EXL3 checkpoint
- Inco AI's DFlash2 K7 drafter
- A TP1 ARM64/SM121 vLLM runtime derived from MiaAI's two-Spark recipe
64.1 tok/s structured C1 · 25.1 tok/s prose · 181.9 tok/s C4 active-stream aggregate · 262K context
This repository does not contain model weights
This is a deployment/runtime discovery page, not a new model or quant. The software, Docker recipe, benchmark harnesses, and raw evidence live in the linked GitHub repository. Target and draft weights download directly from their original publishers.
Measured results
One DGX Spark, TP1, EXL3 2.05 bpw, DFlash2 K7, FP8 KV, thinking disabled:
| Benchmark | Result |
|---|---|
| Structured C1, five-run median, temperature 0 | 64.053 tok/s |
| Structured C1, five-run median, temperature 1.0/top-p 0.95 | 62.637 tok/s |
| Open-ended prose, five-run median | 25.059 tok/s |
| C4 median active stream | 40.958 tok/s/stream |
| C4 summed active-stream convention | 181.944 tok/s |
| C4 strict submission-to-completion wall | 91.475 tok/s |
C4 disclosure: 181.944 tok/s is the sum of each stream's active decode rate, matching MiaAI's reporting convention. Because the current scheduler stages admission, strict full-batch wall throughput is 91.475 tok/s. Both numbers are published intentionally.
Long-context results
| Prompt | Cold prefill | Cold TTFT | Warm TTFT |
|---|---|---|---|
| 8K | 786.4 tok/s | 10.175 s | 1.775 s |
| 16K | 822.1 tok/s | 19.464 s | 2.786 s |
| 100K | 845.7 tok/s | 118.250 s | 8.842 s |
Every cold request had zero prefix-cache hits; every warm checksum response was correct.
Links
- GitHub source and instructions:
https://github.com/gitcommit90/glm-5.3-one-spark - Hugging Face Collection: https://huggingface.co/collections/gitcommit90/glm-53-one-spark-6a98b70df9981ae425acbc05
- Prebuilt ARM64 runtime image:
ghcr.io/gitcommit90/glm-5.3-one-spark:general23 - Target checkpoint: https://huggingface.co/turboderp/GLM-5.3-Flash-exl3/tree/2.05bpw
- DFlash2 checkpoint: https://huggingface.co/incoai/GLM-5.3-Flash-DFlash2
- Z.ai base model: https://huggingface.co/zai-org/GLM-5.3-Flash
Credits and licensing
The runtime is derived from Mia's AI Lab's MIT-licensed two-Spark recipe and substantially adapted for TP1, full-model 2.05-bpw mul1 EXL3, ARM64/SM121, and one-Spark memory limits.
Credits: Z.ai / GLM-5 Team, Turboderp and ExLlamaV3, Inco AI, Mia's AI Lab, and the vLLM contributors.
DFlash2 is CC BY-NC-ND 4.0 for research/evaluation. It is not bundled here. Commercial users must obtain appropriate licensing from Inco AI.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for gitcommit90/GLM-5.3-Flash-EXL3-2.05-One-Spark
Base model
zai-org/GLM-5.3-Flash