RadixArk/GLM-5.3-Flash-NVFP4

Model Overview

Description:

The RadixArk GLM-5.3-Flash-NVFP4 model is a quantized version of zai-org/GLM-5.3-Flash-BF16, pinned to source revision a6c167b6. RadixArk converted the 300B-class hybrid Mixture-of-Experts model to mixed-precision NVFP4 W4A4 using NVIDIA Model Optimizer. The conversion uses plain abs-max scaling with 256 tensor-scale normalization.

Run on SGLang: use the launch command below and see the GLM-5.3-Flash cookbook for deployment guidance.

Third-Party Community Consideration

This model is not owned or developed by RadixArk. It is a quantized derivative of Z.ai's model; see the upstream GLM-5.3-Flash-BF16 model card for the source model's capabilities, training information, and license.

License/Terms of Use:

MIT License

Deployment Geography:

Global

Use Case:

Developers looking to deploy an off-the-shelf, pre-quantized multimodal model for agentic engineering, coding, long-context reasoning, tool use, chat, and other AI-powered applications.

Release Date:

Hugging Face 08/28/2026 via https://huggingface.co/RadixArk/GLM-5.3-Flash-NVFP4

Model Architecture:

Architecture Type: Transformer (hybrid-attention sparse Mixture-of-Experts, natively multimodal)
Network Architecture: GLM-5.3-Flash — 45 language-model layers comprising 3 dense MLP layers and 42 MoE layers, 288 routed experts per MoE layer, a shared expert, KDA linear attention, DSA sparse attention with an indexer, MLA, manifold-constrained hyper-connections, a vision encoder, and a native MTP/NextN draft layer
Number of Model Parameters: 320B total, 18B activated per token

Input:

Input Type(s): Text, image, and video
Input Format(s): String and visual media
Other Properties Related to Input: Native context length up to 1,048,576 tokens.

Output:

Output Type(s): Text
Output Format: String

Software Integration:

Supported Runtime Engine(s):

• SGLang
  

Supported Hardware Microarchitecture Compatibility:

• NVIDIA Blackwell (validated on 4x GB300)
  

Preferred Operating System(s):

• Linux
  

Model Version(s):

Source: zai-org/GLM-5.3-Flash-BF16, revision a6c167b6.
Quantized with NVIDIA Model Optimizer 0.46.0, commit 43fd41a58d52c4e6e5dec1d1ff5989ecc737ae1a.

Training, Testing, and Evaluation Datasets:

Calibration Data:

Calibration used 1,024 samples from the abisee/cnn_dailymail training split with sequence length 512 and batch size 1.

Training Dataset:

RadixArk did not train or fine-tune this checkpoint. Training information is inherited from the upstream GLM-5.3-Flash-BF16 model card.

Evaluation Dataset:

This checkpoint was evaluated on GSM8K, AIME 2026, and Terminal-Bench 2.1.

Post Training Quantization

The checkpoint uses plain abs-max NVFP4 W4A4 quantization with 256 tensor-scale normalization and group size 16. The quantized scope contains 36,423 NVFP4 bases: the gate_proj, up_proj, and down_proj tensors for all routed experts in 42 MoE layers (288 experts per layer), each shared expert, and the dense MLPs in layers 0-2.

All attention components (KDA, the DSA indexer, and MLA), hyper-connections, normalization layers, BF16 router weights and FP32 correction biases, the vision tower, the MTP/NextN layer, embeddings, and the language-model head remain at source precision. The checkpoint does not quantize the KV cache. Both FP8 (fp8_e4m3) KV cache with TRT-LLM DSA backends and BF16 KV cache with TileLang DSA backends are validated serving pairings; the recipe below defaults to FP8 KV with TRT-LLM DSA (roughly 1.8x KV token capacity), while BF16 KV with TileLang remains an alternative.

The checkpoint audit found 2,347 unchanged tensors content-identical to the pinned source; the checkpoint index independently contains all 889 MTP (layer-45) tensors. All scale values are finite and positive (range 3.49e-05 to 256.0). Full audit evidence is included in tensor-audit-b.json and precision-contract-b.json.

Usage

Use the official SGLang GLM-5.3-Flash image and the following four-GPU configuration:

docker pull lmsysorg/sglang:glm-5.3-flash

docker run --gpus all \
  --shm-size 32g \
  -p 30000:30000 \
  -v ~/.cache/huggingface:/root/.cache/huggingface \
  --env "HF_TOKEN=<your-token>" \
  --ipc=host \
  lmsysorg/sglang:glm-5.3-flash \
  python3 -m sglang.launch_server \
    --model-path RadixArk/GLM-5.3-Flash-NVFP4 \
    --quantization modelopt_fp4 \
    --tp-size 4 \
    --dsa-prefill-backend trtllm \
    --dsa-decode-backend trtllm \
    --kv-cache-dtype fp8_e4m3 \
    --moe-runner-backend flashinfer_cutlass \
    --speculative-algorithm NEXTN \
    --speculative-num-steps 5 \
    --speculative-eagle-topk 1 \
    --speculative-num-draft-tokens 6 \
    --speculative-adaptive \
    --reasoning-parser glm45 \
    --tool-call-parser glm47 \
    --host 0.0.0.0 \
    --port 30000

For other deployment topologies and hardware-specific configurations, see the SGLang GLM-5.3-Flash cookbook.

Evaluation

The benchmark results below were produced with this NVFP4 checkpoint and must not be interpreted as results from a different quantization variant.

Benchmark	Evaluation protocol	Score	Per-seed range	Stop rate
GSM8K	Full 1,319-example split x 4 seeds; temperature=1.0, top_p=0.95, max_tokens=32768	97.14%	96.89%-97.42%	99.85%-100%
AIME 2026	30 problems x 16 repeats x 4 seeds (1,920 generations); temperature=1.0, top_p=0.95, max_tokens=131072	92.45%	91.67%-93.54%	94.58%-96.04%
Terminal-Bench 2.1	89 tasks, terminus-2 agent, effort max, pass@1; temperature=1.0, top_p=0.95, max_tokens=32768	83.1% (74/89)	-	-

For AIME 2026, generated-token percentiles (total output tokens; this harness does not split reasoning from answer tokens) were p50 8,696 and p90 53,342. The reported evaluations were text-only.

Terminal-Bench 2.1 was run on the terminal-bench-2-1 dataset (revision 7d7bdc1c) with concurrency 32 and task deadlines disabled (capability-first). Two tasks (qemu-alpine-ssh, qemu-startup) could not run because they require KVM, which was unavailable on the evaluation runner. Two trials (extract-moves-from-video, regex-chess) did not finish within the evaluation window, so the reported numerator can only rise. The Terminal-Bench 2.1 run was served with SGLang on 4x GB300 (TP4) using FP8 (fp8_e4m3) KV cache with TRT-LLM DSA attention backends, flashinfer_cutlass MoE, and NEXTN speculative decoding.

Model Limitations:

Quantization can change model outputs relative to the source checkpoint. The base model may generate inaccurate, incomplete, irrelevant, biased, or otherwise undesirable responses. Developers should evaluate this checkpoint under their intended prompts, modalities, context lengths, sampling settings, and serving configuration, and apply appropriate safeguards.

Ethical Considerations

RadixArk believes trustworthy AI is a shared responsibility. Developers should ensure that use of this model complies with the upstream license and meets the safety, privacy, security, and reliability requirements of their application.