Add SGLang serving instructions
#2
by sh-25 - opened
Updates this PR to document the validated SGLang DFlash configuration for
text-only serving with nvidia/Muse-Glimmer-30B-NVFP4.
Validation:
- SGLang 0.0.0.dev1+g4358a1617 on one NVIDIA Blackwell B200 GPU
- Chat, streaming, reasoning parser, and tool-call parser smoke tests passed
- Full GSM8K: 1319/1319 examples, 96.21% accuracy, 0 request errors,
and 0 truncated responses - Fixed random benchmark used 1024 input and 256 output tokens, with two
discarded warmups and three formal repetitions at concurrency 1, 16,
and 64
GSM8K used high reasoning, temperature 1.0, top-p 0.95, and seed 42.
sgl-eval 0.1.1 did not expose a top-k option.