Not working on dgx spark with vllm
Not working on dgx spark with vllm
FLASHINFER_TRTLLM (trtllm-gen) is SM100-only (datacenter B100/B200). On your SM120 RTX PRO 6000, is_supported_config() returns False and it gets eliminated.
No backends remain → NotImplementedError.
Note that FLASHINFER_CUTLASS does support both the SwiGLU clamp and SM120 — but it's simply missing from the NVFP4_BACKENDS_WITH_CLAMP set.
Fix Status
Artifact Status
PR #41834(opens in new tab) — adds FLASHINFER_CUTLASS to the clamp set + full SM12x enablement for DeepSeek V4 Flash Still open (needs rebase, last updated June 1, 2026)
PR #42209(opens in new tab) — NVFP4 MoE support for DeepSeek V4 (merged May 22, 2026) Merged, but didn't fix the clamp-set issue
Same issue. Have 2x DGX Spark clustered
It is better to use dspark version