Qwen3.8-2.4T-A95B-NVFP4

NVFP4 quantization of Qwen/Qwen3.8-2.4T-A95B. Routed experts in NVFP4 (group size 16): attention, linear attention, shared experts, router gates, embeddings, and lm_head keep their original precision. Text-only, 262144 native context extended to 1M using RoPE at serving time.

Downloads last month
114
Safetensors
Model size
1.3T params
Tensor type
BF16
ยท
U8
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for modal-labs/Qwen3.8-2.4T-A95B-NVFP4

Quantized
(33)
this model
Finetunes
1 model