YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Recipe:
Main model:
Routed Expert Projections - NVFP4 (calibrated, with input scales for A4)
Attention Projections: MXFP8
Shared Experts: MXFP8
MTP:
Routed Expert Projections - NVFP4 (A16 only)
Attention Projections: MXFP8
Shared Experts: MXFP8
KLD: ~0.04
Evals to follow.
Should be used with https://github.com/local-inference-lab/vllm/tree/dev/jovian-judgement
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support