YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

WIP model using LUT-B compression pathways on mlp layers, not yet supported in vllm

Downloads last month
-
Safetensors
Model size
5B params
Tensor type
BF16
F8_E4M3
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support