Jev2 vision โ€” FP8 dynamic W8A8

Quantized from bqbbao6/b-jev with LLM Compressor FP8_DYNAMIC on Linear layers. lm_head stays in its original dtype because Jev derives scores from the logprob difference of two decision tokens. The Jev request schema and serving code are copied from the source export. Use the vLLM comparison script in quantize_jev to validate both text and image requests.

Downloads last month
-
Safetensors
Model size
2B params
Tensor type
BF16
ยท
F8_E4M3
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for bqbbao6/b-jev-fp8

Base model

Qwen/Qwen2-VL-2B
Finetuned
bqbbao6/b-jev
Quantized
(2)
this model