vLLM 0.22.1 required.

vllm serve --config vllm_config.yaml
Downloads last month
91
Safetensors
Model size
8B params
Tensor type
BF16
·
I32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ECE-ILAB/resilient-sur-v3-ILab

Quantized
(241)
this model