Hugging Face's logo

jesusriosal
/
vllm-demo

Safetensors
Model card Files
xet
 Community

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Demo: vLLM multi-tenant with sparse adapter support

Adapter Folder Type
lora1 lora1/ LoRA
lora2 lora2/ LoRA
sparta1 sparta1/ SpaRTA
sparta2 sparta2/ SpaRTA

Pre-trained base model: Qwen/Qwen2.5-0.5B

To download adapters 

git clone https://huggingface.co/jesusriosal/vllm-demo
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support