GitHub repository: noelo/vllm-router-demo
Primary language: Python
Created: 2024-10-19T09:43:47Z
Description: OpenWebUI + LiteLLM + SemanticRouter + vLLM -> LLM semantic routing demo with Lora