GitHub repository: vllm-project/aibrix
Primary language: Go
Description: Cost-efficient and pluggable Infrastructure components for GenAI inference