GitHub repository: nagyist/aibrix
Primary language: Go
Description: Cost-efficient and pluggable Infrastructure components for GenAI inference