GitHub repository: qinguoyi/llmaz
Primary language: Go
Description: ☸️ Easy, advanced inference platform for large language models on Kubernetes