GitHub repository: sgl-project/ome
Primary language: Go
Description: OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)