GitHub repository: skyvense/llm-fw
Primary language: Go
Description: A framework for managing and monitoring Large Language Model (LLM) services. It provides a unified interface for handling model requests, collecting metrics, and exposing API endpoints to access these functionalities.