GitHub repository: yazon/flexllama
Primary language: Python
Description: 🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GPU support