GitHub repository: Emerging-AI/ENOVA
Primary language: Python
Description: A deployment, monitoring and autoscaling service towards serverless LLM serving.