GitHub repository: microsoft/ParrotServe
Primary language: Python
Description: [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable