GitHub repository: mahdi-shafiei/optillm
Primary language: Python
Description: Optimizing inference proxy for LLMs