GitHub repository: kp-forks/optillm
Primary language: Python
Description: Optimizing inference proxy for LLMs