GitHub repository: sammcj/optillm
Primary language: Python
Description: Optimizing inference proxy for LLMs