GitHub repository: CerebrasResearch/cb_optillm
Primary language: Python
Description: Optimizing inference proxy for LLMs