GitHub repository: LBANN/cb_optillm
Description: Optimizing inference proxy for LLMs