GitHub repository: pgimenes/adaserve
Primary language: Python
Description: Adaptive Inference Serving Engine for Generative Language Models