GitHub repository: selalipop/aphrodite-engine
Primary language: Python
Description: Large-scale LLM inference engine