GitHub repository: thu-pacman/chitu
Primary language: Python
Description: High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.