GitHub repository: zhangce/FlexGen
Description: Throughput-oriented systems for large language models on commodity GPUs.