GitHub repository: yinfan98/lmdeploy
Primary language: C++
Description: LMDeploy is a toolkit for compressing, deploying, and serving LLMs.