GitHub repository: matheus-rech/lmdeploy
Description: LMDeploy is a toolkit for compressing, deploying, and serving LLMs.