GitHub repository: zyearw1024/ant-lmdeploy
Primary language: Python
Description: LMDeploy is a toolkit for compressing, deploying, and serving LLMs.