GitHub repository: Fyphen1223/PowerInfer
Description: High-speed Large Language Model Serving on PCs with Consumer-grade GPUs