GitHub repository: powerserve-project/PowerServe
Primary language: C++
Description: High-speed and easy-use LLM serving framework for local deployment