GitHub repository: AlongWY/Nanoflow
Primary language: Cuda
Description: A throughput-oriented high-performance serving framework for LLMs