GitHub repository: vectorch-ai/ScaleLLM
Primary language: C++
Description: A high-performance inference system for large language models, designed for production environments.