GitHub repository: sgl-project/genai-bench
Primary language: Python
Description: Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.