GitHub repository: key4ng/genai-bench
Primary language: Python
Description: Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.