GitHub repository: CentML/flexible-inference-bench
Primary language: Python
Description: A modular, extensible LLM inference benchmarking framework that supports multiple benchmarking frameworks and paradigms.