GitHub repository: 4paradigm/llm-perf-bench
Primary language: Python
Description: This is a benchmarking tool to help evaluate the performance of a given LLM and hardware platform.