GitHub repository: lantel-wm/llm-bench
Primary language: Python
Description: Static benchmark for vLLM and serving benchmark for vLLM and PPL.