GitHub repository: rotationalio/llm-benchmark
Primary language: Python
Description: An LLM inferencing benchmark tool focusing on device-specific latency and memory usage