GitHub repository: leexcape/LLM-Latency-Profiler
Primary language: Python
Created: 2025-04-23T00:19:19Z
Description: A lightweight benchmarking tool for Hugging Face LLMs using AutoModelForCausalLM. Measures generation latency, tokens per second, and captures device + model metadata across diverse hardware (CPU, GPU, Jetson, Raspberry Pi, etc.). Results are saved in timestamped JSON logs for easy comparison and analysis.