GitHub repository: leexcape/Llamacpp-Latency-Profiler
Primary language: Python
Description: A lightweight benchmarking tool for llama.cpp based transformer models. Measures generation latency, tokens per second, and captures device + model metadata across diverse hardware (CPU, GPU, Jetson, Raspberry Pi, etc.). Results are saved in timestamped JSON logs for easy comparison and analysis.