GitHub repository: theodoreniu/llmperf
Primary language: Python
Description: Benchmarking tool for stress testing self-hosted LLMs, Azure OpenAI, and OpenAI APIs. Measure latency, throughput, and optimize performance. 🚀