GitHub repository: oben01/benchmark_llm_serving
Description: A tool to benchmark LLMs via their API exposure. For the moment, it is vLLM oriented