GitHub repository: orlevii/llm-server-benchmark
Created: 2024-06-22T18:18:37Z
Description: Simple latency benchmark to run against any OpenAI compatible server