GitHub repository: llm-d/llm-d-inference-sim
Primary language: Go
Description: A light weight vLLM simulator, for mocking out replicas.