GitHub repository: microsoft/vidur
Primary language: Python
Description: A large-scale simulation framework for LLM inference