GitHub repository: rohan-uiuc/llm-inference
Primary language: Python
Description: Efficient LLM inference on Slurm clusters using vLLM.