GitHub repository: ml4oncology/ml4o-inference
Primary language: Python
Description: Efficient LLM inference on Slurm clusters using vLLM.