GitHub repository: justinwlin/worker-vllm
Primary language: Python
Description: The RunPod worker template for serving our large language model endpoints. Powered by vLLM.