GitHub repository: vhive-serverless/vllm
Primary language: Python
Description: A customized vllm repo that supports running on multiple devices within one process