GitHub repository: EmbeddedLLM/vllm-0.1.4-rocm
Description: ROCm-enabled vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs