GitHub repository: EmbeddedLLM/vllm-rocm
Primary language: Python
Description: ROCm-enabled vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs