GitHub repository: orca-zhang/vllm-rocm
Primary language: Python
Description: FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs