GitHub repository: FerranAgulloLopez/vLLMBatchingMemoryGap
Primary language: Python
Description: Fork of vLLM for developing the paper "Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference"