GitHub repository: microsoft/vattention
Primary language: C
Description: Dynamic Memory Management for Serving LLMs without PagedAttention