GitHub repository: mit-han-lab/duo-attention
Primary language: Python
Description: [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads