GitHub repository: mit-han-lab/streaming-llm
Primary language: Python
Description: [ICLR 2024] Efficient Streaming Language Models with Attention Sinks