mit-han-lab/streaming-llm: Efficient Streaming Language Models with Attention Sinks
Category: llm
Language: Python
Topics: attention, long-dialogue
Homepage: https://arxiv.org/abs/2309.17453