GitHub repository: tomaarsen/attention_sinks
Primary language: Python
Created: 2023-10-02T14:51:55Z
Description: Extend existing LLMs way beyond the original training length with constant memory usage, without retraining