GitHub repository: Beomi/InfiniTransformer
Primary language: Python
Created: 2024-04-12T08:55:58Z
Description: Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention