GitHub repository: kyegomez/LongNet
Primary language: Python
Created: 2023-07-06T11:03:05Z
Description: Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"