GitHub repository: Jovillios/longGPT
Description: Implementation of LongNet to scale sequence length beyond 1 billion tokens on nanoGPT fork