GitHub repository: syncdoth/RetNet
Primary language: Jupyter Notebook
Created: 2023-07-19T06:56:38Z
Description: Huggingface compatible implementation of RetNet (Retentive Networks, https://arxiv.org/pdf/2307.08621.pdf) including parallel, recurrent, and chunkwise forward.