GitHub repository: juvi21/retnet-torch
Primary language: Python
Created: 2023-08-16T19:14:24Z
Description: Strongly typed implementation of the Paper " Retentive Network: A Successor to Transformer for Large Language Models" in Pytorch. https://arxiv.org/pdf/2307.08621.pdf