semvec/pypi-packages huggingface dataset:
retnet-torch 0.0.1
Strongly typed implementation of the Paper "Retentive Network: A Successor to Transformer for Large Language Models" in Pytorch.
License: MIT
Keywords: retnet,retention,pytorch

# retnet-torch
Strongly typed implementation of the Paper "Retentive Network: A Successor to Transformer for Large Language Models" in Pytorch. https://arxiv.org/pdf/2307.08621.pdf

WORK IN PROGRESS BETTER README SOON