GitHub repository: onlyrico/rotary-embedding-torch
Primary language: Python
Description: Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch