GitHub repository: onlyrico/long-short-transformer
Description: Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch