GitHub repository: lucidrains/long-short-transformer
Primary language: Python
Created: 2021-07-07T16:20:44Z
Description: Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch