GitHub repository: Kyan820815/Linformer
Primary language: Python
Description: We implement a encoder/decoder seq2seq model, which has the same performance (similar perplexity) as traditional transformer but also reduce time complexity from O(n^2) to O(n).