GitHub repository: kyegomez/SparseAttention
Primary language: Python
Created: 2023-10-25T04:47:58Z
Description: Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"