leap-transformer (pypi): Linear Explainable Attention in Parallel (LEAP) for causal language modeling (also implements fastformer)
Keywords: linear|transformer|NLP|deep|learning|pytorch|additive-attention|attention-mechanism|deep-learning|dot-product-attention|linear-attention|local-attention|parallel|rnn|softmax|transformers