semvec/pypi-packages huggingface dataset:
linformer-pytorch 0.19.3
An implementation of the Linformer in Pytorch
Keywords: transformers,attention,deep learning,artificial intelligence,sparse attention

# Linformer Pytorch Implementation
A practical implementation of the [Linformer paper](https://arxiv.org/pdf/2006.04768.pdf).

This is a self attention mechanism with linear time complexity in n.

Check out the github for more information: https://github.com/tatp22/linformer-pytorch