memory-transformer-xl (pypi): Memory Transformer-XL, a variant of Transformer-XL that uses linear attention update long term memory
Keywords: attention mechanism|artificial intelligence|transformer|deep learning|artificial-intelligence|attention-mechanism|deep-learning|memory