GitHub repository: kyegomez/ShallowFF
Primary language: Python
Created: 2023-11-20T03:49:14Z
Description: Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"