GitHub repository: Gurkenglas/x-transformers
Description: A simple but complete full-attention transformer with a set of promising experimental features from various papers