GitHub repository: ridwan-salau/transformer-xl
Primary language: Python
Description: Fully Sharded Data Parallel (FSDP) implementation of Transformer XL