GitHub repository: seal-rg/recurrent-pretraining
Primary language: Python
Description: Pretraining code for a large-scale depth-recurrent language model