Before revision:  This implied learning some of the grammar of the language of life realized in protein sequences. The successful up-scaling of protein LMs through HPC to larger data sets slightly reduced the gap between models trained on evolutionary information and LMs. The official GitHub repository: URL
After revision:  This implied learning some of the grammar of the language of life . To facilitate future work, we released our models at URL