Before revision:  In this paper, we introduce a novel BERT-wise pre-training scheme for a protein sequence representation model called PLUS, which stands for Protein sequence representations Learned Using Structural information.
After revision:  In this paper, we introduce a novel pre-training scheme for a protein sequence representation model called PLUS, which stands for Protein sequence representations Learned Using Structural information.