Before revision:  Results: The results of training these LMs on proteins was assessed by predicting secondary structure in three- and eight-states ( Q3= 75-83, Q8= 63-72), localization for 10 cellular compartments (Q10=74) and whether a protein is membrane-bound or water-soluble (Q2=89).
After revision:  Results: The results of training these LMs on proteins was assessed by predicting secondary structure in three- and eight-states ( Q3= 75-83, Q8= 65-73), sub-cellular localization for 10 cellular compartments (Q10=74) and whether a protein is membrane-bound or water-soluble (Q2=89).