Before revision:  OuBioBERT, short for Bidirectional Encoder Representations from Transformers for Biomedical Text Mining by Osaka University, achieved the best score in terms of the BLUE benchmark . The total score is 1.1 points above that of BioBERT and 0.3 points above that of the ablated model trained without our proposed method.
After revision:  OuBioBERT, short for Bidirectional Encoder Representations from Transformers for Biomedical Text Mining by Osaka University, achieved the best score in terms of the BLUE benchmark were 0.3 points above that of the ablated model trained without our proposed method.