Before revision: Bidirectional Encoder Representations from Transformers (BERT) models for biomedical specialties such as BioBERT and clinicalBERT  have significantly improved in biomedical text-mining tasks and enabled us to extract valuable information from biomedical literature .
After revision: Bidirectional Encoder Representations from Transformers (BERT) models for biomedical specialties such as BioBERT and clinicalBERT , have significantly improved in biomedical text-mining tasks and enabled us to extract valuable information from biomedical literature .