Before revision: Bidirectional Encoder Representations from Transformers (BERT) models for biomedical specialties such as BioBERT and clinicalBERT  have significantly improved in biomedical text-mining tasks and enabled us to extract valuable information from biomedical literature .
After revision: Bidirectional Encoder Representations from Transformers (BERT) models for biomedical specialties such as BioBERT and clinicalBERT have significantly improved in performing biomedical text mining tasks and have enabled extracting valuable information from biomedical literature .