Before revision:  The total score is 1.0 points above that of BioBERT  .
After revision:  The total score is 1.0 points above that of BioBERT and 0.3 points above that of the ablated model trained without our proposed method. This proposed technique is an effective approach to develop localized medical BERT models and to enhance domain-specific models in the biomedical domain .