Before revision: Despite the widespread success of self-supervised learning via masked language models , learning representations directly from text to accurately capture complex and fine-grained semantic relationships in the biomedical domain remains as a challenge.
After revision: Despite the widespread success of self-supervised learning via masked language models (MLM), accurately capturing fine-grained semantic relationships in the biomedical domain remains as a challenge.