Question: How they introduce domain-specific features into pre-trained language model?
Answer: integrate clinical named entity information into pre-trained language model