language: en
tags:
- biomedical
- lexical-semantics
datasets:
- UMLS
[news] A cross-lingual extension of SapBERT will appear in the main onference of ACL 2021!
[news] SapBERT will appear in the conference proceedings of NAACL 2021!
SapBERT-PubMedBERT
SapBERT by Liu et al. (2020). Trained with UMLS 2020AA (English only), using microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext as the base model. Please use [CLS] as the representation of the input.
Citation
@article{liu2020self,
title={Self-alignment Pre-training for Biomedical Entity Representations},
author={Liu, Fangyu and Shareghi, Ehsan and Meng, Zaiqiao and Basaldella, Marco and Collier, Nigel},
journal={arXiv preprint arXiv:2010.11784},
year={2020}
}