---
license: apache-2.0
---

license: apache-2.0
datasets:
	- ProteinKG25

	
# OntoProtein
[OntoProtein](https://openreview.net/pdf?id=yfe1VMYAXa4), the first general framework that makes use of structure in GO (Gene Ontology) into protein pre-training models. We construct a novel large-scale knowledge graph that consists of GO and its related proteins, and gene annotation texts or protein sequences describe all nodes in the graph. We propose novel contrastive learning with knowledge-aware negative sampling to jointly optimize the knowledge graph and protein embedding during pre-training.