---
language:
- en
tags:
- fill-mask
- roberta
widget:
- text: "Polymerase <mask> Reaction"

---

# PMC pretrained RoBERTa large model
Pretrained on PMC fulltext paragraphs on masked language modeling task, it's mostly biology/ medical papers