Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,15 @@
|
|
| 1 |
---
|
| 2 |
license: cc
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: cc
|
| 3 |
---
|
| 4 |
+
|
| 5 |
+
# Bio-ELECTRA Base 1m (cased)
|
| 6 |
+
|
| 7 |
+
Pretrained (from scratch) ELECTRA model on 2021 Base PubMed abstracts with a domain specific word piece vocabulary generated using SentencePiece
|
| 8 |
+
byte-pair-encoding (BPE) model from PubMed abstract texts. This model is case-sensitive: it makes a difference between english and English.
|
| 9 |
+
|
| 10 |
+
|
| 11 |
+
# Intended uses & limitations
|
| 12 |
+
This model is mostly intended to be fine-tuned on a downstream biomedical domain task.
|
| 13 |
+
|
| 14 |
+
Note that this model is primarily aimed at being fine-tuned on tasks that use the whole sentence to
|
| 15 |
+
make decisions, such as classification, information retrieval, relation extraction or question answering.
|