ai-forever
commited on
Commit
•
0c7ce6f
1
Parent(s):
73e9211
Update README.md
Browse files
README.md
CHANGED
@@ -14,11 +14,12 @@ tags:
|
|
14 |
|
15 |
# BERT base uncased model pre-trained on 5 NER datasets
|
16 |
|
17 |
-
Model was trained by
|
|
|
|
|
18 |
* Task: `NER`
|
19 |
* Training Data is 5 datasets: [CoNLL-2003](https://aclanthology.org/W03-0419.pdf), [WNUT17](http://noisy-text.github.io/2017/emerging-rare-entities.html), [JNLPBA](http://www.geniaproject.org/shared-tasks/bionlp-jnlpba-shared-task-2004), [CoNLL-2012 (OntoNotes)](https://aclanthology.org/W12-4501.pdf), [BTC](https://www.derczynski.com/papers/btc.pdf)
|
20 |
|
21 |
|
22 |
-
The pretraining process and technical details are described [in this article](https://habr.com/ru/company/sberbank/blog/).
|
23 |
|
24 |
-
|
|
|
14 |
|
15 |
# BERT base uncased model pre-trained on 5 NER datasets
|
16 |
|
17 |
+
Model was trained by _SberIDP_. The pretraining process and technical details are described [in this article](https://habr.com/ru/company/sberbank/blog/).
|
18 |
+
|
19 |
+
|
20 |
* Task: `NER`
|
21 |
* Training Data is 5 datasets: [CoNLL-2003](https://aclanthology.org/W03-0419.pdf), [WNUT17](http://noisy-text.github.io/2017/emerging-rare-entities.html), [JNLPBA](http://www.geniaproject.org/shared-tasks/bionlp-jnlpba-shared-task-2004), [CoNLL-2012 (OntoNotes)](https://aclanthology.org/W12-4501.pdf), [BTC](https://www.derczynski.com/papers/btc.pdf)
|
22 |
|
23 |
|
|
|
24 |
|
25 |
+
The model is pretrained for NER task using [Reptile](https://openai.com/blog/reptile/) and can be finetuned for new entities with only a small amount of samples.
|