johngiorgi
commited on
Commit
•
c77ea61
1
Parent(s):
567dc7d
Update README.md
Browse files
README.md
CHANGED
@@ -2,7 +2,7 @@
|
|
2 |
|
3 |
## Model description
|
4 |
|
5 |
-
This is the [allenai/scibert_scivocab_uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) model, with extended pretraining on 2
|
6 |
|
7 |
## Intended uses & limitations
|
8 |
|
|
|
2 |
|
3 |
## Model description
|
4 |
|
5 |
+
This is the [allenai/scibert_scivocab_uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) model, with extended pretraining on over 2 million scientific papers from [S2ORC](https://github.com/allenai/s2orc/) using the self-supervised training strategy presented in [DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations](https://arxiv.org/abs/2006.03659).
|
6 |
|
7 |
## Intended uses & limitations
|
8 |
|