Update README.md
Browse files
README.md
CHANGED
|
@@ -12,4 +12,11 @@ This model is a medically continuously pre-trained version of [deepset/gbert-bas
|
|
| 12 |
|
| 13 |
## Training data
|
| 14 |
|
| 15 |
-
The model was trained on German PubMed abstracts, translated English PubMed abstracts, and translated MIMIC-III reports.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
## Training data
|
| 14 |
|
| 15 |
+
The model was trained on German PubMed abstracts, translated English PubMed abstracts, and translated MIMIC-III reports.
|
| 16 |
+
|
| 17 |
+
| Dataset | Tokens | Documents |
|
| 18 |
+
|------------|----------|-----------|
|
| 19 |
+
| German PubMed | 5M | 16K |
|
| 20 |
+
| PubMed | 1,700M | 21M |
|
| 21 |
+
| MIMIC-III | 695M | 24M |
|
| 22 |
+
| **Total** | **2,400M** | **45M** |
|