Update README.md
Browse files
README.md
CHANGED
@@ -12,4 +12,11 @@ This model is a medically continuously pre-trained version of [deepset/gbert-bas
|
|
12 |
|
13 |
## Training data
|
14 |
|
15 |
-
The model was trained on German PubMed abstracts, translated English PubMed abstracts, and translated MIMIC-III reports.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
|
13 |
## Training data
|
14 |
|
15 |
+
The model was trained on German PubMed abstracts, translated English PubMed abstracts, and translated MIMIC-III reports.
|
16 |
+
|
17 |
+
| Dataset | Tokens | Documents |
|
18 |
+
|------------|----------|-----------|
|
19 |
+
| German PubMed | 5M | 16K |
|
20 |
+
| PubMed | 1,700M | 21M |
|
21 |
+
| MIMIC-III | 695M | 24M |
|
22 |
+
| **Total** | **2,400M** | **45M** |
|