amindada commited on
Commit
4191f47
1 Parent(s): 8322644

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -4,4 +4,14 @@ This model is a medically continuously pre-trained version of [deepset/gbert-lar
4
 
5
  ## Training data
6
 
7
- The model was trained on German PubMed abstracts, translated English PubMed abstracts, and translated MIMIC-III reports.
 
 
 
 
 
 
 
 
 
 
 
4
 
5
  ## Training data
6
 
7
+ The model was trained on German PubMed abstracts, translated English PubMed abstracts, and translated MIMIC-III reports.
8
+
9
+ ## Evaluation
10
+
11
+ | Model | CLEF eHealth 2019 | | | RadQA | | GraSCCo | | | BRONCO150 | | | GGPONC 2.0 | | |
12
+ |------------------------------|-------------------|------|------|-------|------|---------|------|------|-----------|------|------|------------|------|------|
13
+ | | F1 | P | R | F1 | EM | F1 | P | R | F1 | P | R | F1 | P | R |
14
+ | [GBERT-base](https://huggingface.co/deepset/gbert-base) | .816 | .818 | .815 | .794 | .707 | .642 | .617 | .676 | .833 | .818 | .849 | .770 | .761 | .780 |
15
+ | [GBERT-large](https://huggingface.co/deepset/gbert-large) | .832 | .802 | .865 | .809 | .718 | .647 | .617 | .680 | .835 | .820 | .852 | .772 | .758 | .786 |
16
+ | GBERT-BioM-Translation-base | .825 | .851 | .801 | .808 | .716 | .661 | .642 | .681 | .842 | .824 | .861 | .780 | .766 | .794 |
17
+ | **GBERT-BioM-Translation-large** | .833 | .860 | .807 | .811 | .714 | .692 | .677 | .707 | .844 | .825 | .864 | .786 | .779 | .793 |