domenicrosati
commited on
Commit
•
29850c6
1
Parent(s):
8bafd36
Update README.md
Browse files
README.md
CHANGED
@@ -24,9 +24,8 @@ Cross-domain question answering!
|
|
24 |
|
25 |
## Training and evaluation data
|
26 |
|
27 |
-
|
28 |
-
|
29 |
-
|
30 |
|
31 |
## Training procedure
|
32 |
|
@@ -44,6 +43,8 @@ The following hyperparameters were used during training:
|
|
44 |
|
45 |
### Training results
|
46 |
|
|
|
|
|
47 |
|
48 |
|
49 |
### Framework versions
|
24 |
|
25 |
## Training and evaluation data
|
26 |
|
27 |
+
Training: BioASQ 10B with SQUAD sampled evenly to match the same samples as BioASQ 10B
|
28 |
+
Eval: BioASQ 9B Eval with SQUAD Eval sampled evenly to match the same samples as BioASQ 9B Eval
|
|
|
29 |
|
30 |
## Training procedure
|
31 |
|
43 |
|
44 |
### Training results
|
45 |
|
46 |
+
Went from untrained exact match: 60.9% (f1 71.8%) to exact match: 95.2% (96.6% f1) on BioASQ 9B held out training set.
|
47 |
+
Scores on SQUAD+BioASQ remained stable at exact match: 72.5% (f1 81.4%) to 88.5% (f1 93.3%).
|
48 |
|
49 |
|
50 |
### Framework versions
|