File size: 504 Bytes
fd18680 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
Dataset Size: 204416 Examples from squadv2 and NQ dataset
Trained for 1 epoch on TPU
Accuracy on Squadv2 dev
{'exact': 76.2402088772846,
'f1': 79.42257205291492,
'total': 11873,
'HasAns_exact': 79.97638326585695,
'HasAns_f1': 86.35023582730433,
'HasAns_total': 5928,
'NoAns_exact': 72.51471825063078,
'NoAns_f1': 72.51471825063078,
'NoAns_total': 5945,
'best_exact': 76.2402088772846,
'best_exact_thresh': 0.0,
'best_f1': 79.42257205291494,
'best_f1_thresh': 0.0} |