File size: 504 Bytes
fd18680
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
Dataset Size: 204416 Examples from squadv2 and NQ dataset

Trained for 1 epoch on TPU

Accuracy on Squadv2 dev

  {'exact': 76.2402088772846,
   'f1': 79.42257205291492,
   'total': 11873,
   'HasAns_exact': 79.97638326585695,
   'HasAns_f1': 86.35023582730433,
   'HasAns_total': 5928,
   'NoAns_exact': 72.51471825063078,
   'NoAns_f1': 72.51471825063078,
   'NoAns_total': 5945,
   'best_exact': 76.2402088772846,
   'best_exact_thresh': 0.0,
   'best_f1': 79.42257205291494,
   'best_f1_thresh': 0.0}