Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Rembert Squad2
|
| 2 |
+
This model is finetuned for QA task on Squad2 from [Rembert checkpoint](https://huggingface.co/google/rembert).
|
| 3 |
+
|
| 4 |
+
## Hyperparameters
|
| 5 |
+
```
|
| 6 |
+
Batch Size: 4
|
| 7 |
+
Grad Accumulation Steps = 8
|
| 8 |
+
Total epochs = 3
|
| 9 |
+
MLM Checkpoint = "rembert"
|
| 10 |
+
max_seq_len = 256
|
| 11 |
+
learning_rate = 1e-5
|
| 12 |
+
lr_schedule = LinearWarmup
|
| 13 |
+
warmup_ratio = 0.1
|
| 14 |
+
doc_stride = 128
|
| 15 |
+
```
|
| 16 |
+
|
| 17 |
+
## Squad 2 Evaluation stats:
|
| 18 |
+
|
| 19 |
+
Metrics generated from [the official Squad2 evaluation script](https://worksheets.codalab.org/rest/bundles/0x6b567e1cf2e041ec80d7098f031c5c9e/contents/blob/)
|
| 20 |
+
```json
|
| 21 |
+
{
|
| 22 |
+
"exact": 84.51107554956624,
|
| 23 |
+
"f1": 87.46644042781853,
|
| 24 |
+
"total": 11873,
|
| 25 |
+
"HasAns_exact": 80.97165991902834,
|
| 26 |
+
"HasAns_f1": 86.89086491219469,
|
| 27 |
+
"HasAns_total": 5928,
|
| 28 |
+
"NoAns_exact": 88.04037005887301,
|
| 29 |
+
"NoAns_f1": 88.04037005887301,
|
| 30 |
+
"NoAns_total": 5945
|
| 31 |
+
}
|
| 32 |
+
```
|