File size: 605 Bytes
bdf3ec5 3114e01 bdf3ec5 3114e01 bdf3ec5 3114e01 bdf3ec5 3114e01 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
language:
- en
tags:
- question-answering
- qa
license: "apache-2.0"
datasets:
- squad
metrics:
- squad
---
# Description
Trained on the SQuAD v1.1 dataset from the MRQA Shared Task. The public dev set was divided into two: one for dev and one for test.
# Dev results:
"eval_exact_match": 88.15914715400723,
"eval_f1": 93.91715796563734,
"eval_samples": 5291
# Test results:
"test_exact_match": 86.52455272173582,
"test_f1": 92.92134442432088
"predict_samples": 5294
More info in the paper:
**MetaQA: Combining Expert Agents for Multi-Skill Question Answering**
https://arxiv.org/abs/2112.01922 |