|
--- |
|
tags: |
|
- multilingual |
|
datasets: |
|
- xquad |
|
--- |
|
|
|
# bert-base-multilingual-uncased for multilingual QA |
|
|
|
# Overview |
|
**Language Model**: bert-base-multilingual-uncased \ |
|
**Downstream task**: Extractive QA \ |
|
**Training data**: [XQuAD](https://github.com/deepmind/xquad) \ |
|
**Testing Data**: [XQuAD](https://github.com/deepmind/xquad) |
|
|
|
# Hyperparameters |
|
|
|
```python |
|
batch_size = 48 |
|
n_epochs = 6 |
|
max_seq_len = 384 |
|
doc_stride = 128 |
|
learning_rate = 3e-5 |
|
``` |
|
|
|
# Performance |
|
|
|
Evaluated on held-out test set from XQuAD |
|
```python |
|
"exact_match": 64.6067415730337, |
|
"f1": 79.52043478874286, |
|
"test_samples": 2384 |
|
``` |
