alon-albalak
commited on
Commit
•
6ead330
1
Parent(s):
91d5145
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,26 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# bert-base-multilingual-uncased for multilingual QA
|
2 |
+
|
3 |
+
# Overview
|
4 |
+
**Language Model**: bert-base-multilingual-uncased \
|
5 |
+
**Downstream task**: Extractive QA \
|
6 |
+
**Training data**: [XQuAD](https://github.com/deepmind/xquad)\
|
7 |
+
**Testing Data**: [XQuAD](https://github.com/deepmind/xquad)
|
8 |
+
|
9 |
+
# Hyperparameters
|
10 |
+
|
11 |
+
```python
|
12 |
+
batch_size = 48
|
13 |
+
n_epochs = 6
|
14 |
+
max_seq_len = 384
|
15 |
+
doc_stride = 128
|
16 |
+
learning_rate = 3e-5
|
17 |
+
```
|
18 |
+
|
19 |
+
# Performance
|
20 |
+
|
21 |
+
Evaluated on held-out test set from XQuAD
|
22 |
+
```python
|
23 |
+
"exact_match": 64.6067415730337,
|
24 |
+
"f1": 79.52043478874286,
|
25 |
+
"test_samples": 2384
|
26 |
+
```
|