alon-albalak commited on
Commit
6ead330
1 Parent(s): 91d5145

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -0
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # bert-base-multilingual-uncased for multilingual QA
2
+
3
+ # Overview
4
+ **Language Model**: bert-base-multilingual-uncased \
5
+ **Downstream task**: Extractive QA \
6
+ **Training data**: [XQuAD](https://github.com/deepmind/xquad)\
7
+ **Testing Data**: [XQuAD](https://github.com/deepmind/xquad)
8
+
9
+ # Hyperparameters
10
+
11
+ ```python
12
+ batch_size = 48
13
+ n_epochs = 6
14
+ max_seq_len = 384
15
+ doc_stride = 128
16
+ learning_rate = 3e-5
17
+ ```
18
+
19
+ # Performance
20
+
21
+ Evaluated on held-out test set from XQuAD
22
+ ```python
23
+ "exact_match": 64.6067415730337,
24
+ "f1": 79.52043478874286,
25
+ "test_samples": 2384
26
+ ```