salti commited on
Commit
3cfeb44
1 Parent(s): 05fb3e9

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +33 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - multilingual
4
+
5
+ datasets:
6
+ - squad
7
+
8
+ ---
9
+
10
+ # Multilingual BERT fine-tuned on SQuADv1.1
11
+
12
+ ## Training Arguments
13
+
14
+ ```python
15
+ max_seq_length = 512
16
+ doc_stride = 256
17
+ max_answer_length = 64
18
+ bacth_size = 16
19
+ gradient_accumulation_steps = 2
20
+ learning_rate = 5e-5
21
+ weight_decay = 3e-7
22
+ num_train_epochs = 3
23
+ warmup_ratio = 0.1
24
+ fp16 = True
25
+ fp16_opt_level = "O1"
26
+ seed = 0
27
+ ```
28
+
29
+ ## Results
30
+
31
+ | EM | F1 |
32
+ | :---: | :---: |
33
+ | 81.731 | 89.009 |