PremalMatalia commited on
Commit
a7eff34
1 Parent(s): ce2316b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -32
README.md CHANGED
@@ -1,36 +1,39 @@
1
  # roberta-base for QA
2
 
3
- # Overview
4
- - Language model: deepset/roberta-base-squad2
5
- - Language: English
6
- - Downstream-task: Extractive QA
7
- - Training data: SQuAD 2.0
8
- - Eval data: SQuAD 2.0
9
- - Code: <TBD>
10
- - Infrastructure: Colab TPU
11
 
12
- # Hyperparameters
13
- batch_size = 8 </br>
14
- n_epochs = 6 </br>
15
- base_LM_model = "deepset/roberta-base-squad2"</br>
16
- max_seq_len = 386</br>
17
- doc_stride=128</br>
18
- learning_rate = 1.5e-5 </br>
19
- warmup_proportion = 0.2 </br>
20
- batch_size=8 </br>
21
- n_best_size=20 </br>
22
- max_answer_length=30 </br>
23
- min_null_score=7.0 </br>
24
- CLS_threshold=-3 </br>
 
 
25
 
26
-
27
- # Performance
28
- "exact": 81.192622 </br>
29
- "f1": 83.95408 </br>
30
- "total": 11873 </br>
31
- "HasAns_exact": 74.190283 </br>
32
- "HasAns_f1": 79.721119 </br>
33
- "HasAns_total": 5928 </br>
34
- "NoAns_exact": 88.174937 </br>
35
- "NoAns_f1": 88.174937 </br>
36
- "NoAns_total": 5945 </br>
 
 
1
  # roberta-base for QA
2
 
3
+ ## Overview
4
+ **Language model:** deepset/roberta-base-squad2 </br>
5
+ **Language:** English </br>
6
+ **Downstream-task:** Extractive QA </br>
7
+ **Training data:** SQuAD 2.0 </br>
8
+ **Eval data:** SQuAD 2.0 </br>
9
+ **Code:** <TBD> </br>
10
+ **Infrastructure:** Colab TPU </br>
11
 
12
+ ## Hyperparameters
13
+ ```
14
+ batch_size = 8
15
+ n_epochs = 6
16
+ base_LM_model = "deepset/roberta-base-squad2"
17
+ max_seq_len = 386
18
+ doc_stride=128
19
+ learning_rate = 1.5e-5
20
+ warmup_proportion = 0.2
21
+ batch_size=8
22
+ n_best_size=20
23
+ max_answer_length=30
24
+ min_null_score=7.0
25
+ CLS_threshold=-3
26
+ ```
27
 
28
+ ## Performance
29
+ ```
30
+ "exact": 81.192622
31
+ "f1": 83.95408
32
+ "total": 11873
33
+ "HasAns_exact": 74.190283
34
+ "HasAns_f1": 79.721119
35
+ "HasAns_total": 5928
36
+ "NoAns_exact": 88.174937
37
+ "NoAns_f1": 88.174937
38
+ "NoAns_total": 5945
39
+ ```