sjrhuschlee commited on
Commit
c419f18
1 Parent(s): e6bd3a9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +124 -0
README.md CHANGED
@@ -3,6 +3,130 @@ language: en
3
  license: cc-by-4.0
4
  datasets:
5
  - squad_v2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  ---
7
 
8
  # roberta-large for QA
3
  license: cc-by-4.0
4
  datasets:
5
  - squad_v2
6
+ base_model: roberta-large
7
+ model-index:
8
+ - name: deepset/roberta-large-squad2
9
+ results:
10
+ - task:
11
+ type: question-answering
12
+ name: Question Answering
13
+ dataset:
14
+ name: squad_v2
15
+ type: squad_v2
16
+ config: squad_v2
17
+ split: validation
18
+ metrics:
19
+ - type: exact_match
20
+ value: 85.168
21
+ name: Exact Match
22
+ - type: f1
23
+ value: 88.349
24
+ name: F1
25
+ - task:
26
+ type: question-answering
27
+ name: Question Answering
28
+ dataset:
29
+ name: squad
30
+ type: squad
31
+ config: plain_text
32
+ split: validation
33
+ metrics:
34
+ - type: exact_match
35
+ value: 87.162
36
+ name: Exact Match
37
+ - type: f1
38
+ value: 93.603
39
+ name: F1
40
+ - task:
41
+ type: question-answering
42
+ name: Question Answering
43
+ dataset:
44
+ name: adversarial_qa
45
+ type: adversarial_qa
46
+ config: adversarialQA
47
+ split: validation
48
+ metrics:
49
+ - type: exact_match
50
+ value: 35.900
51
+ name: Exact Match
52
+ - type: f1
53
+ value: 48.923
54
+ name: F1
55
+ - task:
56
+ type: question-answering
57
+ name: Question Answering
58
+ dataset:
59
+ name: squad_adversarial
60
+ type: squad_adversarial
61
+ config: AddOneSent
62
+ split: validation
63
+ metrics:
64
+ - type: exact_match
65
+ value: 81.142
66
+ name: Exact Match
67
+ - type: f1
68
+ value: 87.099
69
+ name: F1
70
+ - task:
71
+ type: question-answering
72
+ name: Question Answering
73
+ dataset:
74
+ name: squadshifts amazon
75
+ type: squadshifts
76
+ config: amazon
77
+ split: test
78
+ metrics:
79
+ - type: exact_match
80
+ value: 72.453
81
+ name: Exact Match
82
+ - type: f1
83
+ value: 86.325
84
+ name: F1
85
+ - task:
86
+ type: question-answering
87
+ name: Question Answering
88
+ dataset:
89
+ name: squadshifts new_wiki
90
+ type: squadshifts
91
+ config: new_wiki
92
+ split: test
93
+ metrics:
94
+ - type: exact_match
95
+ value: 82.338
96
+ name: Exact Match
97
+ - type: f1
98
+ value: 91.974
99
+ name: F1
100
+ - task:
101
+ type: question-answering
102
+ name: Question Answering
103
+ dataset:
104
+ name: squadshifts nyt
105
+ type: squadshifts
106
+ config: nyt
107
+ split: test
108
+ metrics:
109
+ - type: exact_match
110
+ value: 84.352
111
+ name: Exact Match
112
+ - type: f1
113
+ value: 92.645
114
+ name: F1
115
+ - task:
116
+ type: question-answering
117
+ name: Question Answering
118
+ dataset:
119
+ name: squadshifts reddit
120
+ type: squadshifts
121
+ config: reddit
122
+ split: test
123
+ metrics:
124
+ - type: exact_match
125
+ value: 74.722
126
+ name: Exact Match
127
+ - type: f1
128
+ value: 86.860
129
+ name: F1
130
  ---
131
 
132
  # roberta-large for QA