Hugging Face's logo

deepset
/
flan-t5-xl-squad2

Question Answering
Transformers
PyTorch
Safetensors
English
t5
flan
flan-t5
squad
squad_v2
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
sjrhuschlee commited on
Commit
1446144
•
1 Parent(s): ce38462

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +127 -0
README.md CHANGED
@@ -3,11 +3,138 @@ language: en
3
  license: cc-by-4.0
4
  base_model: google/flan-t5-xl
5
  tags:
 
6
  - flan
7
  - flan-t5
 
 
8
  datasets:
9
  - squad_v2
10
  - squad
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  ---
12
  # flan-t5-xl for Extractive QA
13
 
 
3
  license: cc-by-4.0
4
  base_model: google/flan-t5-xl
5
  tags:
6
+ - question-answering
7
  - flan
8
  - flan-t5
9
+ - squad
10
+ - squad_v2
11
  datasets:
12
  - squad_v2
13
  - squad
14
+ model-index:
15
+ - name: deepset/flan-t5-xl-squad2
16
+ results:
17
+ - task:
18
+ type: question-answering
19
+ name: Question Answering
20
+ dataset:
21
+ name: squad_v2
22
+ type: squad_v2
23
+ config: squad_v2
24
+ split: validation
25
+ metrics:
26
+ - type: exact_match
27
+ value: 88.790
28
+ name: Exact Match
29
+ - type: f1
30
+ value: 91.617
31
+ name: F1
32
+ - task:
33
+ type: question-answering
34
+ name: Question Answering
35
+ dataset:
36
+ name: squad
37
+ type: squad
38
+ config: plain_text
39
+ split: validation
40
+ metrics:
41
+ - type: exact_match
42
+ value: 90.331
43
+ name: Exact Match
44
+ - type: f1
45
+ value: 95.722
46
+ name: F1
47
+ - task:
48
+ type: question-answering
49
+ name: Question Answering
50
+ dataset:
51
+ name: adversarial_qa
52
+ type: adversarial_qa
53
+ config: adversarialQA
54
+ split: validation
55
+ metrics:
56
+ - type: exact_match
57
+ value: 54.367
58
+ name: Exact Match
59
+ - type: f1
60
+ value: 68.055
61
+ name: F1
62
+ - task:
63
+ type: question-answering
64
+ name: Question Answering
65
+ dataset:
66
+ name: squad_adversarial
67
+ type: squad_adversarial
68
+ config: AddOneSent
69
+ split: validation
70
+ metrics:
71
+ - type: exact_match
72
+ value: 87.241
73
+ name: Exact Match
74
+ - type: f1
75
+ value: 92.894
76
+ name: F1
77
+ - task:
78
+ type: question-answering
79
+ name: Question Answering
80
+ dataset:
81
+ name: squadshifts amazon
82
+ type: squadshifts
83
+ config: amazon
84
+ split: test
85
+ metrics:
86
+ - type: exact_match
87
+ value: 77.602
88
+ name: Exact Match
89
+ - type: f1
90
+ value: 90.426
91
+ name: F1
92
+ - task:
93
+ type: question-answering
94
+ name: Question Answering
95
+ dataset:
96
+ name: squadshifts new_wiki
97
+ type: squadshifts
98
+ config: new_wiki
99
+ split: test
100
+ metrics:
101
+ - type: exact_match
102
+ value: 85.639
103
+ name: Exact Match
104
+ - type: f1
105
+ value: 93.974
106
+ name: F1
107
+ - task:
108
+ type: question-answering
109
+ name: Question Answering
110
+ dataset:
111
+ name: squadshifts nyt
112
+ type: squadshifts
113
+ config: nyt
114
+ split: test
115
+ metrics:
116
+ - type: exact_match
117
+ value: 87.392
118
+ name: Exact Match
119
+ - type: f1
120
+ value: 94.579
121
+ name: F1
122
+ - task:
123
+ type: question-answering
124
+ name: Question Answering
125
+ dataset:
126
+ name: squadshifts reddit
127
+ type: squadshifts
128
+ config: reddit
129
+ split: test
130
+ metrics:
131
+ - type: exact_match
132
+ value: 79.323
133
+ name: Exact Match
134
+ - type: f1
135
+ value: 90.083
136
+ name: F1
137
+
138
  ---
139
  # flan-t5-xl for Extractive QA
140