cointegrated commited on
Commit
307cf3b
1 Parent(s): d06656b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2597 -0
README.md CHANGED
@@ -1,5 +1,2602 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
4
 
5
  # SONAR
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ tags:
4
+ - mteb
5
+ model-index:
6
+ - name: SONAR
7
+ results:
8
+ - task:
9
+ type: Classification
10
+ dataset:
11
+ type: mteb/amazon_counterfactual
12
+ name: MTEB AmazonCounterfactualClassification (en)
13
+ config: en
14
+ split: test
15
+ revision: e8379541af4e31359cca9fbcf4b00f2671dba205
16
+ metrics:
17
+ - type: accuracy
18
+ value: 78.98507462686568
19
+ - type: ap
20
+ value: 44.08138737273602
21
+ - type: f1
22
+ value: 73.46285533200773
23
+ - task:
24
+ type: Classification
25
+ dataset:
26
+ type: mteb/amazon_polarity
27
+ name: MTEB AmazonPolarityClassification
28
+ config: default
29
+ split: test
30
+ revision: e2d317d38cd51312af73b3d32a06d1a08b442046
31
+ metrics:
32
+ - type: accuracy
33
+ value: 61.5211
34
+ - type: ap
35
+ value: 57.2344349163483
36
+ - type: f1
37
+ value: 60.73005370602843
38
+ - task:
39
+ type: Classification
40
+ dataset:
41
+ type: mteb/amazon_reviews_multi
42
+ name: MTEB AmazonReviewsClassification (en)
43
+ config: en
44
+ split: test
45
+ revision: 1399c76144fd37290681b995c656ef9b2e06e26d
46
+ metrics:
47
+ - type: accuracy
48
+ value: 30.491999999999997
49
+ - type: f1
50
+ value: 29.557204623883994
51
+ - task:
52
+ type: Retrieval
53
+ dataset:
54
+ type: arguana
55
+ name: MTEB ArguAna
56
+ config: default
57
+ split: test
58
+ revision: None
59
+ metrics:
60
+ - type: map_at_1
61
+ value: 8.677
62
+ - type: map_at_10
63
+ value: 14.732000000000001
64
+ - type: map_at_100
65
+ value: 15.501999999999999
66
+ - type: map_at_1000
67
+ value: 15.583
68
+ - type: map_at_3
69
+ value: 12.553
70
+ - type: map_at_5
71
+ value: 13.822999999999999
72
+ - type: mrr_at_1
73
+ value: 8.819
74
+ - type: mrr_at_10
75
+ value: 14.787
76
+ - type: mrr_at_100
77
+ value: 15.557000000000002
78
+ - type: mrr_at_1000
79
+ value: 15.638
80
+ - type: mrr_at_3
81
+ value: 12.648000000000001
82
+ - type: mrr_at_5
83
+ value: 13.879
84
+ - type: ndcg_at_1
85
+ value: 8.677
86
+ - type: ndcg_at_10
87
+ value: 18.295
88
+ - type: ndcg_at_100
89
+ value: 22.353
90
+ - type: ndcg_at_1000
91
+ value: 24.948999999999998
92
+ - type: ndcg_at_3
93
+ value: 13.789000000000001
94
+ - type: ndcg_at_5
95
+ value: 16.075
96
+ - type: precision_at_1
97
+ value: 8.677
98
+ - type: precision_at_10
99
+ value: 2.98
100
+ - type: precision_at_100
101
+ value: 0.49500000000000005
102
+ - type: precision_at_1000
103
+ value: 0.07100000000000001
104
+ - type: precision_at_3
105
+ value: 5.785
106
+ - type: precision_at_5
107
+ value: 4.58
108
+ - type: recall_at_1
109
+ value: 8.677
110
+ - type: recall_at_10
111
+ value: 29.801
112
+ - type: recall_at_100
113
+ value: 49.502
114
+ - type: recall_at_1000
115
+ value: 70.91
116
+ - type: recall_at_3
117
+ value: 17.354
118
+ - type: recall_at_5
119
+ value: 22.902
120
+ - task:
121
+ type: Clustering
122
+ dataset:
123
+ type: mteb/arxiv-clustering-p2p
124
+ name: MTEB ArxivClusteringP2P
125
+ config: default
126
+ split: test
127
+ revision: a122ad7f3f0291bf49cc6f4d32aa80929df69d5d
128
+ metrics:
129
+ - type: v_measure
130
+ value: 25.78534535464707
131
+ - task:
132
+ type: Clustering
133
+ dataset:
134
+ type: mteb/arxiv-clustering-s2s
135
+ name: MTEB ArxivClusteringS2S
136
+ config: default
137
+ split: test
138
+ revision: f910caf1a6075f7329cdf8c1a6135696f37dbd53
139
+ metrics:
140
+ - type: v_measure
141
+ value: 22.935310338963955
142
+ - task:
143
+ type: Reranking
144
+ dataset:
145
+ type: mteb/askubuntudupquestions-reranking
146
+ name: MTEB AskUbuntuDupQuestions
147
+ config: default
148
+ split: test
149
+ revision: 2000358ca161889fa9c082cb41daa8dcfb161a54
150
+ metrics:
151
+ - type: map
152
+ value: 50.88606427049027
153
+ - type: mrr
154
+ value: 65.13004001231148
155
+ - task:
156
+ type: STS
157
+ dataset:
158
+ type: mteb/biosses-sts
159
+ name: MTEB BIOSSES
160
+ config: default
161
+ split: test
162
+ revision: d3fb88f8f02e40887cd149695127462bbcf29b4a
163
+ metrics:
164
+ - type: cos_sim_pearson
165
+ value: 77.15058570798328
166
+ - type: cos_sim_spearman
167
+ value: 79.10541692841936
168
+ - type: euclidean_pearson
169
+ value: 57.77256072255626
170
+ - type: euclidean_spearman
171
+ value: 61.9206880133157
172
+ - type: manhattan_pearson
173
+ value: 57.61971995547671
174
+ - type: manhattan_spearman
175
+ value: 61.65983869619309
176
+ - task:
177
+ type: Classification
178
+ dataset:
179
+ type: mteb/banking77
180
+ name: MTEB Banking77Classification
181
+ config: default
182
+ split: test
183
+ revision: 0fd18e25b25c072e09e0d92ab615fda904d66300
184
+ metrics:
185
+ - type: accuracy
186
+ value: 70.12012987012987
187
+ - type: f1
188
+ value: 69.2899512261214
189
+ - task:
190
+ type: Clustering
191
+ dataset:
192
+ type: mteb/biorxiv-clustering-p2p
193
+ name: MTEB BiorxivClusteringP2P
194
+ config: default
195
+ split: test
196
+ revision: 65b79d1d13f80053f67aca9498d9402c2d9f1f40
197
+ metrics:
198
+ - type: v_measure
199
+ value: 18.50684170881271
200
+ - task:
201
+ type: Clustering
202
+ dataset:
203
+ type: mteb/biorxiv-clustering-s2s
204
+ name: MTEB BiorxivClusteringS2S
205
+ config: default
206
+ split: test
207
+ revision: 258694dd0231531bc1fd9de6ceb52a0853c6d908
208
+ metrics:
209
+ - type: v_measure
210
+ value: 16.69474554114157
211
+ - task:
212
+ type: Retrieval
213
+ dataset:
214
+ type: BeIR/cqadupstack
215
+ name: MTEB CQADupstackAndroidRetrieval
216
+ config: default
217
+ split: test
218
+ revision: None
219
+ metrics:
220
+ - type: map_at_1
221
+ value: 7.655000000000001
222
+ - type: map_at_10
223
+ value: 11.681999999999999
224
+ - type: map_at_100
225
+ value: 12.464
226
+ - type: map_at_1000
227
+ value: 12.603
228
+ - type: map_at_3
229
+ value: 10.514
230
+ - type: map_at_5
231
+ value: 11.083
232
+ - type: mrr_at_1
233
+ value: 10.157
234
+ - type: mrr_at_10
235
+ value: 14.773
236
+ - type: mrr_at_100
237
+ value: 15.581999999999999
238
+ - type: mrr_at_1000
239
+ value: 15.68
240
+ - type: mrr_at_3
241
+ value: 13.519
242
+ - type: mrr_at_5
243
+ value: 14.049
244
+ - type: ndcg_at_1
245
+ value: 10.157
246
+ - type: ndcg_at_10
247
+ value: 14.527999999999999
248
+ - type: ndcg_at_100
249
+ value: 18.695999999999998
250
+ - type: ndcg_at_1000
251
+ value: 22.709
252
+ - type: ndcg_at_3
253
+ value: 12.458
254
+ - type: ndcg_at_5
255
+ value: 13.152
256
+ - type: precision_at_1
257
+ value: 10.157
258
+ - type: precision_at_10
259
+ value: 2.976
260
+ - type: precision_at_100
261
+ value: 0.634
262
+ - type: precision_at_1000
263
+ value: 0.131
264
+ - type: precision_at_3
265
+ value: 6.152
266
+ - type: precision_at_5
267
+ value: 4.378
268
+ - type: recall_at_1
269
+ value: 7.655000000000001
270
+ - type: recall_at_10
271
+ value: 20.105
272
+ - type: recall_at_100
273
+ value: 39.181
274
+ - type: recall_at_1000
275
+ value: 68.06400000000001
276
+ - type: recall_at_3
277
+ value: 14.033000000000001
278
+ - type: recall_at_5
279
+ value: 16.209
280
+ - task:
281
+ type: Retrieval
282
+ dataset:
283
+ type: BeIR/cqadupstack
284
+ name: MTEB CQADupstackEnglishRetrieval
285
+ config: default
286
+ split: test
287
+ revision: None
288
+ metrics:
289
+ - type: map_at_1
290
+ value: 3.2329999999999997
291
+ - type: map_at_10
292
+ value: 5.378
293
+ - type: map_at_100
294
+ value: 5.774
295
+ - type: map_at_1000
296
+ value: 5.863
297
+ - type: map_at_3
298
+ value: 4.598
299
+ - type: map_at_5
300
+ value: 4.9750000000000005
301
+ - type: mrr_at_1
302
+ value: 4.076
303
+ - type: mrr_at_10
304
+ value: 6.679
305
+ - type: mrr_at_100
306
+ value: 7.151000000000001
307
+ - type: mrr_at_1000
308
+ value: 7.24
309
+ - type: mrr_at_3
310
+ value: 5.722
311
+ - type: mrr_at_5
312
+ value: 6.2059999999999995
313
+ - type: ndcg_at_1
314
+ value: 4.076
315
+ - type: ndcg_at_10
316
+ value: 6.994
317
+ - type: ndcg_at_100
318
+ value: 9.366
319
+ - type: ndcg_at_1000
320
+ value: 12.181000000000001
321
+ - type: ndcg_at_3
322
+ value: 5.356000000000001
323
+ - type: ndcg_at_5
324
+ value: 6.008
325
+ - type: precision_at_1
326
+ value: 4.076
327
+ - type: precision_at_10
328
+ value: 1.459
329
+ - type: precision_at_100
330
+ value: 0.334
331
+ - type: precision_at_1000
332
+ value: 0.075
333
+ - type: precision_at_3
334
+ value: 2.718
335
+ - type: precision_at_5
336
+ value: 2.089
337
+ - type: recall_at_1
338
+ value: 3.2329999999999997
339
+ - type: recall_at_10
340
+ value: 10.749
341
+ - type: recall_at_100
342
+ value: 21.776
343
+ - type: recall_at_1000
344
+ value: 42.278999999999996
345
+ - type: recall_at_3
346
+ value: 6.146999999999999
347
+ - type: recall_at_5
348
+ value: 7.779999999999999
349
+ - task:
350
+ type: Retrieval
351
+ dataset:
352
+ type: BeIR/cqadupstack
353
+ name: MTEB CQADupstackGamingRetrieval
354
+ config: default
355
+ split: test
356
+ revision: None
357
+ metrics:
358
+ - type: map_at_1
359
+ value: 8.036
360
+ - type: map_at_10
361
+ value: 12.727
362
+ - type: map_at_100
363
+ value: 13.532
364
+ - type: map_at_1000
365
+ value: 13.653
366
+ - type: map_at_3
367
+ value: 11.15
368
+ - type: map_at_5
369
+ value: 11.965
370
+ - type: mrr_at_1
371
+ value: 9.404
372
+ - type: mrr_at_10
373
+ value: 14.493
374
+ - type: mrr_at_100
375
+ value: 15.274
376
+ - type: mrr_at_1000
377
+ value: 15.370000000000001
378
+ - type: mrr_at_3
379
+ value: 12.853
380
+ - type: mrr_at_5
381
+ value: 13.696
382
+ - type: ndcg_at_1
383
+ value: 9.404
384
+ - type: ndcg_at_10
385
+ value: 15.784
386
+ - type: ndcg_at_100
387
+ value: 20.104
388
+ - type: ndcg_at_1000
389
+ value: 23.357
390
+ - type: ndcg_at_3
391
+ value: 12.61
392
+ - type: ndcg_at_5
393
+ value: 13.988
394
+ - type: precision_at_1
395
+ value: 9.404
396
+ - type: precision_at_10
397
+ value: 2.947
398
+ - type: precision_at_100
399
+ value: 0.562
400
+ - type: precision_at_1000
401
+ value: 0.093
402
+ - type: precision_at_3
403
+ value: 6.04
404
+ - type: precision_at_5
405
+ value: 4.4639999999999995
406
+ - type: recall_at_1
407
+ value: 8.036
408
+ - type: recall_at_10
409
+ value: 23.429
410
+ - type: recall_at_100
411
+ value: 43.728
412
+ - type: recall_at_1000
413
+ value: 68.10000000000001
414
+ - type: recall_at_3
415
+ value: 14.99
416
+ - type: recall_at_5
417
+ value: 18.274
418
+ - task:
419
+ type: Retrieval
420
+ dataset:
421
+ type: BeIR/cqadupstack
422
+ name: MTEB CQADupstackGisRetrieval
423
+ config: default
424
+ split: test
425
+ revision: None
426
+ metrics:
427
+ - type: map_at_1
428
+ value: 3.653
429
+ - type: map_at_10
430
+ value: 5.941
431
+ - type: map_at_100
432
+ value: 6.512
433
+ - type: map_at_1000
434
+ value: 6.6129999999999995
435
+ - type: map_at_3
436
+ value: 5.2540000000000004
437
+ - type: map_at_5
438
+ value: 5.645
439
+ - type: mrr_at_1
440
+ value: 3.955
441
+ - type: mrr_at_10
442
+ value: 6.4079999999999995
443
+ - type: mrr_at_100
444
+ value: 7.005999999999999
445
+ - type: mrr_at_1000
446
+ value: 7.105
447
+ - type: mrr_at_3
448
+ value: 5.593
449
+ - type: mrr_at_5
450
+ value: 6.051
451
+ - type: ndcg_at_1
452
+ value: 3.955
453
+ - type: ndcg_at_10
454
+ value: 7.342
455
+ - type: ndcg_at_100
456
+ value: 10.543
457
+ - type: ndcg_at_1000
458
+ value: 14.011000000000001
459
+ - type: ndcg_at_3
460
+ value: 5.853
461
+ - type: ndcg_at_5
462
+ value: 6.586
463
+ - type: precision_at_1
464
+ value: 3.955
465
+ - type: precision_at_10
466
+ value: 1.266
467
+ - type: precision_at_100
468
+ value: 0.315
469
+ - type: precision_at_1000
470
+ value: 0.066
471
+ - type: precision_at_3
472
+ value: 2.5989999999999998
473
+ - type: precision_at_5
474
+ value: 1.966
475
+ - type: recall_at_1
476
+ value: 3.653
477
+ - type: recall_at_10
478
+ value: 11.232000000000001
479
+ - type: recall_at_100
480
+ value: 26.625
481
+ - type: recall_at_1000
482
+ value: 54.476
483
+ - type: recall_at_3
484
+ value: 7.269
485
+ - type: recall_at_5
486
+ value: 8.982999999999999
487
+ - task:
488
+ type: Retrieval
489
+ dataset:
490
+ type: BeIR/cqadupstack
491
+ name: MTEB CQADupstackMathematicaRetrieval
492
+ config: default
493
+ split: test
494
+ revision: None
495
+ metrics:
496
+ - type: map_at_1
497
+ value: 2.257
498
+ - type: map_at_10
499
+ value: 3.881
500
+ - type: map_at_100
501
+ value: 4.279
502
+ - type: map_at_1000
503
+ value: 4.417
504
+ - type: map_at_3
505
+ value: 3.4070000000000005
506
+ - type: map_at_5
507
+ value: 3.744
508
+ - type: mrr_at_1
509
+ value: 2.9850000000000003
510
+ - type: mrr_at_10
511
+ value: 4.756
512
+ - type: mrr_at_100
513
+ value: 5.228
514
+ - type: mrr_at_1000
515
+ value: 5.354
516
+ - type: mrr_at_3
517
+ value: 4.125
518
+ - type: mrr_at_5
519
+ value: 4.567
520
+ - type: ndcg_at_1
521
+ value: 2.9850000000000003
522
+ - type: ndcg_at_10
523
+ value: 4.936999999999999
524
+ - type: ndcg_at_100
525
+ value: 7.664
526
+ - type: ndcg_at_1000
527
+ value: 12.045
528
+ - type: ndcg_at_3
529
+ value: 3.956
530
+ - type: ndcg_at_5
531
+ value: 4.584
532
+ - type: precision_at_1
533
+ value: 2.9850000000000003
534
+ - type: precision_at_10
535
+ value: 0.9329999999999999
536
+ - type: precision_at_100
537
+ value: 0.29
538
+ - type: precision_at_1000
539
+ value: 0.083
540
+ - type: precision_at_3
541
+ value: 1.949
542
+ - type: precision_at_5
543
+ value: 1.567
544
+ - type: recall_at_1
545
+ value: 2.257
546
+ - type: recall_at_10
547
+ value: 7.382
548
+ - type: recall_at_100
549
+ value: 20.689
550
+ - type: recall_at_1000
551
+ value: 53.586
552
+ - type: recall_at_3
553
+ value: 4.786
554
+ - type: recall_at_5
555
+ value: 6.2829999999999995
556
+ - task:
557
+ type: Retrieval
558
+ dataset:
559
+ type: BeIR/cqadupstack
560
+ name: MTEB CQADupstackPhysicsRetrieval
561
+ config: default
562
+ split: test
563
+ revision: None
564
+ metrics:
565
+ - type: map_at_1
566
+ value: 6.691
567
+ - type: map_at_10
568
+ value: 9.447
569
+ - type: map_at_100
570
+ value: 10.174
571
+ - type: map_at_1000
572
+ value: 10.308
573
+ - type: map_at_3
574
+ value: 8.187999999999999
575
+ - type: map_at_5
576
+ value: 8.852
577
+ - type: mrr_at_1
578
+ value: 8.566
579
+ - type: mrr_at_10
580
+ value: 12.036
581
+ - type: mrr_at_100
582
+ value: 12.817
583
+ - type: mrr_at_1000
584
+ value: 12.918
585
+ - type: mrr_at_3
586
+ value: 10.539
587
+ - type: mrr_at_5
588
+ value: 11.381
589
+ - type: ndcg_at_1
590
+ value: 8.566
591
+ - type: ndcg_at_10
592
+ value: 11.95
593
+ - type: ndcg_at_100
594
+ value: 15.831000000000001
595
+ - type: ndcg_at_1000
596
+ value: 19.561
597
+ - type: ndcg_at_3
598
+ value: 9.467
599
+ - type: ndcg_at_5
600
+ value: 10.544
601
+ - type: precision_at_1
602
+ value: 8.566
603
+ - type: precision_at_10
604
+ value: 2.387
605
+ - type: precision_at_100
606
+ value: 0.538
607
+ - type: precision_at_1000
608
+ value: 0.104
609
+ - type: precision_at_3
610
+ value: 4.556
611
+ - type: precision_at_5
612
+ value: 3.5029999999999997
613
+ - type: recall_at_1
614
+ value: 6.691
615
+ - type: recall_at_10
616
+ value: 17.375
617
+ - type: recall_at_100
618
+ value: 34.503
619
+ - type: recall_at_1000
620
+ value: 61.492000000000004
621
+ - type: recall_at_3
622
+ value: 10.134
623
+ - type: recall_at_5
624
+ value: 13.056999999999999
625
+ - task:
626
+ type: Retrieval
627
+ dataset:
628
+ type: BeIR/cqadupstack
629
+ name: MTEB CQADupstackProgrammersRetrieval
630
+ config: default
631
+ split: test
632
+ revision: None
633
+ metrics:
634
+ - type: map_at_1
635
+ value: 4.68
636
+ - type: map_at_10
637
+ value: 6.776999999999999
638
+ - type: map_at_100
639
+ value: 7.207
640
+ - type: map_at_1000
641
+ value: 7.321999999999999
642
+ - type: map_at_3
643
+ value: 6.007
644
+ - type: map_at_5
645
+ value: 6.356000000000001
646
+ - type: mrr_at_1
647
+ value: 5.479
648
+ - type: mrr_at_10
649
+ value: 8.094999999999999
650
+ - type: mrr_at_100
651
+ value: 8.622
652
+ - type: mrr_at_1000
653
+ value: 8.729000000000001
654
+ - type: mrr_at_3
655
+ value: 7.249
656
+ - type: mrr_at_5
657
+ value: 7.6770000000000005
658
+ - type: ndcg_at_1
659
+ value: 5.479
660
+ - type: ndcg_at_10
661
+ value: 8.474
662
+ - type: ndcg_at_100
663
+ value: 11.134
664
+ - type: ndcg_at_1000
665
+ value: 14.759
666
+ - type: ndcg_at_3
667
+ value: 6.888
668
+ - type: ndcg_at_5
669
+ value: 7.504
670
+ - type: precision_at_1
671
+ value: 5.479
672
+ - type: precision_at_10
673
+ value: 1.575
674
+ - type: precision_at_100
675
+ value: 0.35000000000000003
676
+ - type: precision_at_1000
677
+ value: 0.08099999999999999
678
+ - type: precision_at_3
679
+ value: 3.272
680
+ - type: precision_at_5
681
+ value: 2.374
682
+ - type: recall_at_1
683
+ value: 4.68
684
+ - type: recall_at_10
685
+ value: 12.552
686
+ - type: recall_at_100
687
+ value: 24.91
688
+ - type: recall_at_1000
689
+ value: 52.019999999999996
690
+ - type: recall_at_3
691
+ value: 8.057
692
+ - type: recall_at_5
693
+ value: 9.629999999999999
694
+ - task:
695
+ type: Retrieval
696
+ dataset:
697
+ type: BeIR/cqadupstack
698
+ name: MTEB CQADupstackRetrieval
699
+ config: default
700
+ split: test
701
+ revision: None
702
+ metrics:
703
+ - type: map_at_1
704
+ value: 4.74175
705
+ - type: map_at_10
706
+ value: 7.103916666666667
707
+ - type: map_at_100
708
+ value: 7.656499999999999
709
+ - type: map_at_1000
710
+ value: 7.7675833333333335
711
+ - type: map_at_3
712
+ value: 6.262416666666666
713
+ - type: map_at_5
714
+ value: 6.6939166666666665
715
+ - type: mrr_at_1
716
+ value: 5.780583333333332
717
+ - type: mrr_at_10
718
+ value: 8.576333333333332
719
+ - type: mrr_at_100
720
+ value: 9.179749999999999
721
+ - type: mrr_at_1000
722
+ value: 9.279083333333334
723
+ - type: mrr_at_3
724
+ value: 7.608833333333334
725
+ - type: mrr_at_5
726
+ value: 8.111333333333333
727
+ - type: ndcg_at_1
728
+ value: 5.780583333333332
729
+ - type: ndcg_at_10
730
+ value: 8.866166666666668
731
+ - type: ndcg_at_100
732
+ value: 12.037083333333333
733
+ - type: ndcg_at_1000
734
+ value: 15.455499999999997
735
+ - type: ndcg_at_3
736
+ value: 7.179083333333335
737
+ - type: ndcg_at_5
738
+ value: 7.897166666666666
739
+ - type: precision_at_1
740
+ value: 5.780583333333332
741
+ - type: precision_at_10
742
+ value: 1.6935833333333334
743
+ - type: precision_at_100
744
+ value: 0.3921666666666666
745
+ - type: precision_at_1000
746
+ value: 0.08391666666666665
747
+ - type: precision_at_3
748
+ value: 3.425416666666666
749
+ - type: precision_at_5
750
+ value: 2.557083333333333
751
+ - type: recall_at_1
752
+ value: 4.74175
753
+ - type: recall_at_10
754
+ value: 12.889083333333334
755
+ - type: recall_at_100
756
+ value: 27.81866666666667
757
+ - type: recall_at_1000
758
+ value: 53.52316666666667
759
+ - type: recall_at_3
760
+ value: 8.179333333333334
761
+ - type: recall_at_5
762
+ value: 10.004083333333334
763
+ - task:
764
+ type: Retrieval
765
+ dataset:
766
+ type: BeIR/cqadupstack
767
+ name: MTEB CQADupstackStatsRetrieval
768
+ config: default
769
+ split: test
770
+ revision: None
771
+ metrics:
772
+ - type: map_at_1
773
+ value: 3.7130000000000005
774
+ - type: map_at_10
775
+ value: 5.734
776
+ - type: map_at_100
777
+ value: 6.297999999999999
778
+ - type: map_at_1000
779
+ value: 6.388000000000001
780
+ - type: map_at_3
781
+ value: 5.119
782
+ - type: map_at_5
783
+ value: 5.432
784
+ - type: mrr_at_1
785
+ value: 4.9079999999999995
786
+ - type: mrr_at_10
787
+ value: 7.2940000000000005
788
+ - type: mrr_at_100
789
+ value: 7.8549999999999995
790
+ - type: mrr_at_1000
791
+ value: 7.95
792
+ - type: mrr_at_3
793
+ value: 6.621
794
+ - type: mrr_at_5
795
+ value: 6.950000000000001
796
+ - type: ndcg_at_1
797
+ value: 4.9079999999999995
798
+ - type: ndcg_at_10
799
+ value: 7.167999999999999
800
+ - type: ndcg_at_100
801
+ value: 10.436
802
+ - type: ndcg_at_1000
803
+ value: 13.370999999999999
804
+ - type: ndcg_at_3
805
+ value: 5.959
806
+ - type: ndcg_at_5
807
+ value: 6.481000000000001
808
+ - type: precision_at_1
809
+ value: 4.9079999999999995
810
+ - type: precision_at_10
811
+ value: 1.3339999999999999
812
+ - type: precision_at_100
813
+ value: 0.33899999999999997
814
+ - type: precision_at_1000
815
+ value: 0.065
816
+ - type: precision_at_3
817
+ value: 2.965
818
+ - type: precision_at_5
819
+ value: 2.117
820
+ - type: recall_at_1
821
+ value: 3.7130000000000005
822
+ - type: recall_at_10
823
+ value: 10.156
824
+ - type: recall_at_100
825
+ value: 25.955000000000002
826
+ - type: recall_at_1000
827
+ value: 48.891
828
+ - type: recall_at_3
829
+ value: 6.795
830
+ - type: recall_at_5
831
+ value: 8.187999999999999
832
+ - task:
833
+ type: Retrieval
834
+ dataset:
835
+ type: BeIR/cqadupstack
836
+ name: MTEB CQADupstackTexRetrieval
837
+ config: default
838
+ split: test
839
+ revision: None
840
+ metrics:
841
+ - type: map_at_1
842
+ value: 2.114
843
+ - type: map_at_10
844
+ value: 3.4290000000000003
845
+ - type: map_at_100
846
+ value: 3.789
847
+ - type: map_at_1000
848
+ value: 3.878
849
+ - type: map_at_3
850
+ value: 2.9139999999999997
851
+ - type: map_at_5
852
+ value: 3.148
853
+ - type: mrr_at_1
854
+ value: 2.65
855
+ - type: mrr_at_10
856
+ value: 4.252000000000001
857
+ - type: mrr_at_100
858
+ value: 4.689
859
+ - type: mrr_at_1000
860
+ value: 4.782
861
+ - type: mrr_at_3
862
+ value: 3.671
863
+ - type: mrr_at_5
864
+ value: 3.9370000000000003
865
+ - type: ndcg_at_1
866
+ value: 2.65
867
+ - type: ndcg_at_10
868
+ value: 4.47
869
+ - type: ndcg_at_100
870
+ value: 6.654
871
+ - type: ndcg_at_1000
872
+ value: 9.713
873
+ - type: ndcg_at_3
874
+ value: 3.424
875
+ - type: ndcg_at_5
876
+ value: 3.794
877
+ - type: precision_at_1
878
+ value: 2.65
879
+ - type: precision_at_10
880
+ value: 0.9119999999999999
881
+ - type: precision_at_100
882
+ value: 0.248
883
+ - type: precision_at_1000
884
+ value: 0.063
885
+ - type: precision_at_3
886
+ value: 1.7209999999999999
887
+ - type: precision_at_5
888
+ value: 1.287
889
+ - type: recall_at_1
890
+ value: 2.114
891
+ - type: recall_at_10
892
+ value: 6.927
893
+ - type: recall_at_100
894
+ value: 17.26
895
+ - type: recall_at_1000
896
+ value: 40.672999999999995
897
+ - type: recall_at_3
898
+ value: 3.8859999999999997
899
+ - type: recall_at_5
900
+ value: 4.861
901
+ - task:
902
+ type: Retrieval
903
+ dataset:
904
+ type: BeIR/cqadupstack
905
+ name: MTEB CQADupstackUnixRetrieval
906
+ config: default
907
+ split: test
908
+ revision: None
909
+ metrics:
910
+ - type: map_at_1
911
+ value: 6.055
912
+ - type: map_at_10
913
+ value: 7.704999999999999
914
+ - type: map_at_100
915
+ value: 8.169
916
+ - type: map_at_1000
917
+ value: 8.257
918
+ - type: map_at_3
919
+ value: 7.033
920
+ - type: map_at_5
921
+ value: 7.4079999999999995
922
+ - type: mrr_at_1
923
+ value: 6.81
924
+ - type: mrr_at_10
925
+ value: 8.955
926
+ - type: mrr_at_100
927
+ value: 9.497
928
+ - type: mrr_at_1000
929
+ value: 9.583
930
+ - type: mrr_at_3
931
+ value: 8.116
932
+ - type: mrr_at_5
933
+ value: 8.526
934
+ - type: ndcg_at_1
935
+ value: 6.81
936
+ - type: ndcg_at_10
937
+ value: 9.113
938
+ - type: ndcg_at_100
939
+ value: 11.884
940
+ - type: ndcg_at_1000
941
+ value: 14.762
942
+ - type: ndcg_at_3
943
+ value: 7.675999999999999
944
+ - type: ndcg_at_5
945
+ value: 8.325000000000001
946
+ - type: precision_at_1
947
+ value: 6.81
948
+ - type: precision_at_10
949
+ value: 1.558
950
+ - type: precision_at_100
951
+ value: 0.34299999999999997
952
+ - type: precision_at_1000
953
+ value: 0.068
954
+ - type: precision_at_3
955
+ value: 3.2960000000000003
956
+ - type: precision_at_5
957
+ value: 2.388
958
+ - type: recall_at_1
959
+ value: 6.055
960
+ - type: recall_at_10
961
+ value: 12.219
962
+ - type: recall_at_100
963
+ value: 25.304
964
+ - type: recall_at_1000
965
+ value: 47.204
966
+ - type: recall_at_3
967
+ value: 8.387
968
+ - type: recall_at_5
969
+ value: 9.991
970
+ - task:
971
+ type: Retrieval
972
+ dataset:
973
+ type: BeIR/cqadupstack
974
+ name: MTEB CQADupstackWebmastersRetrieval
975
+ config: default
976
+ split: test
977
+ revision: None
978
+ metrics:
979
+ - type: map_at_1
980
+ value: 5.043
981
+ - type: map_at_10
982
+ value: 7.394
983
+ - type: map_at_100
984
+ value: 8.096
985
+ - type: map_at_1000
986
+ value: 8.243
987
+ - type: map_at_3
988
+ value: 6.300999999999999
989
+ - type: map_at_5
990
+ value: 6.7780000000000005
991
+ - type: mrr_at_1
992
+ value: 6.126
993
+ - type: mrr_at_10
994
+ value: 9.308
995
+ - type: mrr_at_100
996
+ value: 10.091
997
+ - type: mrr_at_1000
998
+ value: 10.206
999
+ - type: mrr_at_3
1000
+ value: 7.938000000000001
1001
+ - type: mrr_at_5
1002
+ value: 8.64
1003
+ - type: ndcg_at_1
1004
+ value: 6.126
1005
+ - type: ndcg_at_10
1006
+ value: 9.474
1007
+ - type: ndcg_at_100
1008
+ value: 13.238
1009
+ - type: ndcg_at_1000
1010
+ value: 17.366
1011
+ - type: ndcg_at_3
1012
+ value: 7.3260000000000005
1013
+ - type: ndcg_at_5
1014
+ value: 8.167
1015
+ - type: precision_at_1
1016
+ value: 6.126
1017
+ - type: precision_at_10
1018
+ value: 1.9959999999999998
1019
+ - type: precision_at_100
1020
+ value: 0.494
1021
+ - type: precision_at_1000
1022
+ value: 0.125
1023
+ - type: precision_at_3
1024
+ value: 3.557
1025
+ - type: precision_at_5
1026
+ value: 2.9250000000000003
1027
+ - type: recall_at_1
1028
+ value: 5.043
1029
+ - type: recall_at_10
1030
+ value: 13.812
1031
+ - type: recall_at_100
1032
+ value: 31.375999999999998
1033
+ - type: recall_at_1000
1034
+ value: 61.309999999999995
1035
+ - type: recall_at_3
1036
+ value: 7.8020000000000005
1037
+ - type: recall_at_5
1038
+ value: 9.725999999999999
1039
+ - task:
1040
+ type: Retrieval
1041
+ dataset:
1042
+ type: BeIR/cqadupstack
1043
+ name: MTEB CQADupstackWordpressRetrieval
1044
+ config: default
1045
+ split: test
1046
+ revision: None
1047
+ metrics:
1048
+ - type: map_at_1
1049
+ value: 3.771
1050
+ - type: map_at_10
1051
+ value: 5.152
1052
+ - type: map_at_100
1053
+ value: 5.584
1054
+ - type: map_at_1000
1055
+ value: 5.666
1056
+ - type: map_at_3
1057
+ value: 4.664
1058
+ - type: map_at_5
1059
+ value: 4.941
1060
+ - type: mrr_at_1
1061
+ value: 4.251
1062
+ - type: mrr_at_10
1063
+ value: 5.867
1064
+ - type: mrr_at_100
1065
+ value: 6.345000000000001
1066
+ - type: mrr_at_1000
1067
+ value: 6.432
1068
+ - type: mrr_at_3
1069
+ value: 5.36
1070
+ - type: mrr_at_5
1071
+ value: 5.656
1072
+ - type: ndcg_at_1
1073
+ value: 4.251
1074
+ - type: ndcg_at_10
1075
+ value: 6.16
1076
+ - type: ndcg_at_100
1077
+ value: 8.895
1078
+ - type: ndcg_at_1000
1079
+ value: 11.631
1080
+ - type: ndcg_at_3
1081
+ value: 5.176
1082
+ - type: ndcg_at_5
1083
+ value: 5.633
1084
+ - type: precision_at_1
1085
+ value: 4.251
1086
+ - type: precision_at_10
1087
+ value: 0.98
1088
+ - type: precision_at_100
1089
+ value: 0.259
1090
+ - type: precision_at_1000
1091
+ value: 0.053
1092
+ - type: precision_at_3
1093
+ value: 2.2800000000000002
1094
+ - type: precision_at_5
1095
+ value: 1.627
1096
+ - type: recall_at_1
1097
+ value: 3.771
1098
+ - type: recall_at_10
1099
+ value: 8.731
1100
+ - type: recall_at_100
1101
+ value: 22.517
1102
+ - type: recall_at_1000
1103
+ value: 44.183
1104
+ - type: recall_at_3
1105
+ value: 5.866
1106
+ - type: recall_at_5
1107
+ value: 7.066999999999999
1108
+ - task:
1109
+ type: Retrieval
1110
+ dataset:
1111
+ type: climate-fever
1112
+ name: MTEB ClimateFEVER
1113
+ config: default
1114
+ split: test
1115
+ revision: None
1116
+ metrics:
1117
+ - type: map_at_1
1118
+ value: 0.543
1119
+ - type: map_at_10
1120
+ value: 1.027
1121
+ - type: map_at_100
1122
+ value: 1.228
1123
+ - type: map_at_1000
1124
+ value: 1.266
1125
+ - type: map_at_3
1126
+ value: 0.756
1127
+ - type: map_at_5
1128
+ value: 0.877
1129
+ - type: mrr_at_1
1130
+ value: 1.3679999999999999
1131
+ - type: mrr_at_10
1132
+ value: 2.474
1133
+ - type: mrr_at_100
1134
+ value: 2.8369999999999997
1135
+ - type: mrr_at_1000
1136
+ value: 2.894
1137
+ - type: mrr_at_3
1138
+ value: 1.8780000000000001
1139
+ - type: mrr_at_5
1140
+ value: 2.1319999999999997
1141
+ - type: ndcg_at_1
1142
+ value: 1.3679999999999999
1143
+ - type: ndcg_at_10
1144
+ value: 1.791
1145
+ - type: ndcg_at_100
1146
+ value: 3.06
1147
+ - type: ndcg_at_1000
1148
+ value: 4.501
1149
+ - type: ndcg_at_3
1150
+ value: 1.16
1151
+ - type: ndcg_at_5
1152
+ value: 1.3419999999999999
1153
+ - type: precision_at_1
1154
+ value: 1.3679999999999999
1155
+ - type: precision_at_10
1156
+ value: 0.697
1157
+ - type: precision_at_100
1158
+ value: 0.193
1159
+ - type: precision_at_1000
1160
+ value: 0.045
1161
+ - type: precision_at_3
1162
+ value: 0.9339999999999999
1163
+ - type: precision_at_5
1164
+ value: 0.808
1165
+ - type: recall_at_1
1166
+ value: 0.543
1167
+ - type: recall_at_10
1168
+ value: 2.5149999999999997
1169
+ - type: recall_at_100
1170
+ value: 7.356999999999999
1171
+ - type: recall_at_1000
1172
+ value: 16.233
1173
+ - type: recall_at_3
1174
+ value: 1.018
1175
+ - type: recall_at_5
1176
+ value: 1.5150000000000001
1177
+ - task:
1178
+ type: Retrieval
1179
+ dataset:
1180
+ type: dbpedia-entity
1181
+ name: MTEB DBPedia
1182
+ config: default
1183
+ split: test
1184
+ revision: None
1185
+ metrics:
1186
+ - type: map_at_1
1187
+ value: 0.541
1188
+ - type: map_at_10
1189
+ value: 1.1560000000000001
1190
+ - type: map_at_100
1191
+ value: 1.508
1192
+ - type: map_at_1000
1193
+ value: 1.598
1194
+ - type: map_at_3
1195
+ value: 0.918
1196
+ - type: map_at_5
1197
+ value: 0.992
1198
+ - type: mrr_at_1
1199
+ value: 9.5
1200
+ - type: mrr_at_10
1201
+ value: 13.446
1202
+ - type: mrr_at_100
1203
+ value: 13.935
1204
+ - type: mrr_at_1000
1205
+ value: 14.008999999999999
1206
+ - type: mrr_at_3
1207
+ value: 12.083
1208
+ - type: mrr_at_5
1209
+ value: 12.733
1210
+ - type: ndcg_at_1
1211
+ value: 5.75
1212
+ - type: ndcg_at_10
1213
+ value: 3.9210000000000003
1214
+ - type: ndcg_at_100
1215
+ value: 3.975
1216
+ - type: ndcg_at_1000
1217
+ value: 5.634
1218
+ - type: ndcg_at_3
1219
+ value: 4.87
1220
+ - type: ndcg_at_5
1221
+ value: 4.259
1222
+ - type: precision_at_1
1223
+ value: 9.5
1224
+ - type: precision_at_10
1225
+ value: 3.9
1226
+ - type: precision_at_100
1227
+ value: 1.015
1228
+ - type: precision_at_1000
1229
+ value: 0.297
1230
+ - type: precision_at_3
1231
+ value: 6.75
1232
+ - type: precision_at_5
1233
+ value: 5.25
1234
+ - type: recall_at_1
1235
+ value: 0.541
1236
+ - type: recall_at_10
1237
+ value: 2.228
1238
+ - type: recall_at_100
1239
+ value: 4.9430000000000005
1240
+ - type: recall_at_1000
1241
+ value: 11.661000000000001
1242
+ - type: recall_at_3
1243
+ value: 1.264
1244
+ - type: recall_at_5
1245
+ value: 1.4869999999999999
1246
+ - task:
1247
+ type: Classification
1248
+ dataset:
1249
+ type: mteb/emotion
1250
+ name: MTEB EmotionClassification
1251
+ config: default
1252
+ split: test
1253
+ revision: 4f58c6b202a23cf9a4da393831edf4f9183cad37
1254
+ metrics:
1255
+ - type: accuracy
1256
+ value: 36.52
1257
+ - type: f1
1258
+ value: 33.66164203159101
1259
+ - task:
1260
+ type: Retrieval
1261
+ dataset:
1262
+ type: fever
1263
+ name: MTEB FEVER
1264
+ config: default
1265
+ split: test
1266
+ revision: None
1267
+ metrics:
1268
+ - type: map_at_1
1269
+ value: 0.9249999999999999
1270
+ - type: map_at_10
1271
+ value: 1.311
1272
+ - type: map_at_100
1273
+ value: 1.363
1274
+ - type: map_at_1000
1275
+ value: 1.376
1276
+ - type: map_at_3
1277
+ value: 1.145
1278
+ - type: map_at_5
1279
+ value: 1.233
1280
+ - type: mrr_at_1
1281
+ value: 0.975
1282
+ - type: mrr_at_10
1283
+ value: 1.371
1284
+ - type: mrr_at_100
1285
+ value: 1.426
1286
+ - type: mrr_at_1000
1287
+ value: 1.439
1288
+ - type: mrr_at_3
1289
+ value: 1.195
1290
+ - type: mrr_at_5
1291
+ value: 1.286
1292
+ - type: ndcg_at_1
1293
+ value: 0.975
1294
+ - type: ndcg_at_10
1295
+ value: 1.5859999999999999
1296
+ - type: ndcg_at_100
1297
+ value: 1.8800000000000001
1298
+ - type: ndcg_at_1000
1299
+ value: 2.313
1300
+ - type: ndcg_at_3
1301
+ value: 1.229
1302
+ - type: ndcg_at_5
1303
+ value: 1.388
1304
+ - type: precision_at_1
1305
+ value: 0.975
1306
+ - type: precision_at_10
1307
+ value: 0.254
1308
+ - type: precision_at_100
1309
+ value: 0.041
1310
+ - type: precision_at_1000
1311
+ value: 0.008
1312
+ - type: precision_at_3
1313
+ value: 0.49
1314
+ - type: precision_at_5
1315
+ value: 0.375
1316
+ - type: recall_at_1
1317
+ value: 0.9249999999999999
1318
+ - type: recall_at_10
1319
+ value: 2.4250000000000003
1320
+ - type: recall_at_100
1321
+ value: 3.866
1322
+ - type: recall_at_1000
1323
+ value: 7.401000000000001
1324
+ - type: recall_at_3
1325
+ value: 1.4200000000000002
1326
+ - type: recall_at_5
1327
+ value: 1.81
1328
+ - task:
1329
+ type: Retrieval
1330
+ dataset:
1331
+ type: fiqa
1332
+ name: MTEB FiQA2018
1333
+ config: default
1334
+ split: test
1335
+ revision: None
1336
+ metrics:
1337
+ - type: map_at_1
1338
+ value: 1.032
1339
+ - type: map_at_10
1340
+ value: 1.8849999999999998
1341
+ - type: map_at_100
1342
+ value: 2.167
1343
+ - type: map_at_1000
1344
+ value: 2.266
1345
+ - type: map_at_3
1346
+ value: 1.609
1347
+ - type: map_at_5
1348
+ value: 1.7680000000000002
1349
+ - type: mrr_at_1
1350
+ value: 2.6229999999999998
1351
+ - type: mrr_at_10
1352
+ value: 4.479
1353
+ - type: mrr_at_100
1354
+ value: 4.92
1355
+ - type: mrr_at_1000
1356
+ value: 5.029999999999999
1357
+ - type: mrr_at_3
1358
+ value: 3.7289999999999996
1359
+ - type: mrr_at_5
1360
+ value: 4.138
1361
+ - type: ndcg_at_1
1362
+ value: 2.6229999999999998
1363
+ - type: ndcg_at_10
1364
+ value: 3.005
1365
+ - type: ndcg_at_100
1366
+ value: 5.01
1367
+ - type: ndcg_at_1000
1368
+ value: 8.312
1369
+ - type: ndcg_at_3
1370
+ value: 2.548
1371
+ - type: ndcg_at_5
1372
+ value: 2.735
1373
+ - type: precision_at_1
1374
+ value: 2.6229999999999998
1375
+ - type: precision_at_10
1376
+ value: 1.049
1377
+ - type: precision_at_100
1378
+ value: 0.31
1379
+ - type: precision_at_1000
1380
+ value: 0.089
1381
+ - type: precision_at_3
1382
+ value: 1.955
1383
+ - type: precision_at_5
1384
+ value: 1.574
1385
+ - type: recall_at_1
1386
+ value: 1.032
1387
+ - type: recall_at_10
1388
+ value: 3.888
1389
+ - type: recall_at_100
1390
+ value: 12.414
1391
+ - type: recall_at_1000
1392
+ value: 33.823
1393
+ - type: recall_at_3
1394
+ value: 2.37
1395
+ - type: recall_at_5
1396
+ value: 3.077
1397
+ - task:
1398
+ type: Retrieval
1399
+ dataset:
1400
+ type: hotpotqa
1401
+ name: MTEB HotpotQA
1402
+ config: default
1403
+ split: test
1404
+ revision: None
1405
+ metrics:
1406
+ - type: map_at_1
1407
+ value: 6.813
1408
+ - type: map_at_10
1409
+ value: 9.49
1410
+ - type: map_at_100
1411
+ value: 9.959
1412
+ - type: map_at_1000
1413
+ value: 10.024
1414
+ - type: map_at_3
1415
+ value: 8.618
1416
+ - type: map_at_5
1417
+ value: 9.084
1418
+ - type: mrr_at_1
1419
+ value: 13.626
1420
+ - type: mrr_at_10
1421
+ value: 17.818
1422
+ - type: mrr_at_100
1423
+ value: 18.412
1424
+ - type: mrr_at_1000
1425
+ value: 18.482000000000003
1426
+ - type: mrr_at_3
1427
+ value: 16.506999999999998
1428
+ - type: mrr_at_5
1429
+ value: 17.219
1430
+ - type: ndcg_at_1
1431
+ value: 13.626
1432
+ - type: ndcg_at_10
1433
+ value: 12.959999999999999
1434
+ - type: ndcg_at_100
1435
+ value: 15.562999999999999
1436
+ - type: ndcg_at_1000
1437
+ value: 17.571
1438
+ - type: ndcg_at_3
1439
+ value: 10.995000000000001
1440
+ - type: ndcg_at_5
1441
+ value: 11.908000000000001
1442
+ - type: precision_at_1
1443
+ value: 13.626
1444
+ - type: precision_at_10
1445
+ value: 2.995
1446
+ - type: precision_at_100
1447
+ value: 0.51
1448
+ - type: precision_at_1000
1449
+ value: 0.078
1450
+ - type: precision_at_3
1451
+ value: 7.000000000000001
1452
+ - type: precision_at_5
1453
+ value: 4.926
1454
+ - type: recall_at_1
1455
+ value: 6.813
1456
+ - type: recall_at_10
1457
+ value: 14.976
1458
+ - type: recall_at_100
1459
+ value: 25.517
1460
+ - type: recall_at_1000
1461
+ value: 39.095
1462
+ - type: recall_at_3
1463
+ value: 10.5
1464
+ - type: recall_at_5
1465
+ value: 12.316
1466
+ - task:
1467
+ type: Classification
1468
+ dataset:
1469
+ type: mteb/imdb
1470
+ name: MTEB ImdbClassification
1471
+ config: default
1472
+ split: test
1473
+ revision: 3d86128a09e091d6018b6d26cad27f2739fc2db7
1474
+ metrics:
1475
+ - type: accuracy
1476
+ value: 55.2292
1477
+ - type: ap
1478
+ value: 53.00916532305935
1479
+ - type: f1
1480
+ value: 54.6906813069184
1481
+ - task:
1482
+ type: Retrieval
1483
+ dataset:
1484
+ type: msmarco
1485
+ name: MTEB MSMARCO
1486
+ config: default
1487
+ split: dev
1488
+ revision: None
1489
+ metrics:
1490
+ - type: map_at_1
1491
+ value: 1.203
1492
+ - type: map_at_10
1493
+ value: 2.27
1494
+ - type: map_at_100
1495
+ value: 2.5860000000000003
1496
+ - type: map_at_1000
1497
+ value: 2.661
1498
+ - type: map_at_3
1499
+ value: 1.8159999999999998
1500
+ - type: map_at_5
1501
+ value: 2.037
1502
+ - type: mrr_at_1
1503
+ value: 1.232
1504
+ - type: mrr_at_10
1505
+ value: 2.338
1506
+ - type: mrr_at_100
1507
+ value: 2.665
1508
+ - type: mrr_at_1000
1509
+ value: 2.7390000000000003
1510
+ - type: mrr_at_3
1511
+ value: 1.87
1512
+ - type: mrr_at_5
1513
+ value: 2.1
1514
+ - type: ndcg_at_1
1515
+ value: 1.232
1516
+ - type: ndcg_at_10
1517
+ value: 3.005
1518
+ - type: ndcg_at_100
1519
+ value: 4.936
1520
+ - type: ndcg_at_1000
1521
+ value: 7.441000000000001
1522
+ - type: ndcg_at_3
1523
+ value: 2.036
1524
+ - type: ndcg_at_5
1525
+ value: 2.435
1526
+ - type: precision_at_1
1527
+ value: 1.232
1528
+ - type: precision_at_10
1529
+ value: 0.549
1530
+ - type: precision_at_100
1531
+ value: 0.158
1532
+ - type: precision_at_1000
1533
+ value: 0.038
1534
+ - type: precision_at_3
1535
+ value: 0.903
1536
+ - type: precision_at_5
1537
+ value: 0.739
1538
+ - type: recall_at_1
1539
+ value: 1.203
1540
+ - type: recall_at_10
1541
+ value: 5.332
1542
+ - type: recall_at_100
1543
+ value: 15.164
1544
+ - type: recall_at_1000
1545
+ value: 35.831
1546
+ - type: recall_at_3
1547
+ value: 2.622
1548
+ - type: recall_at_5
1549
+ value: 3.572
1550
+ - task:
1551
+ type: Classification
1552
+ dataset:
1553
+ type: mteb/mtop_domain
1554
+ name: MTEB MTOPDomainClassification (en)
1555
+ config: en
1556
+ split: test
1557
+ revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf
1558
+ metrics:
1559
+ - type: accuracy
1560
+ value: 88.25809393524851
1561
+ - type: f1
1562
+ value: 87.67467702138386
1563
+ - task:
1564
+ type: Classification
1565
+ dataset:
1566
+ type: mteb/mtop_intent
1567
+ name: MTEB MTOPIntentClassification (en)
1568
+ config: en
1569
+ split: test
1570
+ revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba
1571
+ metrics:
1572
+ - type: accuracy
1573
+ value: 63.28545371637026
1574
+ - type: f1
1575
+ value: 39.28010634448113
1576
+ - task:
1577
+ type: Classification
1578
+ dataset:
1579
+ type: mteb/amazon_massive_intent
1580
+ name: MTEB MassiveIntentClassification (en)
1581
+ config: en
1582
+ split: test
1583
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1584
+ metrics:
1585
+ - type: accuracy
1586
+ value: 57.871553463349024
1587
+ - type: f1
1588
+ value: 55.48077228016125
1589
+ - task:
1590
+ type: Classification
1591
+ dataset:
1592
+ type: mteb/amazon_massive_scenario
1593
+ name: MTEB MassiveScenarioClassification (en)
1594
+ config: en
1595
+ split: test
1596
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1597
+ metrics:
1598
+ - type: accuracy
1599
+ value: 64.14593140551446
1600
+ - type: f1
1601
+ value: 62.99257031840126
1602
+ - task:
1603
+ type: Clustering
1604
+ dataset:
1605
+ type: mteb/medrxiv-clustering-p2p
1606
+ name: MTEB MedrxivClusteringP2P
1607
+ config: default
1608
+ split: test
1609
+ revision: e7a26af6f3ae46b30dde8737f02c07b1505bcc73
1610
+ metrics:
1611
+ - type: v_measure
1612
+ value: 19.340284691485483
1613
+ - task:
1614
+ type: Clustering
1615
+ dataset:
1616
+ type: mteb/medrxiv-clustering-s2s
1617
+ name: MTEB MedrxivClusteringS2S
1618
+ config: default
1619
+ split: test
1620
+ revision: 35191c8c0dca72d8ff3efcd72aa802307d469663
1621
+ metrics:
1622
+ - type: v_measure
1623
+ value: 17.003121027783283
1624
+ - task:
1625
+ type: Reranking
1626
+ dataset:
1627
+ type: mteb/mind_small
1628
+ name: MTEB MindSmallReranking
1629
+ config: default
1630
+ split: test
1631
+ revision: 3bdac13927fdc888b903db93b2ffdbd90b295a69
1632
+ metrics:
1633
+ - type: map
1634
+ value: 26.880558370137575
1635
+ - type: mrr
1636
+ value: 27.22989883408136
1637
+ - task:
1638
+ type: Retrieval
1639
+ dataset:
1640
+ type: nfcorpus
1641
+ name: MTEB NFCorpus
1642
+ config: default
1643
+ split: test
1644
+ revision: None
1645
+ metrics:
1646
+ - type: map_at_1
1647
+ value: 0.443
1648
+ - type: map_at_10
1649
+ value: 1.189
1650
+ - type: map_at_100
1651
+ value: 2.221
1652
+ - type: map_at_1000
1653
+ value: 3.034
1654
+ - type: map_at_3
1655
+ value: 0.683
1656
+ - type: map_at_5
1657
+ value: 0.882
1658
+ - type: mrr_at_1
1659
+ value: 4.334
1660
+ - type: mrr_at_10
1661
+ value: 10.908
1662
+ - type: mrr_at_100
1663
+ value: 12.536
1664
+ - type: mrr_at_1000
1665
+ value: 12.642000000000001
1666
+ - type: mrr_at_3
1667
+ value: 7.481999999999999
1668
+ - type: mrr_at_5
1669
+ value: 9.324
1670
+ - type: ndcg_at_1
1671
+ value: 3.7150000000000003
1672
+ - type: ndcg_at_10
1673
+ value: 5.591
1674
+ - type: ndcg_at_100
1675
+ value: 9.522
1676
+ - type: ndcg_at_1000
1677
+ value: 19.705000000000002
1678
+ - type: ndcg_at_3
1679
+ value: 4.292
1680
+ - type: ndcg_at_5
1681
+ value: 5.038
1682
+ - type: precision_at_1
1683
+ value: 4.334
1684
+ - type: precision_at_10
1685
+ value: 5.077
1686
+ - type: precision_at_100
1687
+ value: 3.2910000000000004
1688
+ - type: precision_at_1000
1689
+ value: 1.568
1690
+ - type: precision_at_3
1691
+ value: 4.644
1692
+ - type: precision_at_5
1693
+ value: 5.139
1694
+ - type: recall_at_1
1695
+ value: 0.443
1696
+ - type: recall_at_10
1697
+ value: 3.3520000000000003
1698
+ - type: recall_at_100
1699
+ value: 15.515
1700
+ - type: recall_at_1000
1701
+ value: 50.505
1702
+ - type: recall_at_3
1703
+ value: 0.931
1704
+ - type: recall_at_5
1705
+ value: 1.698
1706
+ - task:
1707
+ type: Retrieval
1708
+ dataset:
1709
+ type: nq
1710
+ name: MTEB NQ
1711
+ config: default
1712
+ split: test
1713
+ revision: None
1714
+ metrics:
1715
+ - type: map_at_1
1716
+ value: 0.439
1717
+ - type: map_at_10
1718
+ value: 0.6839999999999999
1719
+ - type: map_at_100
1720
+ value: 0.769
1721
+ - type: map_at_1000
1722
+ value: 0.79
1723
+ - type: map_at_3
1724
+ value: 0.584
1725
+ - type: map_at_5
1726
+ value: 0.621
1727
+ - type: mrr_at_1
1728
+ value: 0.5499999999999999
1729
+ - type: mrr_at_10
1730
+ value: 0.819
1731
+ - type: mrr_at_100
1732
+ value: 0.9169999999999999
1733
+ - type: mrr_at_1000
1734
+ value: 0.9400000000000001
1735
+ - type: mrr_at_3
1736
+ value: 0.705
1737
+ - type: mrr_at_5
1738
+ value: 0.75
1739
+ - type: ndcg_at_1
1740
+ value: 0.5499999999999999
1741
+ - type: ndcg_at_10
1742
+ value: 0.886
1743
+ - type: ndcg_at_100
1744
+ value: 1.422
1745
+ - type: ndcg_at_1000
1746
+ value: 2.2079999999999997
1747
+ - type: ndcg_at_3
1748
+ value: 0.6629999999999999
1749
+ - type: ndcg_at_5
1750
+ value: 0.735
1751
+ - type: precision_at_1
1752
+ value: 0.5499999999999999
1753
+ - type: precision_at_10
1754
+ value: 0.16199999999999998
1755
+ - type: precision_at_100
1756
+ value: 0.048
1757
+ - type: precision_at_1000
1758
+ value: 0.012
1759
+ - type: precision_at_3
1760
+ value: 0.309
1761
+ - type: precision_at_5
1762
+ value: 0.22599999999999998
1763
+ - type: recall_at_1
1764
+ value: 0.439
1765
+ - type: recall_at_10
1766
+ value: 1.405
1767
+ - type: recall_at_100
1768
+ value: 4.051
1769
+ - type: recall_at_1000
1770
+ value: 10.487
1771
+ - type: recall_at_3
1772
+ value: 0.787
1773
+ - type: recall_at_5
1774
+ value: 0.9560000000000001
1775
+ - task:
1776
+ type: Retrieval
1777
+ dataset:
1778
+ type: quora
1779
+ name: MTEB QuoraRetrieval
1780
+ config: default
1781
+ split: test
1782
+ revision: None
1783
+ metrics:
1784
+ - type: map_at_1
1785
+ value: 61.451
1786
+ - type: map_at_10
1787
+ value: 73.898
1788
+ - type: map_at_100
1789
+ value: 74.72800000000001
1790
+ - type: map_at_1000
1791
+ value: 74.766
1792
+ - type: map_at_3
1793
+ value: 70.994
1794
+ - type: map_at_5
1795
+ value: 72.74000000000001
1796
+ - type: mrr_at_1
1797
+ value: 70.94
1798
+ - type: mrr_at_10
1799
+ value: 78.35600000000001
1800
+ - type: mrr_at_100
1801
+ value: 78.64
1802
+ - type: mrr_at_1000
1803
+ value: 78.647
1804
+ - type: mrr_at_3
1805
+ value: 76.912
1806
+ - type: mrr_at_5
1807
+ value: 77.81
1808
+ - type: ndcg_at_1
1809
+ value: 70.93
1810
+ - type: ndcg_at_10
1811
+ value: 78.622
1812
+ - type: ndcg_at_100
1813
+ value: 81.00699999999999
1814
+ - type: ndcg_at_1000
1815
+ value: 81.453
1816
+ - type: ndcg_at_3
1817
+ value: 75.03999999999999
1818
+ - type: ndcg_at_5
1819
+ value: 76.839
1820
+ - type: precision_at_1
1821
+ value: 70.93
1822
+ - type: precision_at_10
1823
+ value: 11.953
1824
+ - type: precision_at_100
1825
+ value: 1.4489999999999998
1826
+ - type: precision_at_1000
1827
+ value: 0.154
1828
+ - type: precision_at_3
1829
+ value: 32.65
1830
+ - type: precision_at_5
1831
+ value: 21.598
1832
+ - type: recall_at_1
1833
+ value: 61.451
1834
+ - type: recall_at_10
1835
+ value: 87.608
1836
+ - type: recall_at_100
1837
+ value: 96.818
1838
+ - type: recall_at_1000
1839
+ value: 99.445
1840
+ - type: recall_at_3
1841
+ value: 77.348
1842
+ - type: recall_at_5
1843
+ value: 82.334
1844
+ - task:
1845
+ type: Clustering
1846
+ dataset:
1847
+ type: mteb/reddit-clustering
1848
+ name: MTEB RedditClustering
1849
+ config: default
1850
+ split: test
1851
+ revision: 24640382cdbf8abc73003fb0fa6d111a705499eb
1852
+ metrics:
1853
+ - type: v_measure
1854
+ value: 18.928935618274824
1855
+ - task:
1856
+ type: Clustering
1857
+ dataset:
1858
+ type: mteb/reddit-clustering-p2p
1859
+ name: MTEB RedditClusteringP2P
1860
+ config: default
1861
+ split: test
1862
+ revision: 282350215ef01743dc01b456c7f5241fa8937f16
1863
+ metrics:
1864
+ - type: v_measure
1865
+ value: 35.948929675640414
1866
+ - task:
1867
+ type: Retrieval
1868
+ dataset:
1869
+ type: scidocs
1870
+ name: MTEB SCIDOCS
1871
+ config: default
1872
+ split: test
1873
+ revision: None
1874
+ metrics:
1875
+ - type: map_at_1
1876
+ value: 0.52
1877
+ - type: map_at_10
1878
+ value: 0.893
1879
+ - type: map_at_100
1880
+ value: 1.113
1881
+ - type: map_at_1000
1882
+ value: 1.304
1883
+ - type: map_at_3
1884
+ value: 0.7779999999999999
1885
+ - type: map_at_5
1886
+ value: 0.8200000000000001
1887
+ - type: mrr_at_1
1888
+ value: 2.6
1889
+ - type: mrr_at_10
1890
+ value: 4.0680000000000005
1891
+ - type: mrr_at_100
1892
+ value: 4.6080000000000005
1893
+ - type: mrr_at_1000
1894
+ value: 4.797
1895
+ - type: mrr_at_3
1896
+ value: 3.5999999999999996
1897
+ - type: mrr_at_5
1898
+ value: 3.8150000000000004
1899
+ - type: ndcg_at_1
1900
+ value: 2.6
1901
+ - type: ndcg_at_10
1902
+ value: 1.79
1903
+ - type: ndcg_at_100
1904
+ value: 3.5549999999999997
1905
+ - type: ndcg_at_1000
1906
+ value: 9.942
1907
+ - type: ndcg_at_3
1908
+ value: 1.94
1909
+ - type: ndcg_at_5
1910
+ value: 1.543
1911
+ - type: precision_at_1
1912
+ value: 2.6
1913
+ - type: precision_at_10
1914
+ value: 0.8500000000000001
1915
+ - type: precision_at_100
1916
+ value: 0.361
1917
+ - type: precision_at_1000
1918
+ value: 0.197
1919
+ - type: precision_at_3
1920
+ value: 1.7670000000000001
1921
+ - type: precision_at_5
1922
+ value: 1.26
1923
+ - type: recall_at_1
1924
+ value: 0.52
1925
+ - type: recall_at_10
1926
+ value: 1.7149999999999999
1927
+ - type: recall_at_100
1928
+ value: 7.318
1929
+ - type: recall_at_1000
1930
+ value: 39.915
1931
+ - type: recall_at_3
1932
+ value: 1.0699999999999998
1933
+ - type: recall_at_5
1934
+ value: 1.27
1935
+ - task:
1936
+ type: STS
1937
+ dataset:
1938
+ type: mteb/sickr-sts
1939
+ name: MTEB SICK-R
1940
+ config: default
1941
+ split: test
1942
+ revision: a6ea5a8cab320b040a23452cc28066d9beae2cee
1943
+ metrics:
1944
+ - type: cos_sim_pearson
1945
+ value: 67.0394316443087
1946
+ - type: cos_sim_spearman
1947
+ value: 62.93973839554845
1948
+ - type: euclidean_pearson
1949
+ value: 57.60094512966203
1950
+ - type: euclidean_spearman
1951
+ value: 57.05926985559664
1952
+ - type: manhattan_pearson
1953
+ value: 57.53054316732484
1954
+ - type: manhattan_spearman
1955
+ value: 56.98810707222501
1956
+ - task:
1957
+ type: STS
1958
+ dataset:
1959
+ type: mteb/sts12-sts
1960
+ name: MTEB STS12
1961
+ config: default
1962
+ split: test
1963
+ revision: a0d554a64d88156834ff5ae9920b964011b16384
1964
+ metrics:
1965
+ - type: cos_sim_pearson
1966
+ value: 61.62220407968201
1967
+ - type: cos_sim_spearman
1968
+ value: 65.46331444956428
1969
+ - type: euclidean_pearson
1970
+ value: 53.17721859223576
1971
+ - type: euclidean_spearman
1972
+ value: 62.26490113361859
1973
+ - type: manhattan_pearson
1974
+ value: 53.24730859766875
1975
+ - type: manhattan_spearman
1976
+ value: 62.27695125302589
1977
+ - task:
1978
+ type: STS
1979
+ dataset:
1980
+ type: mteb/sts13-sts
1981
+ name: MTEB STS13
1982
+ config: default
1983
+ split: test
1984
+ revision: 7e90230a92c190f1bf69ae9002b8cea547a64cca
1985
+ metrics:
1986
+ - type: cos_sim_pearson
1987
+ value: 60.32974355127381
1988
+ - type: cos_sim_spearman
1989
+ value: 62.786126823027246
1990
+ - type: euclidean_pearson
1991
+ value: 48.85507668127239
1992
+ - type: euclidean_spearman
1993
+ value: 50.87786603451179
1994
+ - type: manhattan_pearson
1995
+ value: 49.12859466063693
1996
+ - type: manhattan_spearman
1997
+ value: 50.84858327663952
1998
+ - task:
1999
+ type: STS
2000
+ dataset:
2001
+ type: mteb/sts14-sts
2002
+ name: MTEB STS14
2003
+ config: default
2004
+ split: test
2005
+ revision: 6031580fec1f6af667f0bd2da0a551cf4f0b2375
2006
+ metrics:
2007
+ - type: cos_sim_pearson
2008
+ value: 59.1627744693388
2009
+ - type: cos_sim_spearman
2010
+ value: 57.53692924942505
2011
+ - type: euclidean_pearson
2012
+ value: 43.86657039278782
2013
+ - type: euclidean_spearman
2014
+ value: 45.082440020418424
2015
+ - type: manhattan_pearson
2016
+ value: 43.955740479348044
2017
+ - type: manhattan_spearman
2018
+ value: 45.15905727160372
2019
+ - task:
2020
+ type: STS
2021
+ dataset:
2022
+ type: mteb/sts15-sts
2023
+ name: MTEB STS15
2024
+ config: default
2025
+ split: test
2026
+ revision: ae752c7c21bf194d8b67fd573edf7ae58183cbe3
2027
+ metrics:
2028
+ - type: cos_sim_pearson
2029
+ value: 74.42588616006334
2030
+ - type: cos_sim_spearman
2031
+ value: 74.25087851075787
2032
+ - type: euclidean_pearson
2033
+ value: 63.646746727259774
2034
+ - type: euclidean_spearman
2035
+ value: 63.150219043712106
2036
+ - type: manhattan_pearson
2037
+ value: 63.5341614083317
2038
+ - type: manhattan_spearman
2039
+ value: 63.00883784164611
2040
+ - task:
2041
+ type: STS
2042
+ dataset:
2043
+ type: mteb/sts16-sts
2044
+ name: MTEB STS16
2045
+ config: default
2046
+ split: test
2047
+ revision: 4d8694f8f0e0100860b497b999b3dbed754a0513
2048
+ metrics:
2049
+ - type: cos_sim_pearson
2050
+ value: 75.77242395196524
2051
+ - type: cos_sim_spearman
2052
+ value: 75.72930700521489
2053
+ - type: euclidean_pearson
2054
+ value: 68.76523039736611
2055
+ - type: euclidean_spearman
2056
+ value: 67.96962494828459
2057
+ - type: manhattan_pearson
2058
+ value: 68.66742487680166
2059
+ - type: manhattan_spearman
2060
+ value: 67.89168383123581
2061
+ - task:
2062
+ type: STS
2063
+ dataset:
2064
+ type: mteb/sts17-crosslingual-sts
2065
+ name: MTEB STS17 (en-en)
2066
+ config: en-en
2067
+ split: test
2068
+ revision: af5e6fb845001ecf41f4c1e033ce921939a2a68d
2069
+ metrics:
2070
+ - type: cos_sim_pearson
2071
+ value: 80.04007186284058
2072
+ - type: cos_sim_spearman
2073
+ value: 79.94429611477106
2074
+ - type: euclidean_pearson
2075
+ value: 73.04121359782312
2076
+ - type: euclidean_spearman
2077
+ value: 72.46378547225223
2078
+ - type: manhattan_pearson
2079
+ value: 73.20754563807353
2080
+ - type: manhattan_spearman
2081
+ value: 72.61008679959097
2082
+ - task:
2083
+ type: STS
2084
+ dataset:
2085
+ type: mteb/sts22-crosslingual-sts
2086
+ name: MTEB STS22 (en)
2087
+ config: en
2088
+ split: test
2089
+ revision: 6d1ba47164174a496b7fa5d3569dae26a6813b80
2090
+ metrics:
2091
+ - type: cos_sim_pearson
2092
+ value: 34.55806706564699
2093
+ - type: cos_sim_spearman
2094
+ value: 46.69742358797615
2095
+ - type: euclidean_pearson
2096
+ value: 39.776484084081034
2097
+ - type: euclidean_spearman
2098
+ value: 48.41914464646695
2099
+ - type: manhattan_pearson
2100
+ value: 44.80416657869655
2101
+ - type: manhattan_spearman
2102
+ value: 50.73215508057123
2103
+ - task:
2104
+ type: STS
2105
+ dataset:
2106
+ type: mteb/stsbenchmark-sts
2107
+ name: MTEB STSBenchmark
2108
+ config: default
2109
+ split: test
2110
+ revision: b0fddb56ed78048fa8b90373c8a3cfc37b684831
2111
+ metrics:
2112
+ - type: cos_sim_pearson
2113
+ value: 67.84222997484147
2114
+ - type: cos_sim_spearman
2115
+ value: 67.39086924655895
2116
+ - type: euclidean_pearson
2117
+ value: 51.87216665821589
2118
+ - type: euclidean_spearman
2119
+ value: 51.309915218441695
2120
+ - type: manhattan_pearson
2121
+ value: 51.871943884893454
2122
+ - type: manhattan_spearman
2123
+ value: 51.271356979504375
2124
+ - task:
2125
+ type: Reranking
2126
+ dataset:
2127
+ type: mteb/scidocs-reranking
2128
+ name: MTEB SciDocsRR
2129
+ config: default
2130
+ split: test
2131
+ revision: d3c5e1fc0b855ab6097bf1cda04dd73947d7caab
2132
+ metrics:
2133
+ - type: map
2134
+ value: 68.36051662289248
2135
+ - type: mrr
2136
+ value: 89.39224265204656
2137
+ - task:
2138
+ type: Retrieval
2139
+ dataset:
2140
+ type: scifact
2141
+ name: MTEB SciFact
2142
+ config: default
2143
+ split: test
2144
+ revision: None
2145
+ metrics:
2146
+ - type: map_at_1
2147
+ value: 23.721999999999998
2148
+ - type: map_at_10
2149
+ value: 31.335
2150
+ - type: map_at_100
2151
+ value: 32.461
2152
+ - type: map_at_1000
2153
+ value: 32.557
2154
+ - type: map_at_3
2155
+ value: 29.282000000000004
2156
+ - type: map_at_5
2157
+ value: 30.602
2158
+ - type: mrr_at_1
2159
+ value: 24.667
2160
+ - type: mrr_at_10
2161
+ value: 32.363
2162
+ - type: mrr_at_100
2163
+ value: 33.421
2164
+ - type: mrr_at_1000
2165
+ value: 33.499
2166
+ - type: mrr_at_3
2167
+ value: 30.444
2168
+ - type: mrr_at_5
2169
+ value: 31.628
2170
+ - type: ndcg_at_1
2171
+ value: 24.667
2172
+ - type: ndcg_at_10
2173
+ value: 35.29
2174
+ - type: ndcg_at_100
2175
+ value: 40.665
2176
+ - type: ndcg_at_1000
2177
+ value: 43.241
2178
+ - type: ndcg_at_3
2179
+ value: 31.238
2180
+ - type: ndcg_at_5
2181
+ value: 33.486
2182
+ - type: precision_at_1
2183
+ value: 24.667
2184
+ - type: precision_at_10
2185
+ value: 5.1
2186
+ - type: precision_at_100
2187
+ value: 0.7969999999999999
2188
+ - type: precision_at_1000
2189
+ value: 0.10300000000000001
2190
+ - type: precision_at_3
2191
+ value: 12.667
2192
+ - type: precision_at_5
2193
+ value: 8.933
2194
+ - type: recall_at_1
2195
+ value: 23.721999999999998
2196
+ - type: recall_at_10
2197
+ value: 46.417
2198
+ - type: recall_at_100
2199
+ value: 70.944
2200
+ - type: recall_at_1000
2201
+ value: 91.033
2202
+ - type: recall_at_3
2203
+ value: 35.693999999999996
2204
+ - type: recall_at_5
2205
+ value: 40.944
2206
+ - task:
2207
+ type: PairClassification
2208
+ dataset:
2209
+ type: mteb/sprintduplicatequestions-pairclassification
2210
+ name: MTEB SprintDuplicateQuestions
2211
+ config: default
2212
+ split: test
2213
+ revision: d66bd1f72af766a5cc4b0ca5e00c162f89e8cc46
2214
+ metrics:
2215
+ - type: cos_sim_accuracy
2216
+ value: 99.5
2217
+ - type: cos_sim_ap
2218
+ value: 77.07584119570414
2219
+ - type: cos_sim_f1
2220
+ value: 71.8864950078823
2221
+ - type: cos_sim_precision
2222
+ value: 75.74750830564784
2223
+ - type: cos_sim_recall
2224
+ value: 68.4
2225
+ - type: dot_accuracy
2226
+ value: 99.19108910891089
2227
+ - type: dot_ap
2228
+ value: 49.25510696447474
2229
+ - type: dot_f1
2230
+ value: 49.716932578486876
2231
+ - type: dot_precision
2232
+ value: 51.21951219512195
2233
+ - type: dot_recall
2234
+ value: 48.3
2235
+ - type: euclidean_accuracy
2236
+ value: 99.19009900990099
2237
+ - type: euclidean_ap
2238
+ value: 42.035751368399374
2239
+ - type: euclidean_f1
2240
+ value: 44.82153306026916
2241
+ - type: euclidean_precision
2242
+ value: 54.01974612129761
2243
+ - type: euclidean_recall
2244
+ value: 38.3
2245
+ - type: manhattan_accuracy
2246
+ value: 99.19207920792078
2247
+ - type: manhattan_ap
2248
+ value: 42.10943390943409
2249
+ - type: manhattan_f1
2250
+ value: 44.79905437352246
2251
+ - type: manhattan_precision
2252
+ value: 54.76878612716764
2253
+ - type: manhattan_recall
2254
+ value: 37.9
2255
+ - type: max_accuracy
2256
+ value: 99.5
2257
+ - type: max_ap
2258
+ value: 77.07584119570414
2259
+ - type: max_f1
2260
+ value: 71.8864950078823
2261
+ - task:
2262
+ type: Clustering
2263
+ dataset:
2264
+ type: mteb/stackexchange-clustering
2265
+ name: MTEB StackExchangeClustering
2266
+ config: default
2267
+ split: test
2268
+ revision: 6cbc1f7b2bc0622f2e39d2c77fa502909748c259
2269
+ metrics:
2270
+ - type: v_measure
2271
+ value: 37.40985053432638
2272
+ - task:
2273
+ type: Clustering
2274
+ dataset:
2275
+ type: mteb/stackexchange-clustering-p2p
2276
+ name: MTEB StackExchangeClusteringP2P
2277
+ config: default
2278
+ split: test
2279
+ revision: 815ca46b2622cec33ccafc3735d572c266efdb44
2280
+ metrics:
2281
+ - type: v_measure
2282
+ value: 19.657671371166966
2283
+ - task:
2284
+ type: Reranking
2285
+ dataset:
2286
+ type: mteb/stackoverflowdupquestions-reranking
2287
+ name: MTEB StackOverflowDupQuestions
2288
+ config: default
2289
+ split: test
2290
+ revision: e185fbe320c72810689fc5848eb6114e1ef5ec69
2291
+ metrics:
2292
+ - type: map
2293
+ value: 38.612724125942385
2294
+ - type: mrr
2295
+ value: 38.891130315762666
2296
+ - task:
2297
+ type: Summarization
2298
+ dataset:
2299
+ type: mteb/summeval
2300
+ name: MTEB SummEval
2301
+ config: default
2302
+ split: test
2303
+ revision: cda12ad7615edc362dbf25a00fdd61d3b1eaf93c
2304
+ metrics:
2305
+ - type: cos_sim_pearson
2306
+ value: 29.30533164131324
2307
+ - type: cos_sim_spearman
2308
+ value: 30.556621737388685
2309
+ - type: dot_pearson
2310
+ value: 30.309502621339206
2311
+ - type: dot_spearman
2312
+ value: 31.302092660260872
2313
+ - task:
2314
+ type: Retrieval
2315
+ dataset:
2316
+ type: trec-covid
2317
+ name: MTEB TRECCOVID
2318
+ config: default
2319
+ split: test
2320
+ revision: None
2321
+ metrics:
2322
+ - type: map_at_1
2323
+ value: 0.08499999999999999
2324
+ - type: map_at_10
2325
+ value: 0.462
2326
+ - type: map_at_100
2327
+ value: 0.893
2328
+ - type: map_at_1000
2329
+ value: 1.129
2330
+ - type: map_at_3
2331
+ value: 0.232
2332
+ - type: map_at_5
2333
+ value: 0.3
2334
+ - type: mrr_at_1
2335
+ value: 38.0
2336
+ - type: mrr_at_10
2337
+ value: 50.629999999999995
2338
+ - type: mrr_at_100
2339
+ value: 51.315999999999995
2340
+ - type: mrr_at_1000
2341
+ value: 51.365
2342
+ - type: mrr_at_3
2343
+ value: 47.0
2344
+ - type: mrr_at_5
2345
+ value: 48.9
2346
+ - type: ndcg_at_1
2347
+ value: 31.0
2348
+ - type: ndcg_at_10
2349
+ value: 24.823
2350
+ - type: ndcg_at_100
2351
+ value: 10.583
2352
+ - type: ndcg_at_1000
2353
+ value: 6.497999999999999
2354
+ - type: ndcg_at_3
2355
+ value: 30.95
2356
+ - type: ndcg_at_5
2357
+ value: 27.899
2358
+ - type: precision_at_1
2359
+ value: 38.0
2360
+ - type: precision_at_10
2361
+ value: 25.6
2362
+ - type: precision_at_100
2363
+ value: 8.98
2364
+ - type: precision_at_1000
2365
+ value: 2.248
2366
+ - type: precision_at_3
2367
+ value: 34.666999999999994
2368
+ - type: precision_at_5
2369
+ value: 29.599999999999998
2370
+ - type: recall_at_1
2371
+ value: 0.08499999999999999
2372
+ - type: recall_at_10
2373
+ value: 0.641
2374
+ - type: recall_at_100
2375
+ value: 2.002
2376
+ - type: recall_at_1000
2377
+ value: 4.902
2378
+ - type: recall_at_3
2379
+ value: 0.28200000000000003
2380
+ - type: recall_at_5
2381
+ value: 0.379
2382
+ - task:
2383
+ type: Retrieval
2384
+ dataset:
2385
+ type: webis-touche2020
2386
+ name: MTEB Touche2020
2387
+ config: default
2388
+ split: test
2389
+ revision: None
2390
+ metrics:
2391
+ - type: map_at_1
2392
+ value: 0.20500000000000002
2393
+ - type: map_at_10
2394
+ value: 0.391
2395
+ - type: map_at_100
2396
+ value: 0.612
2397
+ - type: map_at_1000
2398
+ value: 0.645
2399
+ - type: map_at_3
2400
+ value: 0.302
2401
+ - type: map_at_5
2402
+ value: 0.383
2403
+ - type: mrr_at_1
2404
+ value: 4.082
2405
+ - type: mrr_at_10
2406
+ value: 5.612
2407
+ - type: mrr_at_100
2408
+ value: 6.822
2409
+ - type: mrr_at_1000
2410
+ value: 6.929
2411
+ - type: mrr_at_3
2412
+ value: 4.082
2413
+ - type: mrr_at_5
2414
+ value: 5.408
2415
+ - type: ndcg_at_1
2416
+ value: 4.082
2417
+ - type: ndcg_at_10
2418
+ value: 1.6840000000000002
2419
+ - type: ndcg_at_100
2420
+ value: 2.876
2421
+ - type: ndcg_at_1000
2422
+ value: 4.114
2423
+ - type: ndcg_at_3
2424
+ value: 2.52
2425
+ - type: ndcg_at_5
2426
+ value: 2.3720000000000003
2427
+ - type: precision_at_1
2428
+ value: 4.082
2429
+ - type: precision_at_10
2430
+ value: 1.429
2431
+ - type: precision_at_100
2432
+ value: 0.755
2433
+ - type: precision_at_1000
2434
+ value: 0.18
2435
+ - type: precision_at_3
2436
+ value: 2.041
2437
+ - type: precision_at_5
2438
+ value: 2.4490000000000003
2439
+ - type: recall_at_1
2440
+ value: 0.20500000000000002
2441
+ - type: recall_at_10
2442
+ value: 0.761
2443
+ - type: recall_at_100
2444
+ value: 4.423
2445
+ - type: recall_at_1000
2446
+ value: 9.044
2447
+ - type: recall_at_3
2448
+ value: 0.302
2449
+ - type: recall_at_5
2450
+ value: 0.683
2451
+ - task:
2452
+ type: Classification
2453
+ dataset:
2454
+ type: mteb/toxic_conversations_50k
2455
+ name: MTEB ToxicConversationsClassification
2456
+ config: default
2457
+ split: test
2458
+ revision: d7c0de2777da35d6aae2200a62c6e0e5af397c4c
2459
+ metrics:
2460
+ - type: accuracy
2461
+ value: 63.5394
2462
+ - type: ap
2463
+ value: 11.440330234311777
2464
+ - type: f1
2465
+ value: 48.937405112008854
2466
+ - task:
2467
+ type: Classification
2468
+ dataset:
2469
+ type: mteb/tweet_sentiment_extraction
2470
+ name: MTEB TweetSentimentExtractionClassification
2471
+ config: default
2472
+ split: test
2473
+ revision: d604517c81ca91fe16a244d1248fc021f9ecee7a
2474
+ metrics:
2475
+ - type: accuracy
2476
+ value: 55.16694963214488
2477
+ - type: f1
2478
+ value: 55.275387066931124
2479
+ - task:
2480
+ type: Clustering
2481
+ dataset:
2482
+ type: mteb/twentynewsgroups-clustering
2483
+ name: MTEB TwentyNewsgroupsClustering
2484
+ config: default
2485
+ split: test
2486
+ revision: 6125ec4e24fa026cec8a478383ee943acfbd5449
2487
+ metrics:
2488
+ - type: v_measure
2489
+ value: 19.628551067284956
2490
+ - task:
2491
+ type: PairClassification
2492
+ dataset:
2493
+ type: mteb/twittersemeval2015-pairclassification
2494
+ name: MTEB TwitterSemEval2015
2495
+ config: default
2496
+ split: test
2497
+ revision: 70970daeab8776df92f5ea462b6173c0b46fd2d1
2498
+ metrics:
2499
+ - type: cos_sim_accuracy
2500
+ value: 80.3302139834297
2501
+ - type: cos_sim_ap
2502
+ value: 53.577224528672154
2503
+ - type: cos_sim_f1
2504
+ value: 51.58639580004565
2505
+ - type: cos_sim_precision
2506
+ value: 45.45454545454545
2507
+ - type: cos_sim_recall
2508
+ value: 59.63060686015831
2509
+ - type: dot_accuracy
2510
+ value: 80.14543720569827
2511
+ - type: dot_ap
2512
+ value: 52.08760844500654
2513
+ - type: dot_f1
2514
+ value: 51.38086062941555
2515
+ - type: dot_precision
2516
+ value: 43.22766570605187
2517
+ - type: dot_recall
2518
+ value: 63.3245382585752
2519
+ - type: euclidean_accuracy
2520
+ value: 78.82815759670979
2521
+ - type: euclidean_ap
2522
+ value: 42.10000519114977
2523
+ - type: euclidean_f1
2524
+ value: 42.769230769230774
2525
+ - type: euclidean_precision
2526
+ value: 34.98322147651007
2527
+ - type: euclidean_recall
2528
+ value: 55.01319261213721
2529
+ - type: manhattan_accuracy
2530
+ value: 78.82815759670979
2531
+ - type: manhattan_ap
2532
+ value: 41.93665652756439
2533
+ - type: manhattan_f1
2534
+ value: 42.57720324202319
2535
+ - type: manhattan_precision
2536
+ value: 34.832969615578314
2537
+ - type: manhattan_recall
2538
+ value: 54.74934036939314
2539
+ - type: max_accuracy
2540
+ value: 80.3302139834297
2541
+ - type: max_ap
2542
+ value: 53.577224528672154
2543
+ - type: max_f1
2544
+ value: 51.58639580004565
2545
+ - task:
2546
+ type: PairClassification
2547
+ dataset:
2548
+ type: mteb/twitterurlcorpus-pairclassification
2549
+ name: MTEB TwitterURLCorpus
2550
+ config: default
2551
+ split: test
2552
+ revision: 8b6510b0b1fa4e4c4f879467980e9be563ec1cdf
2553
+ metrics:
2554
+ - type: cos_sim_accuracy
2555
+ value: 87.45876508712695
2556
+ - type: cos_sim_ap
2557
+ value: 83.53206748034412
2558
+ - type: cos_sim_f1
2559
+ value: 75.54560716284276
2560
+ - type: cos_sim_precision
2561
+ value: 73.27929362379678
2562
+ - type: cos_sim_recall
2563
+ value: 77.95657530027718
2564
+ - type: dot_accuracy
2565
+ value: 85.64054798773626
2566
+ - type: dot_ap
2567
+ value: 77.96482079344187
2568
+ - type: dot_f1
2569
+ value: 72.09775967413442
2570
+ - type: dot_precision
2571
+ value: 67.26448429895326
2572
+ - type: dot_recall
2573
+ value: 77.6793963658762
2574
+ - type: euclidean_accuracy
2575
+ value: 84.78480226646485
2576
+ - type: euclidean_ap
2577
+ value: 75.64620709617934
2578
+ - type: euclidean_f1
2579
+ value: 67.1075581395349
2580
+ - type: euclidean_precision
2581
+ value: 63.54252683732452
2582
+ - type: euclidean_recall
2583
+ value: 71.0963966738528
2584
+ - type: manhattan_accuracy
2585
+ value: 84.72658827182055
2586
+ - type: manhattan_ap
2587
+ value: 75.51016029821636
2588
+ - type: manhattan_f1
2589
+ value: 67.00128311570685
2590
+ - type: manhattan_precision
2591
+ value: 65.70688378978534
2592
+ - type: manhattan_recall
2593
+ value: 68.34770557437635
2594
+ - type: max_accuracy
2595
+ value: 87.45876508712695
2596
+ - type: max_ap
2597
+ value: 83.53206748034412
2598
+ - type: max_f1
2599
+ value: 75.54560716284276
2600
  ---
2601
 
2602
  # SONAR