MichaelKarpe commited on
Commit
d96e8ca
1 Parent(s): 3aab512

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +214 -1
README.md CHANGED
@@ -6,7 +6,220 @@ tags:
6
  - feature-extraction
7
  - sentence-similarity
8
  - transformers
9
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  # MichaelKarpe/mxbai-embed-large-v1-sts-matryoshka
 
6
  - feature-extraction
7
  - sentence-similarity
8
  - transformers
9
+ - mteb
10
+ model-index:
11
+ - name: mxbai-embed-large-v1-sts-matryoshka
12
+ results:
13
+ - task:
14
+ type: STS
15
+ dataset:
16
+ type: mteb/biosses-sts
17
+ name: MTEB BIOSSES
18
+ config: default
19
+ split: test
20
+ revision: d3fb88f8f02e40887cd149695127462bbcf29b4a
21
+ metrics:
22
+ - type: cos_sim_pearson
23
+ value: 89.74819706519132
24
+ - type: cos_sim_spearman
25
+ value: 89.16227258672195
26
+ - type: euclidean_pearson
27
+ value: 87.4894915970516
28
+ - type: euclidean_spearman
29
+ value: 88.82371065549121
30
+ - type: manhattan_pearson
31
+ value: 87.4550672002364
32
+ - type: manhattan_spearman
33
+ value: 88.74479319465274
34
+ - task:
35
+ type: STS
36
+ dataset:
37
+ type: mteb/sickr-sts
38
+ name: MTEB SICK-R
39
+ config: default
40
+ split: test
41
+ revision: a6ea5a8cab320b040a23452cc28066d9beae2cee
42
+ metrics:
43
+ - type: cos_sim_pearson
44
+ value: 87.6165367318343
45
+ - type: cos_sim_spearman
46
+ value: 82.96648281765052
47
+ - type: euclidean_pearson
48
+ value: 85.15841275786363
49
+ - type: euclidean_spearman
50
+ value: 82.59932858741094
51
+ - type: manhattan_pearson
52
+ value: 85.13304536590803
53
+ - type: manhattan_spearman
54
+ value: 82.57423596486754
55
+ - task:
56
+ type: STS
57
+ dataset:
58
+ type: mteb/sts12-sts
59
+ name: MTEB STS12
60
+ config: default
61
+ split: test
62
+ revision: a0d554a64d88156834ff5ae9920b964011b16384
63
+ metrics:
64
+ - type: cos_sim_pearson
65
+ value: 90.28534830444329
66
+ - type: cos_sim_spearman
67
+ value: 82.55267827529079
68
+ - type: euclidean_pearson
69
+ value: 88.25378069753911
70
+ - type: euclidean_spearman
71
+ value: 83.11525616002255
72
+ - type: manhattan_pearson
73
+ value: 88.22692740852892
74
+ - type: manhattan_spearman
75
+ value: 83.09760476508313
76
+ - task:
77
+ type: STS
78
+ dataset:
79
+ type: mteb/sts13-sts
80
+ name: MTEB STS13
81
+ config: default
82
+ split: test
83
+ revision: 7e90230a92c190f1bf69ae9002b8cea547a64cca
84
+ metrics:
85
+ - type: cos_sim_pearson
86
+ value: 92.4873773117415
87
+ - type: cos_sim_spearman
88
+ value: 92.45311856572782
89
+ - type: euclidean_pearson
90
+ value: 91.3940762182452
91
+ - type: euclidean_spearman
92
+ value: 91.99304193285555
93
+ - type: manhattan_pearson
94
+ value: 91.36013458363827
95
+ - type: manhattan_spearman
96
+ value: 91.94059360016104
97
+ - task:
98
+ type: STS
99
+ dataset:
100
+ type: mteb/sts14-sts
101
+ name: MTEB STS14
102
+ config: default
103
+ split: test
104
+ revision: 6031580fec1f6af667f0bd2da0a551cf4f0b2375
105
+ metrics:
106
+ - type: cos_sim_pearson
107
+ value: 92.86047241342555
108
+ - type: cos_sim_spearman
109
+ value: 91.7373997118018
110
+ - type: euclidean_pearson
111
+ value: 91.85151887796326
112
+ - type: euclidean_spearman
113
+ value: 91.84470114529888
114
+ - type: manhattan_pearson
115
+ value: 91.84546446666218
116
+ - type: manhattan_spearman
117
+ value: 91.83943192650281
118
+ - task:
119
+ type: STS
120
+ dataset:
121
+ type: mteb/sts15-sts
122
+ name: MTEB STS15
123
+ config: default
124
+ split: test
125
+ revision: ae752c7c21bf194d8b67fd573edf7ae58183cbe3
126
+ metrics:
127
+ - type: cos_sim_pearson
128
+ value: 91.54334603049196
129
+ - type: cos_sim_spearman
130
+ value: 92.53856973601617
131
+ - type: euclidean_pearson
132
+ value: 91.78019629944465
133
+ - type: euclidean_spearman
134
+ value: 92.34058447365024
135
+ - type: manhattan_pearson
136
+ value: 91.77889261840363
137
+ - type: manhattan_spearman
138
+ value: 92.34415590718599
139
+ - task:
140
+ type: STS
141
+ dataset:
142
+ type: mteb/sts16-sts
143
+ name: MTEB STS16
144
+ config: default
145
+ split: test
146
+ revision: 4d8694f8f0e0100860b497b999b3dbed754a0513
147
+ metrics:
148
+ - type: cos_sim_pearson
149
+ value: 86.44182676813374
150
+ - type: cos_sim_spearman
151
+ value: 88.13762635519763
152
+ - type: euclidean_pearson
153
+ value: 87.368150115143
154
+ - type: euclidean_spearman
155
+ value: 87.80086022782062
156
+ - type: manhattan_pearson
157
+ value: 87.36033717796437
158
+ - type: manhattan_spearman
159
+ value: 87.79278886160228
160
+ - task:
161
+ type: STS
162
+ dataset:
163
+ type: mteb/sts17-crosslingual-sts
164
+ name: MTEB STS17 (en-en)
165
+ config: en-en
166
+ split: test
167
+ revision: af5e6fb845001ecf41f4c1e033ce921939a2a68d
168
+ metrics:
169
+ - type: cos_sim_pearson
170
+ value: 90.45736504439745
171
+ - type: cos_sim_spearman
172
+ value: 90.36467157990322
173
+ - type: euclidean_pearson
174
+ value: 90.19668998748772
175
+ - type: euclidean_spearman
176
+ value: 89.89620750310942
177
+ - type: manhattan_pearson
178
+ value: 90.28020856755623
179
+ - type: manhattan_spearman
180
+ value: 90.06372752006743
181
+ - task:
182
+ type: STS
183
+ dataset:
184
+ type: mteb/sts22-crosslingual-sts
185
+ name: MTEB STS22 (en)
186
+ config: en
187
+ split: test
188
+ revision: eea2b4fe26a775864c896887d910b76a8098ad3f
189
+ metrics:
190
+ - type: cos_sim_pearson
191
+ value: 68.08713149697203
192
+ - type: cos_sim_spearman
193
+ value: 68.46457718572601
194
+ - type: euclidean_pearson
195
+ value: 69.25165385150007
196
+ - type: euclidean_spearman
197
+ value: 68.1342295049583
198
+ - type: manhattan_pearson
199
+ value: 69.30447292480429
200
+ - type: manhattan_spearman
201
+ value: 68.25582089078411
202
+ - task:
203
+ type: STS
204
+ dataset:
205
+ type: mteb/stsbenchmark-sts
206
+ name: MTEB STSBenchmark
207
+ config: default
208
+ split: test
209
+ revision: b0fddb56ed78048fa8b90373c8a3cfc37b684831
210
+ metrics:
211
+ - type: cos_sim_pearson
212
+ value: 88.34259569356074
213
+ - type: cos_sim_spearman
214
+ value: 89.78243695761168
215
+ - type: euclidean_pearson
216
+ value: 89.12060338382234
217
+ - type: euclidean_spearman
218
+ value: 89.67729976099504
219
+ - type: manhattan_pearson
220
+ value: 89.12528974491349
221
+ - type: manhattan_spearman
222
+ value: 89.66532321334671
223
  ---
224
 
225
  # MichaelKarpe/mxbai-embed-large-v1-sts-matryoshka