map
on MTEB CMedQAv1
test set
self-reported
86.104
mrr
on MTEB CMedQAv1
test set
self-reported
88.779
map
on MTEB CMedQAv2
test set
self-reported
86.947
mrr
on MTEB CMedQAv2
test set
self-reported
89.473
map_at_1
on MTEB CmedqaRetrieval
self-reported
25.297
map_at_10
on MTEB CmedqaRetrieval
self-reported
37.159
map_at_100
on MTEB CmedqaRetrieval
self-reported
39.016
map_at_1000
on MTEB CmedqaRetrieval
self-reported
39.134
map_at_3
on MTEB CmedqaRetrieval
self-reported
33.248
map_at_5
on MTEB CmedqaRetrieval
self-reported
35.371
mrr_at_1
on MTEB CmedqaRetrieval
self-reported
38.435
mrr_at_10
on MTEB CmedqaRetrieval
self-reported
46.235
mrr_at_100
on MTEB CmedqaRetrieval
self-reported
47.265
mrr_at_1000
on MTEB CmedqaRetrieval
self-reported
47.308
mrr_at_3
on MTEB CmedqaRetrieval
self-reported
43.828
mrr_at_5
on MTEB CmedqaRetrieval
self-reported
45.210
ndcg_at_1
on MTEB CmedqaRetrieval
self-reported
38.435
ndcg_at_10
on MTEB CmedqaRetrieval
self-reported
43.578
ndcg_at_100
on MTEB CmedqaRetrieval
self-reported
50.995
ndcg_at_1000
on MTEB CmedqaRetrieval
self-reported
53.012
ndcg_at_3
on MTEB CmedqaRetrieval
self-reported
38.667
ndcg_at_5
on MTEB CmedqaRetrieval
self-reported
40.657
precision_at_1
on MTEB CmedqaRetrieval
self-reported
38.435
precision_at_10
on MTEB CmedqaRetrieval
self-reported
9.607
precision_at_100
on MTEB CmedqaRetrieval
self-reported
1.557
precision_at_1000
on MTEB CmedqaRetrieval
self-reported
0.182
precision_at_3
on MTEB CmedqaRetrieval
self-reported
21.714
precision_at_5
on MTEB CmedqaRetrieval
self-reported
15.634
recall_at_1
on MTEB CmedqaRetrieval
self-reported
25.297
recall_at_10
on MTEB CmedqaRetrieval
self-reported
53.408
recall_at_100
on MTEB CmedqaRetrieval
self-reported
84.202
recall_at_1000
on MTEB CmedqaRetrieval
self-reported
97.610
recall_at_3
on MTEB CmedqaRetrieval
self-reported
38.533
recall_at_5
on MTEB CmedqaRetrieval
self-reported
44.927
map_at_1
on MTEB CovidRetrieval
self-reported
74.763
map_at_10
on MTEB CovidRetrieval
self-reported
82.604
map_at_100
on MTEB CovidRetrieval
self-reported
82.795
map_at_1000
on MTEB CovidRetrieval
self-reported
82.798
map_at_3
on MTEB CovidRetrieval
self-reported
81.437
map_at_5
on MTEB CovidRetrieval
self-reported
82.097
mrr_at_1
on MTEB CovidRetrieval
self-reported
74.816
mrr_at_10
on MTEB CovidRetrieval
self-reported
82.601
mrr_at_100
on MTEB CovidRetrieval
self-reported
82.787
mrr_at_1000
on MTEB CovidRetrieval
self-reported
82.790
mrr_at_3
on MTEB CovidRetrieval
self-reported
81.472
mrr_at_5
on MTEB CovidRetrieval
self-reported
82.146
ndcg_at_1
on MTEB CovidRetrieval
self-reported
74.921
ndcg_at_10
on MTEB CovidRetrieval
self-reported
85.830
ndcg_at_100
on MTEB CovidRetrieval
self-reported
86.655
ndcg_at_1000
on MTEB CovidRetrieval
self-reported
86.748
ndcg_at_3
on MTEB CovidRetrieval
self-reported
83.497
ndcg_at_5
on MTEB CovidRetrieval
self-reported
84.696
precision_at_1
on MTEB CovidRetrieval
self-reported
74.921
precision_at_10
on MTEB CovidRetrieval
self-reported
9.663
precision_at_100
on MTEB CovidRetrieval
self-reported
1.003
precision_at_1000
on MTEB CovidRetrieval
self-reported
0.101
precision_at_3
on MTEB CovidRetrieval
self-reported
29.996
precision_at_5
on MTEB CovidRetrieval
self-reported
18.609
recall_at_1
on MTEB CovidRetrieval
self-reported
74.763
recall_at_10
on MTEB CovidRetrieval
self-reported
95.627
recall_at_100
on MTEB CovidRetrieval
self-reported
99.262
recall_at_1000
on MTEB CovidRetrieval
self-reported
100.000
recall_at_3
on MTEB CovidRetrieval
self-reported
89.357
recall_at_5
on MTEB CovidRetrieval
self-reported
92.255
map_at_1
on MTEB DuRetrieval
self-reported
26.021
map_at_10
on MTEB DuRetrieval
self-reported
78.561
map_at_100
on MTEB DuRetrieval
self-reported
81.291
map_at_1000
on MTEB DuRetrieval
self-reported
81.344
map_at_3
on MTEB DuRetrieval
self-reported
54.558
map_at_5
on MTEB DuRetrieval
self-reported
68.804
mrr_at_1
on MTEB DuRetrieval
self-reported
89.800
mrr_at_10
on MTEB DuRetrieval
self-reported
92.905
mrr_at_100
on MTEB DuRetrieval
self-reported
92.976
mrr_at_1000
on MTEB DuRetrieval
self-reported
92.979
mrr_at_3
on MTEB DuRetrieval
self-reported
92.608
mrr_at_5
on MTEB DuRetrieval
self-reported
92.783
ndcg_at_1
on MTEB DuRetrieval
self-reported
89.800
ndcg_at_10
on MTEB DuRetrieval
self-reported
86.203
ndcg_at_100
on MTEB DuRetrieval
self-reported
88.955
ndcg_at_1000
on MTEB DuRetrieval
self-reported
89.442
ndcg_at_3
on MTEB DuRetrieval
self-reported
85.163
ndcg_at_5
on MTEB DuRetrieval
self-reported
84.057
precision_at_1
on MTEB DuRetrieval
self-reported
89.800
precision_at_10
on MTEB DuRetrieval
self-reported
41.175
precision_at_100
on MTEB DuRetrieval
self-reported
4.744
precision_at_1000
on MTEB DuRetrieval
self-reported
0.486
precision_at_3
on MTEB DuRetrieval
self-reported
76.283
precision_at_5
on MTEB DuRetrieval
self-reported
64.410
recall_at_1
on MTEB DuRetrieval
self-reported
26.021
recall_at_10
on MTEB DuRetrieval
self-reported
87.250
recall_at_100
on MTEB DuRetrieval
self-reported
96.154
recall_at_1000
on MTEB DuRetrieval
self-reported
98.615
recall_at_3
on MTEB DuRetrieval
self-reported
56.831
recall_at_5
on MTEB DuRetrieval
self-reported
73.518
map_at_1
on MTEB EcomRetrieval
self-reported
52.300
map_at_10
on MTEB EcomRetrieval
self-reported
62.149
map_at_100
on MTEB EcomRetrieval
self-reported
62.719
map_at_1000
on MTEB EcomRetrieval
self-reported
62.730
map_at_3
on MTEB EcomRetrieval
self-reported
59.767
map_at_5
on MTEB EcomRetrieval
self-reported
61.232
mrr_at_1
on MTEB EcomRetrieval
self-reported
52.300
mrr_at_10
on MTEB EcomRetrieval
self-reported
62.149
mrr_at_100
on MTEB EcomRetrieval
self-reported
62.719
mrr_at_1000
on MTEB EcomRetrieval
self-reported
62.730
mrr_at_3
on MTEB EcomRetrieval
self-reported
59.767
mrr_at_5
on MTEB EcomRetrieval
self-reported
61.232
ndcg_at_1
on MTEB EcomRetrieval
self-reported
52.300
ndcg_at_10
on MTEB EcomRetrieval
self-reported
66.993
ndcg_at_100
on MTEB EcomRetrieval
self-reported
69.672
ndcg_at_1000
on MTEB EcomRetrieval
self-reported
69.954
ndcg_at_3
on MTEB EcomRetrieval
self-reported
62.166
ndcg_at_5
on MTEB EcomRetrieval
self-reported
64.804
precision_at_1
on MTEB EcomRetrieval
self-reported
52.300
precision_at_10
on MTEB EcomRetrieval
self-reported
8.220
precision_at_100
on MTEB EcomRetrieval
self-reported
0.945
precision_at_1000
on MTEB EcomRetrieval
self-reported
0.097
precision_at_3
on MTEB EcomRetrieval
self-reported
23.033
precision_at_5
on MTEB EcomRetrieval
self-reported
15.100
recall_at_1
on MTEB EcomRetrieval
self-reported
52.300
recall_at_10
on MTEB EcomRetrieval
self-reported
82.200
recall_at_100
on MTEB EcomRetrieval
self-reported
94.500
recall_at_1000
on MTEB EcomRetrieval
self-reported
96.700
recall_at_3
on MTEB EcomRetrieval
self-reported
69.100
recall_at_5
on MTEB EcomRetrieval
self-reported
75.500
map
on MTEB MMarcoReranking
self-reported
24.260
mrr
on MTEB MMarcoReranking
self-reported
22.695
map_at_1
on MTEB MMarcoRetrieval
self-reported
64.888
map_at_10
on MTEB MMarcoRetrieval
self-reported
73.921
map_at_100
on MTEB MMarcoRetrieval
self-reported
74.281
map_at_1000
on MTEB MMarcoRetrieval
self-reported
74.295
map_at_3
on MTEB MMarcoRetrieval
self-reported
72.040
map_at_5
on MTEB MMarcoRetrieval
self-reported
73.207
mrr_at_1
on MTEB MMarcoRetrieval
self-reported
67.092
mrr_at_10
on MTEB MMarcoRetrieval
self-reported
74.547
mrr_at_100
on MTEB MMarcoRetrieval
self-reported
74.862
mrr_at_1000
on MTEB MMarcoRetrieval
self-reported
74.875
mrr_at_3
on MTEB MMarcoRetrieval
self-reported
72.908
mrr_at_5
on MTEB MMarcoRetrieval
self-reported
73.936
ndcg_at_1
on MTEB MMarcoRetrieval
self-reported
67.092
ndcg_at_10
on MTEB MMarcoRetrieval
self-reported
77.687
ndcg_at_100
on MTEB MMarcoRetrieval
self-reported
79.246
ndcg_at_1000
on MTEB MMarcoRetrieval
self-reported
79.600
ndcg_at_3
on MTEB MMarcoRetrieval
self-reported
74.124
ndcg_at_5
on MTEB MMarcoRetrieval
self-reported
76.098
precision_at_1
on MTEB MMarcoRetrieval
self-reported
67.092
precision_at_10
on MTEB MMarcoRetrieval
self-reported
9.424
precision_at_100
on MTEB MMarcoRetrieval
self-reported
1.019
precision_at_1000
on MTEB MMarcoRetrieval
self-reported
0.105
precision_at_3
on MTEB MMarcoRetrieval
self-reported
27.927
precision_at_5
on MTEB MMarcoRetrieval
self-reported
17.797
recall_at_1
on MTEB MMarcoRetrieval
self-reported
64.888
recall_at_10
on MTEB MMarcoRetrieval
self-reported
88.672
recall_at_100
on MTEB MMarcoRetrieval
self-reported
95.599
recall_at_1000
on MTEB MMarcoRetrieval
self-reported
98.337
recall_at_3
on MTEB MMarcoRetrieval
self-reported
79.275
recall_at_5
on MTEB MMarcoRetrieval
self-reported
83.960
map_at_1
on MTEB MedicalRetrieval
self-reported
55.500
map_at_10
on MTEB MedicalRetrieval
self-reported
61.316
map_at_100
on MTEB MedicalRetrieval
self-reported
61.832
map_at_1000
on MTEB MedicalRetrieval
self-reported
61.867
map_at_3
on MTEB MedicalRetrieval
self-reported
59.900
map_at_5
on MTEB MedicalRetrieval
self-reported
60.685
mrr_at_1
on MTEB MedicalRetrieval
self-reported
55.700
mrr_at_10
on MTEB MedicalRetrieval
self-reported
61.416
mrr_at_100
on MTEB MedicalRetrieval
self-reported
61.932
mrr_at_1000
on MTEB MedicalRetrieval
self-reported
61.967
mrr_at_3
on MTEB MedicalRetrieval
self-reported
60.000
mrr_at_5
on MTEB MedicalRetrieval
self-reported
60.785
ndcg_at_1
on MTEB MedicalRetrieval
self-reported
55.500
ndcg_at_10
on MTEB MedicalRetrieval
self-reported
64.228
ndcg_at_100
on MTEB MedicalRetrieval
self-reported
67.046
ndcg_at_1000
on MTEB MedicalRetrieval
self-reported
68.176
ndcg_at_3
on MTEB MedicalRetrieval
self-reported
61.314
ndcg_at_5
on MTEB MedicalRetrieval
self-reported
62.743
precision_at_1
on MTEB MedicalRetrieval
self-reported
55.500
precision_at_10
on MTEB MedicalRetrieval
self-reported
7.340
precision_at_100
on MTEB MedicalRetrieval
self-reported
0.873
precision_at_1000
on MTEB MedicalRetrieval
self-reported
0.097
precision_at_3
on MTEB MedicalRetrieval
self-reported
21.800
precision_at_5
on MTEB MedicalRetrieval
self-reported
13.780
recall_at_1
on MTEB MedicalRetrieval
self-reported
55.500
recall_at_10
on MTEB MedicalRetrieval
self-reported
73.400
recall_at_100
on MTEB MedicalRetrieval
self-reported
87.300
recall_at_1000
on MTEB MedicalRetrieval
self-reported
96.600
recall_at_3
on MTEB MedicalRetrieval
self-reported
65.400
recall_at_5
on MTEB MedicalRetrieval
self-reported
68.900
map
on MTEB T2Reranking
self-reported
66.832
mrr
on MTEB T2Reranking
self-reported
76.280
