Model: PaDaS-Lab/xlm-roberta-base-msmarco
Author: PaDaS-Lab
Pipeline: sentence-similarity
Library: sentence-transformers
Tags: sentence-transformers, safetensors, xlm-roberta, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:502912, loss:MarginMSELoss, mteb, arxiv:1908.10084, arxiv:2010.02666, base_model:FacebookAI/xlm-roberta-base, base_model:finetune:FacebookAI/xlm-roberta-base, license:mit, model-index, text-embeddings-inference, endpoints_compatible, region:us
Base models (finetune): id: FacebookAI/xlm-roberta-base
Card metadata: tags: sentence-transformers, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:502912, loss:MarginMSELoss, mteb
model-index: name: XLM-RoBERTa-base-MSMARCO
results: task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (ar)
config: ar
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 17.861
verified: no, type: map_at_10
value: 28.733999999999998
verified: no, type: map_at_100
value: 30.482
verified: no, type: map_at_1000
value: 30.616
verified: no, type: map_at_20
value: 29.717
verified: no, type: map_at_3
value: 24.617
verified: no, type: map_at_5
value: 26.654
verified: no, type: mrr_at_1
value: 26.900000000000002
verified: no, type: mrr_at_10
value: 37.138
verified: no, type: mrr_at_100
value: 38.157999999999994
verified: no, type: mrr_at_1000
value: 38.204
verified: no, type: mrr_at_20
value: 37.808
verified: no, type: mrr_at_3
value: 33.717000000000006
verified: no, type: mrr_at_5
value: 35.632000000000005
verified: no, type: ndcg_at_1
value: 26.900000000000002
verified: no, type: ndcg_at_10
value: 36.125
verified: no, type: ndcg_at_100
value: 43.043
verified: no, type: ndcg_at_1000
value: 45.611000000000004
verified: no, type: ndcg_at_20
value: 39.055
verified: no, type: ndcg_at_3
value: 29.372
verified: no, type: ndcg_at_5
value: 32.015
verified: no, type: precision_at_1
value: 26.900000000000002
verified: no, type: precision_at_10
value: 8.59
verified: no, type: precision_at_100
value: 1.444
verified: no, type: precision_at_1000
value: 0.181
verified: no, type: precision_at_20
value: 5.295
verified: no, type: precision_at_3
value: 16.933
verified: no, type: precision_at_5
value: 12.839999999999998
verified: no, type: recall_at_1
value: 17.861
verified: no, type: recall_at_10
value: 49.175999999999995
verified: no, type: recall_at_100
value: 76.28399999999999
verified: no, type: recall_at_1000
value: 92.905
verified: no, type: recall_at_20
value: 58.755
verified: no, type: recall_at_3
value: 31.334
verified: no, type: recall_at_5
value: 38.217
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (arabic)
config: arabic
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 16.744
verified: no, type: map_at_10
value: 25.447999999999997
verified: no, type: map_at_100
value: 26.296999999999997
verified: no, type: map_at_1000
value: 26.369
verified: no, type: map_at_20
value: 25.951
verified: no, type: map_at_3
value: 22.826
verified: no, type: map_at_5
value: 24.309
verified: no, type: mrr_at_1
value: 17.669
verified: no, type: mrr_at_10
value: 26.711000000000002
verified: no, type: mrr_at_100
value: 27.534
verified: no, type: mrr_at_1000
value: 27.589000000000002
verified: no, type: mrr_at_20
value: 27.211999999999996
verified: no, type: mrr_at_3
value: 24.052
verified: no, type: mrr_at_5
value: 25.532
verified: no, type: ndcg_at_1
value: 17.669
verified: no, type: ndcg_at_10
value: 30.53
verified: no, type: ndcg_at_100
value: 34.823
verified: no, type: ndcg_at_1000
value: 36.624
verified: no, type: ndcg_at_20
value: 32.323
verified: no, type: ndcg_at_3
value: 25.119000000000003
verified: no, type: ndcg_at_5
value: 27.791
verified: no, type: precision_at_1
value: 17.669
verified: no, type: precision_at_10
value: 4.8660000000000005
verified: no, type: precision_at_100
value: 0.7230000000000001
verified: no, type: precision_at_1000
value: 0.09
verified: no, type: precision_at_20
value: 2.826
verified: no, type: precision_at_3
value: 10.823
verified: no, type: precision_at_5
value: 7.9
verified: no, type: recall_at_1
value: 16.744
verified: no, type: recall_at_10
value: 45.205
verified: no, type: recall_at_100
value: 65.094
verified: no, type: recall_at_1000
value: 78.739
verified: no, type: recall_at_20
value: 52.066
verified: no, type: recall_at_3
value: 30.574
verified: no, type: recall_at_5
value: 36.986999999999995
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (bn)
config: bn
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 15.962000000000002
verified: no, type: map_at_10
value: 24.746000000000002
verified: no, type: map_at_100
value: 26.306
verified: no, type: map_at_1000
value: 26.451
verified: no, type: map_at_20
value: 25.507
verified: no, type: map_at_3
value: 20.810000000000002
verified: no, type: map_at_5
value: 23.095
verified: no, type: mrr_at_1
value: 26.521
verified: no, type: mrr_at_10
value: 36.268
verified: no, type: mrr_at_100
value: 36.986999999999995
verified: no, type: mrr_at_1000
value: 37.047000000000004
verified: no, type: mrr_at_20
value: 36.611
verified: no, type: mrr_at_3
value: 32.644
verified: no, type: mrr_at_5
value: 35.223
verified: no, type: ndcg_at_1
value: 26.521
verified: no, type: ndcg_at_10
value: 32.038
verified: no, type: ndcg_at_100
value: 38.577
verified: no, type: ndcg_at_1000
value: 41.449999999999996
verified: no, type: ndcg_at_20
value: 34.086
verified: no, type: ndcg_at_3
value: 25.515
verified: no, type: ndcg_at_5
value: 28.860999999999997
verified: no, type: precision_at_1
value: 26.521
verified: no, type: precision_at_10
value: 8.224
verified: no, type: precision_at_100
value: 1.426
verified: no, type: precision_at_1000
value: 0.183
verified: no, type: precision_at_20
value: 4.854
verified: no, type: precision_at_3
value: 15.328
verified: no, type: precision_at_5
value: 12.701
verified: no, type: recall_at_1
value: 15.962000000000002
verified: no, type: recall_at_10
value: 41.573
verified: no, type: recall_at_100
value: 67.963
verified: no, type: recall_at_1000
value: 87.077
verified: no, type: recall_at_20
value: 48.036
verified: no, type: recall_at_3
value: 25.457
verified: no, type: recall_at_5
value: 33.143
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (bengali)
config: bengali
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 14.865
verified: no, type: map_at_10
value: 24.122
verified: no, type: map_at_100
value: 25.345000000000002
verified: no, type: map_at_1000
value: 25.413000000000004
verified: no, type: map_at_20
value: 24.887999999999998
verified: no, type: map_at_3
value: 19.97
verified: no, type: map_at_5
value: 22.898
verified: no, type: mrr_at_1
value: 17.116999999999997
verified: no, type: mrr_at_10
value: 26.115
verified: no, type: mrr_at_100
value: 27.194000000000003
verified: no, type: mrr_at_1000
value: 27.243000000000002
verified: no, type: mrr_at_20
value: 26.828999999999997
verified: no, type: mrr_at_3
value: 21.922
verified: no, type: mrr_at_5
value: 24.985
verified: no, type: ndcg_at_1
value: 17.116999999999997
verified: no, type: ndcg_at_10
value: 29.918
verified: no, type: ndcg_at_100
value: 35.658
verified: no, type: ndcg_at_1000
value: 37.349
verified: no, type: ndcg_at_20
value: 32.74
verified: no, type: ndcg_at_3
value: 21.807000000000002
verified: no, type: ndcg_at_5
value: 27.128999999999998
verified: no, type: precision_at_1
value: 17.116999999999997
verified: no, type: precision_at_10
value: 5.405
verified: no, type: precision_at_100
value: 0.8380000000000001
verified: no, type: precision_at_1000
value: 0.099
verified: no, type: precision_at_20
value: 3.288
verified: no, type: precision_at_3
value: 9.91
verified: no, type: precision_at_5
value: 8.828999999999999
verified: no, type: recall_at_1
value: 14.865
verified: no, type: recall_at_10
value: 45.946
verified: no, type: recall_at_100
value: 72.072
verified: no, type: recall_at_1000
value: 85.135
verified: no, type: recall_at_20
value: 57.206999999999994
verified: no, type: recall_at_3
value: 25.224999999999998
verified: no, type: recall_at_5
value: 37.838
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (de)
config: de
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 10.285
verified: no, type: map_at_10
value: 22.831000000000003
verified: no, type: map_at_100
value: 25.868000000000002
verified: no, type: map_at_1000
value: 26.029999999999998
verified: no, type: map_at_20
value: 24.3
verified: no, type: map_at_3
value: 16.539
verified: no, type: map_at_5
value: 19.593
verified: no, type: mrr_at_1
value: 23.607
verified: no, type: mrr_at_10
value: 36.899
verified: no, type: mrr_at_100
value: 37.958
verified: no, type: mrr_at_1000
value: 37.987
verified: no, type: mrr_at_20
value: 37.454
verified: no, type: mrr_at_3
value: 32.732
verified: no, type: mrr_at_5
value: 35.126000000000005
verified: no, type: ndcg_at_1
value: 23.607
verified: no, type: ndcg_at_10
value: 32.774
verified: no, type: ndcg_at_100
value: 43.553999999999995
verified: no, type: ndcg_at_1000
value: 45.604
verified: no, type: ndcg_at_20
value: 36.408
verified: no, type: ndcg_at_3
value: 23.846
verified: no, type: ndcg_at_5
value: 26.954
verified: no, type: precision_at_1
value: 23.607
verified: no, type: precision_at_10
value: 11.639
verified: no, type: precision_at_100
value: 2.2689999999999997
verified: no, type: precision_at_1000
value: 0.258
verified: no, type: precision_at_20
value: 7.327999999999999
verified: no, type: precision_at_3
value: 18.251
verified: no, type: precision_at_5
value: 15.344
verified: no, type: recall_at_1
value: 10.285
verified: no, type: recall_at_10
value: 46.227000000000004
verified: no, type: recall_at_100
value: 85.478
verified: no, type: recall_at_1000
value: 97.52
verified: no, type: recall_at_20
value: 56.738
verified: no, type: recall_at_3
value: 22.633
verified: no, type: recall_at_5
value: 31.898
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (en)
config: en
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 11.625
verified: no, type: map_at_10
value: 22.033
verified: no, type: map_at_100
value: 25.343
verified: no, type: map_at_1000
value: 25.555
verified: no, type: map_at_20
value: 23.77
verified: no, type: map_at_3
value: 17.163
verified: no, type: map_at_5
value: 19.431
verified: no, type: mrr_at_1
value: 24.781
verified: no, type: mrr_at_10
value: 35.998000000000005
verified: no, type: mrr_at_100
value: 37.345
verified: no, type: mrr_at_1000
value: 37.376
verified: no, type: mrr_at_20
value: 36.912
verified: no, type: mrr_at_3
value: 32.144
verified: no, type: mrr_at_5
value: 34.184
verified: no, type: ndcg_at_1
value: 24.781
verified: no, type: ndcg_at_10
value: 30.608999999999998
verified: no, type: ndcg_at_100
value: 42.407000000000004
verified: no, type: ndcg_at_1000
value: 45.1
verified: no, type: ndcg_at_20
value: 35.188
verified: no, type: ndcg_at_3
value: 24.271
verified: no, type: ndcg_at_5
value: 26.090000000000003
verified: no, type: precision_at_1
value: 24.781
verified: no, type: precision_at_10
value: 10.388
verified: no, type: precision_at_100
value: 2.35
verified: no, type: precision_at_1000
value: 0.28400000000000003
verified: no, type: precision_at_20
value: 7.140000000000001
verified: no, type: precision_at_3
value: 17.438000000000002
verified: no, type: precision_at_5
value: 14.043
verified: no, type: recall_at_1
value: 11.625
verified: no, type: recall_at_10
value: 40.717
verified: no, type: recall_at_100
value: 82.492
verified: no, type: recall_at_1000
value: 97.495
verified: no, type: recall_at_20
value: 54.208
verified: no, type: recall_at_3
value: 21.747
verified: no, type: recall_at_5
value: 28.74
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (english)
config: english
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 6.765000000000001
verified: no, type: map_at_10
value: 13.469999999999999
verified: no, type: map_at_100
value: 14.575
verified: no, type: map_at_1000
value: 14.668000000000001
verified: no, type: map_at_20
value: 14.055000000000001
verified: no, type: map_at_3
value: 10.853
verified: no, type: map_at_5
value: 12.251
verified: no, type: mrr_at_1
value: 8.602
verified: no, type: mrr_at_10
value: 15.595999999999998
verified: no, type: mrr_at_100
value: 16.624
verified: no, type: mrr_at_1000
value: 16.704
verified: no, type: mrr_at_20
value: 16.169
verified: no, type: mrr_at_3
value: 12.881
verified: no, type: mrr_at_5
value: 14.393
verified: no, type: ndcg_at_1
value: 8.602
verified: no, type: ndcg_at_10
value: 18.107
verified: no, type: ndcg_at_100
value: 23.851
verified: no, type: ndcg_at_1000
value: 26.379
verified: no, type: ndcg_at_20
value: 20.182
verified: no, type: ndcg_at_3
value: 12.681000000000001
verified: no, type: ndcg_at_5
value: 15.190000000000001
verified: no, type: precision_at_1
value: 8.602
verified: no, type: precision_at_10
value: 3.6830000000000003
verified: no, type: precision_at_100
value: 0.7040000000000001
verified: no, type: precision_at_1000
value: 0.095
verified: no, type: precision_at_20
value: 2.332
verified: no, type: precision_at_3
value: 6.407
verified: no, type: precision_at_5
value: 5.188000000000001
verified: no, type: recall_at_1
value: 6.765000000000001
verified: no, type: recall_at_10
value: 30.511
verified: no, type: recall_at_100
value: 57.303000000000004
verified: no, type: recall_at_1000
value: 76.568
verified: no, type: recall_at_20
value: 38.284
verified: no, type: recall_at_3
value: 16.084
verified: no, type: recall_at_5
value: 21.886
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (fa)
config: fa
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 15.268
verified: no, type: map_at_10
value: 27.929
verified: no, type: map_at_100
value: 30.323
verified: no, type: map_at_1000
value: 30.433
verified: no, type: map_at_20
value: 29.247
verified: no, type: map_at_3
value: 22.684
verified: no, type: map_at_5
value: 25.453
verified: no, type: mrr_at_1
value: 24.684
verified: no, type: mrr_at_10
value: 36.925999999999995
verified: no, type: mrr_at_100
value: 38.031
verified: no, type: mrr_at_1000
value: 38.063
verified: no, type: mrr_at_20
value: 37.62
verified: no, type: mrr_at_3
value: 33.07
verified: no, type: mrr_at_5
value: 35.467
verified: no, type: ndcg_at_1
value: 24.684
verified: no, type: ndcg_at_10
value: 36.153999999999996
verified: no, type: ndcg_at_100
value: 44.828
verified: no, type: ndcg_at_1000
value: 46.482
verified: no, type: ndcg_at_20
value: 39.678999999999995
verified: no, type: ndcg_at_3
value: 28.223
verified: no, type: ndcg_at_5
value: 31.684
verified: no, type: precision_at_1
value: 24.684
verified: no, type: precision_at_10
value: 9.778
verified: no, type: precision_at_100
value: 1.7610000000000001
verified: no, type: precision_at_1000
value: 0.199
verified: no, type: precision_at_20
value: 6.178999999999999
verified: no, type: precision_at_3
value: 17.563000000000002
verified: no, type: precision_at_5
value: 14.272000000000002
verified: no, type: recall_at_1
value: 15.268
verified: no, type: recall_at_10
value: 50.39
verified: no, type: recall_at_100
value: 83.39800000000001
verified: no, type: recall_at_1000
value: 93.589
verified: no, type: recall_at_20
value: 61.543000000000006
verified: no, type: recall_at_3
value: 29.754
verified: no, type: recall_at_5
value: 38.504
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (fi)
config: fi
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 20.075000000000003
verified: no, type: map_at_10
value: 33.783
verified: no, type: map_at_100
value: 35.548
verified: no, type: map_at_1000
value: 35.650999999999996
verified: no, type: map_at_20
value: 34.824
verified: no, type: map_at_3
value: 29.069
verified: no, type: map_at_5
value: 31.887999999999998
verified: no, type: mrr_at_1
value: 32.9
verified: no, type: mrr_at_10
value: 44.633
verified: no, type: mrr_at_100
value: 45.491
verified: no, type: mrr_at_1000
value: 45.518
verified: no, type: mrr_at_20
value: 45.184999999999995
verified: no, type: mrr_at_3
value: 41.533
verified: no, type: mrr_at_5
value: 43.338
verified: no, type: ndcg_at_1
value: 32.9
verified: no, type: ndcg_at_10
value: 42.068
verified: no, type: ndcg_at_100
value: 48.836
verified: no, type: ndcg_at_1000
value: 50.849999999999994
verified: no, type: ndcg_at_20
value: 45.013999999999996
verified: no, type: ndcg_at_3
value: 34.382000000000005
verified: no, type: ndcg_at_5
value: 38.169
verified: no, type: precision_at_1
value: 32.9
verified: no, type: precision_at_10
value: 10.02
verified: no, type: precision_at_100
value: 1.545
verified: no, type: precision_at_1000
value: 0.182
verified: no, type: precision_at_20
value: 5.955
verified: no, type: precision_at_3
value: 20.9
verified: no, type: precision_at_5
value: 15.98
verified: no, type: recall_at_1
value: 20.075000000000003
verified: no, type: recall_at_10
value: 55.042
verified: no, type: recall_at_100
value: 81.609
verified: no, type: recall_at_1000
value: 95.048
verified: no, type: recall_at_20
value: 64.791
verified: no, type: recall_at_3
value: 36.617
verified: no, type: recall_at_5
value: 44.905
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (finnish)
config: finnish
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 13.489999999999998
verified: no, type: map_at_10
value: 20.253
verified: no, type: map_at_100
value: 21.201
verified: no, type: map_at_1000
value: 21.285999999999998
verified: no, type: map_at_20
value: 20.796
verified: no, type: map_at_3
value: 17.869
verified: no, type: map_at_5
value: 19.217000000000002
verified: no, type: mrr_at_1
value: 14.514
verified: no, type: mrr_at_10
value: 21.369
verified: no, type: mrr_at_100
value: 22.273
verified: no, type: mrr_at_1000
value: 22.346
verified: no, type: mrr_at_20
value: 21.892
verified: no, type: mrr_at_3
value: 18.913
verified: no, type: mrr_at_5
value: 20.336000000000002
verified: no, type: ndcg_at_1
value: 14.514
verified: no, type: ndcg_at_10
value: 24.426000000000002
verified: no, type: ndcg_at_100
value: 29.253
verified: no, type: ndcg_at_1000
value: 31.752000000000002
verified: no, type: ndcg_at_20
value: 26.36
verified: no, type: ndcg_at_3
value: 19.523
verified: no, type: ndcg_at_5
value: 21.986
verified: no, type: precision_at_1
value: 14.514
verified: no, type: precision_at_10
value: 4.011
verified: no, type: precision_at_100
value: 0.6629999999999999
verified: no, type: precision_at_1000
value: 0.09
verified: no, type: precision_at_20
value: 2.444
verified: no, type: precision_at_3
value: 8.373
verified: no, type: precision_at_5
value: 6.332
verified: no, type: recall_at_1
value: 13.489999999999998
verified: no, type: recall_at_10
value: 36.43
verified: no, type: recall_at_100
value: 59.024
verified: no, type: recall_at_1000
value: 78.668
verified: no, type: recall_at_20
value: 43.793
verified: no, type: recall_at_3
value: 23.339
verified: no, type: recall_at_5
value: 29.213
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (fr)
config: fr
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 7.768
verified: no, type: map_at_10
value: 17.591
verified: no, type: map_at_100
value: 20.544999999999998
verified: no, type: map_at_1000
value: 20.673
verified: no, type: map_at_20
value: 19.131
verified: no, type: map_at_3
value: 12.567999999999998
verified: no, type: map_at_5
value: 14.846
verified: no, type: mrr_at_1
value: 13.994000000000002
verified: no, type: mrr_at_10
value: 25.740000000000002
verified: no, type: mrr_at_100
value: 27.156999999999996
verified: no, type: mrr_at_1000
value: 27.189999999999998
verified: no, type: mrr_at_20
value: 26.61
verified: no, type: mrr_at_3
value: 20.554
verified: no, type: mrr_at_5
value: 23.163
verified: no, type: ndcg_at_1
value: 13.994000000000002
verified: no, type: ndcg_at_10
value: 25.929000000000002
verified: no, type: ndcg_at_100
value: 37.244
verified: no, type: ndcg_at_1000
value: 39.211
verified: no, type: ndcg_at_20
value: 30.314000000000004
verified: no, type: ndcg_at_3
value: 16.329
verified: no, type: ndcg_at_5
value: 19.826
verified: no, type: precision_at_1
value: 13.994000000000002
verified: no, type: precision_at_10
value: 8.192
verified: no, type: precision_at_100
value: 1.799
verified: no, type: precision_at_1000
value: 0.207
verified: no, type: precision_at_20
value: 5.583
verified: no, type: precision_at_3
value: 11.079
verified: no, type: precision_at_5
value: 10.204
verified: no, type: recall_at_1
value: 7.768
verified: no, type: recall_at_10
value: 41.516999999999996
verified: no, type: recall_at_100
value: 85.148
verified: no, type: recall_at_1000
value: 97.342
verified: no, type: recall_at_20
value: 55.696
verified: no, type: recall_at_3
value: 17.559
verified: no, type: recall_at_5
value: 25.128
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (hi)
config: hi
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 12.864
verified: no, type: map_at_10
value: 23.992
verified: no, type: map_at_100
value: 26.007
verified: no, type: map_at_1000
value: 26.157999999999998
verified: no, type: map_at_20
value: 25.130000000000003
verified: no, type: map_at_3
value: 19.867
verified: no, type: map_at_5
value: 21.657
verified: no, type: mrr_at_1
value: 25.714
verified: no, type: mrr_at_10
value: 36.374
verified: no, type: mrr_at_100
value: 37.399
verified: no, type: mrr_at_1000
value: 37.458000000000006
verified: no, type: mrr_at_20
value: 37.055
verified: no, type: mrr_at_3
value: 33.762
verified: no, type: mrr_at_5
value: 35.176
verified: no, type: ndcg_at_1
value: 25.714
verified: no, type: ndcg_at_10
value: 31.902
verified: no, type: ndcg_at_100
value: 39.534000000000006
verified: no, type: ndcg_at_1000
value: 42.424
verified: no, type: ndcg_at_20
value: 35.189
verified: no, type: ndcg_at_3
value: 26.52
verified: no, type: ndcg_at_5
value: 27.833999999999996
verified: no, type: precision_at_1
value: 25.714
verified: no, type: precision_at_10
value: 9.171
verified: no, type: precision_at_100
value: 1.569
verified: no, type: precision_at_1000
value: 0.197
verified: no, type: precision_at_20
value: 5.671
verified: no, type: precision_at_3
value: 18.095
verified: no, type: precision_at_5
value: 13.370999999999999
verified: no, type: recall_at_1
value: 12.864
verified: no, type: recall_at_10
value: 42.522999999999996
verified: no, type: recall_at_100
value: 72.653
verified: no, type: recall_at_1000
value: 91.49199999999999
verified: no, type: recall_at_20
value: 53.452999999999996
verified: no, type: recall_at_3
value: 26.007
verified: no, type: recall_at_5
value: 31.608999999999998
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (id)
config: id
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 10.563
verified: no, type: map_at_10
value: 20.183
verified: no, type: map_at_100
value: 22.461000000000002
verified: no, type: map_at_1000
value: 22.719
verified: no, type: map_at_20
value: 21.342
verified: no, type: map_at_3
value: 16.25
verified: no, type: map_at_5
value: 18.415
verified: no, type: mrr_at_1
value: 23.541999999999998
verified: no, type: mrr_at_10
value: 35.272999999999996
verified: no, type: mrr_at_100
value: 36.291000000000004
verified: no, type: mrr_at_1000
value: 36.336
verified: no, type: mrr_at_20
value: 35.894999999999996
verified: no, type: mrr_at_3
value: 31.874999999999996
verified: no, type: mrr_at_5
value: 33.833
verified: no, type: ndcg_at_1
value: 23.541999999999998
verified: no, type: ndcg_at_10
value: 28.144000000000002
verified: no, type: ndcg_at_100
value: 36.806
verified: no, type: ndcg_at_1000
value: 40.888000000000005
verified: no, type: ndcg_at_20
value: 31.263
verified: no, type: ndcg_at_3
value: 23.796999999999997
verified: no, type: ndcg_at_5
value: 25.304
verified: no, type: precision_at_1
value: 23.541999999999998
verified: no, type: precision_at_10
value: 9.771
verified: no, type: precision_at_100
value: 1.994
verified: no, type: precision_at_1000
value: 0.281
verified: no, type: precision_at_20
value: 6.343999999999999
verified: no, type: precision_at_3
value: 17.639
verified: no, type: precision_at_5
value: 14.271
verified: no, type: recall_at_1
value: 10.563
verified: no, type: recall_at_10
value: 35.47
verified: no, type: recall_at_100
value: 65.713
verified: no, type: recall_at_1000
value: 88.68599999999999
verified: no, type: recall_at_20
value: 44.285999999999994
verified: no, type: recall_at_3
value: 21.366
verified: no, type: recall_at_5
value: 27.598
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (indonesian)
config: indonesian
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 17.149
verified: no, type: map_at_10
value: 27.351
verified: no, type: map_at_100
value: 28.42
verified: no, type: map_at_1000
value: 28.491
verified: no, type: map_at_20
value: 28.026
verified: no, type: map_at_3
value: 23.918
verified: no, type: map_at_5
value: 26.125999999999998
verified: no, type: mrr_at_1
value: 18.938
verified: no, type: mrr_at_10
value: 28.853
verified: no, type: mrr_at_100
value: 29.805999999999997
verified: no, type: mrr_at_1000
value: 29.863
verified: no, type: mrr_at_20
value: 29.457
verified: no, type: mrr_at_3
value: 25.714
verified: no, type: mrr_at_5
value: 27.674
verified: no, type: ndcg_at_1
value: 18.938
verified: no, type: ndcg_at_10
value: 33.195
verified: no, type: ndcg_at_100
value: 38.17
verified: no, type: ndcg_at_1000
value: 40.109
verified: no, type: ndcg_at_20
value: 35.514
verified: no, type: ndcg_at_3
value: 26.509
verified: no, type: ndcg_at_5
value: 30.325000000000003
verified: no, type: precision_at_1
value: 18.938
verified: no, type: precision_at_10
value: 5.694
verified: no, type: precision_at_100
value: 0.8370000000000001
verified: no, type: precision_at_1000
value: 0.10200000000000001
verified: no, type: precision_at_20
value: 3.366
verified: no, type: precision_at_3
value: 12.142999999999999
verified: no, type: precision_at_5
value: 9.385
verified: no, type: recall_at_1
value: 17.149
verified: no, type: recall_at_10
value: 49.799
verified: no, type: recall_at_100
value: 72.256
verified: no, type: recall_at_1000
value: 87.354
verified: no, type: recall_at_20
value: 58.585
verified: no, type: recall_at_3
value: 32.268
verified: no, type: recall_at_5
value: 41.275
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (ja)
config: ja
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 10.001999999999999
verified: no, type: map_at_10
value: 19.887
verified: no, type: map_at_100
value: 22.192
verified: no, type: map_at_1000
value: 22.364
verified: no, type: map_at_20
value: 21.127000000000002
verified: no, type: map_at_3
value: 16.297
verified: no, type: map_at_5
value: 18.046
verified: no, type: mrr_at_1
value: 17.442
verified: no, type: mrr_at_10
value: 29.804000000000002
verified: no, type: mrr_at_100
value: 31.025999999999996
verified: no, type: mrr_at_1000
value: 31.075999999999997
verified: no, type: mrr_at_20
value: 30.570000000000004
verified: no, type: mrr_at_3
value: 26.491999999999997
verified: no, type: mrr_at_5
value: 28.341
verified: no, type: ndcg_at_1
value: 17.442
verified: no, type: ndcg_at_10
value: 27.561999999999998
verified: no, type: ndcg_at_100
value: 36.714999999999996
verified: no, type: ndcg_at_1000
value: 39.564
verified: no, type: ndcg_at_20
value: 31.133
verified: no, type: ndcg_at_3
value: 21.464
verified: no, type: ndcg_at_5
value: 23.775
verified: no, type: precision_at_1
value: 17.442
verified: no, type: precision_at_10
value: 7.663
verified: no, type: precision_at_100
value: 1.566
verified: no, type: precision_at_1000
value: 0.197
verified: no, type: precision_at_20
value: 5.07
verified: no, type: precision_at_3
value: 14.302000000000001
verified: no, type: precision_at_5
value: 11.07
verified: no, type: recall_at_1
value: 10.001999999999999
verified: no, type: recall_at_10
value: 39.982
verified: no, type: recall_at_100
value: 76.165
verified: no, type: recall_at_1000
value: 94.487
verified: no, type: recall_at_20
value: 51.559999999999995
verified: no, type: recall_at_3
value: 23.274
verified: no, type: recall_at_5
value: 29.842000000000002
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (japanese)
config: japanese
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 6.412
verified: no, type: map_at_10
value: 12.008000000000001
verified: no, type: map_at_100
value: 13.138
verified: no, type: map_at_1000
value: 13.227
verified: no, type: map_at_20
value: 12.669
verified: no, type: map_at_3
value: 9.738
verified: no, type: map_at_5
value: 10.852
verified: no, type: mrr_at_1
value: 8.056000000000001
verified: no, type: mrr_at_10
value: 14.155999999999999
verified: no, type: mrr_at_100
value: 15.232000000000001
verified: no, type: mrr_at_1000
value: 15.308
verified: no, type: mrr_at_20
value: 14.780999999999999
verified: no, type: mrr_at_3
value: 11.806
verified: no, type: mrr_at_5
value: 12.992999999999999
verified: no, type: ndcg_at_1
value: 8.056000000000001
verified: no, type: ndcg_at_10
value: 16.048000000000002
verified: no, type: ndcg_at_100
value: 21.833
verified: no, type: ndcg_at_1000
value: 24.282
verified: no, type: ndcg_at_20
value: 18.398
verified: no, type: ndcg_at_3
value: 11.317
verified: no, type: ndcg_at_5
value: 13.319
verified: no, type: precision_at_1
value: 8.056000000000001
verified: no, type: precision_at_10
value: 3.292
verified: no, type: precision_at_100
value: 0.664
verified: no, type: precision_at_1000
value: 0.091
verified: no, type: precision_at_20
value: 2.181
verified: no, type: precision_at_3
value: 5.833
verified: no, type: precision_at_5
value: 4.583
verified: no, type: recall_at_1
value: 6.412
verified: no, type: recall_at_10
value: 26.480999999999998
verified: no, type: recall_at_100
value: 53.217999999999996
verified: no, type: recall_at_1000
value: 71.528
verified: no, type: recall_at_20
value: 35.44
verified: no, type: recall_at_3
value: 13.866
verified: no, type: recall_at_5
value: 18.519
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (ko)
config: ko
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 19.03
verified: no, type: map_at_10
value: 30.987
verified: no, type: map_at_100
value: 33.248
verified: no, type: map_at_1000
value: 33.452
verified: no, type: map_at_20
value: 32.298
verified: no, type: map_at_3
value: 26.240999999999996
verified: no, type: map_at_5
value: 28.899
verified: no, type: mrr_at_1
value: 28.638
verified: no, type: mrr_at_10
value: 42.082
verified: no, type: mrr_at_100
value: 43.034
verified: no, type: mrr_at_1000
value: 43.059
verified: no, type: mrr_at_20
value: 42.736000000000004
verified: no, type: mrr_at_3
value: 38.340999999999994
verified: no, type: mrr_at_5
value: 40.548
verified: no, type: ndcg_at_1
value: 28.638
verified: no, type: ndcg_at_10
value: 39.284
verified: no, type: ndcg_at_100
value: 47.157
verified: no, type: ndcg_at_1000
value: 49.864000000000004
verified: no, type: ndcg_at_20
value: 42.719
verified: no, type: ndcg_at_3
value: 32.521
verified: no, type: ndcg_at_5
value: 35.57
verified: no, type: precision_at_1
value: 28.638
verified: no, type: precision_at_10
value: 10.657
verified: no, type: precision_at_100
value: 1.8870000000000002
verified: no, type: precision_at_1000
value: 0.241
verified: no, type: precision_at_20
value: 6.643000000000001
verified: no, type: precision_at_3
value: 19.718
verified: no, type: precision_at_5
value: 15.493000000000002
verified: no, type: recall_at_1
value: 19.03
verified: no, type: recall_at_10
value: 51.961999999999996
verified: no, type: recall_at_100
value: 79.836
verified: no, type: recall_at_1000
value: 95.3
verified: no, type: recall_at_20
value: 62.643
verified: no, type: recall_at_3
value: 33.1
verified: no, type: recall_at_5
value: 41.791
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (korean)
config: korean
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 18.131
verified: no, type: map_at_10
value: 23.858999999999998
verified: no, type: map_at_100
value: 24.507
verified: no, type: map_at_1000
value: 24.582
verified: no, type: map_at_20
value: 24.152
verified: no, type: map_at_3
value: 22.09
verified: no, type: map_at_5
value: 22.971
verified: no, type: mrr_at_1
value: 20.19
verified: no, type: mrr_at_10
value: 26.249
verified: no, type: mrr_at_100
value: 26.871000000000002
verified: no, type: mrr_at_1000
value: 26.936
verified: no, type: mrr_at_20
value: 26.535999999999998
verified: no, type: mrr_at_3
value: 24.465999999999998
verified: no, type: mrr_at_5
value: 25.356
verified: no, type: ndcg_at_1
value: 20.19
verified: no, type: ndcg_at_10
value: 27.700000000000003
verified: no, type: ndcg_at_100
value: 31.436999999999998
verified: no, type: ndcg_at_1000
value: 33.690999999999995
verified: no, type: ndcg_at_20
value: 28.716
verified: no, type: ndcg_at_3
value: 23.985
verified: no, type: ndcg_at_5
value: 25.539
verified: no, type: precision_at_1
value: 20.19
verified: no, type: precision_at_10
value: 4.181
verified: no, type: precision_at_100
value: 0.637
verified: no, type: precision_at_1000
value: 0.08499999999999999
verified: no, type: precision_at_20
value: 2.316
verified: no, type: precision_at_3
value: 10.135
verified: no, type: precision_at_5
value: 6.888
verified: no, type: recall_at_1
value: 18.131
verified: no, type: recall_at_10
value: 37.49
verified: no, type: recall_at_100
value: 55.859
verified: no, type: recall_at_1000
value: 73.634
verified: no, type: recall_at_20
value: 41.291
verified: no, type: recall_at_3
value: 27.276
verified: no, type: recall_at_5
value: 30.918
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (ru)
config: ru
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 12.045
verified: no, type: map_at_10
value: 21.751
verified: no, type: map_at_100
value: 24.517
verified: no, type: map_at_1000
value: 24.726
verified: no, type: map_at_20
value: 23.142
verified: no, type: map_at_3
value: 17.546
verified: no, type: map_at_5
value: 19.555
verified: no, type: mrr_at_1
value: 22.900000000000002
verified: no, type: mrr_at_10
value: 33.946
verified: no, type: mrr_at_100
value: 35.199999999999996
verified: no, type: mrr_at_1000
value: 35.233
verified: no, type: mrr_at_20
value: 34.791
verified: no, type: mrr_at_3
value: 30.099999999999998
verified: no, type: mrr_at_5
value: 32.18
verified: no, type: ndcg_at_1
value: 22.900000000000002
verified: no, type: ndcg_at_10
value: 29.587000000000003
verified: no, type: ndcg_at_100
value: 39.934999999999995
verified: no, type: ndcg_at_1000
value: 42.857
verified: no, type: ndcg_at_20
value: 33.531
verified: no, type: ndcg_at_3
value: 23.361
verified: no, type: ndcg_at_5
value: 25.485999999999997
verified: no, type: precision_at_1
value: 22.900000000000002
verified: no, type: precision_at_10
value: 9.370000000000001
verified: no, type: precision_at_100
value: 2.1
verified: no, type: precision_at_1000
value: 0.263
verified: no, type: precision_at_20
value: 6.4399999999999995
verified: no, type: precision_at_3
value: 15.867
verified: no, type: precision_at_5
value: 12.86
verified: no, type: recall_at_1
value: 12.045
verified: no, type: recall_at_10
value: 39.612
verified: no, type: recall_at_100
value: 76.132
verified: no, type: recall_at_1000
value: 92.643
verified: no, type: recall_at_20
value: 51.13799999999999
verified: no, type: recall_at_3
value: 22.408
verified: no, type: recall_at_5
value: 28.794999999999998
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (russian)
config: russian
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 12.127
verified: no, type: map_at_10
value: 18.472
verified: no, type: map_at_100
value: 19.395
verified: no, type: map_at_1000
value: 19.477
verified: no, type: map_at_20
value: 18.966
verified: no, type: map_at_3
value: 16.309
verified: no, type: map_at_5
value: 17.53
verified: no, type: mrr_at_1
value: 13.568
verified: no, type: mrr_at_10
value: 20.04
verified: no, type: mrr_at_100
value: 20.928
verified: no, type: mrr_at_1000
value: 20.995
verified: no, type: mrr_at_20
value: 20.538
verified: no, type: mrr_at_3
value: 17.855999999999998
verified: no, type: mrr_at_5
value: 19.027
verified: no, type: ndcg_at_1
value: 13.568
verified: no, type: ndcg_at_10
value: 22.509
verified: no, type: ndcg_at_100
value: 27.230999999999998
verified: no, type: ndcg_at_1000
value: 29.444
verified: no, type: ndcg_at_20
value: 24.277
verified: no, type: ndcg_at_3
value: 18.108
verified: no, type: ndcg_at_5
value: 20.252
verified: no, type: precision_at_1
value: 13.568
verified: no, type: precision_at_10
value: 3.769
verified: no, type: precision_at_100
value: 0.635
verified: no, type: precision_at_1000
value: 0.08499999999999999
verified: no, type: precision_at_20
value: 2.271
verified: no, type: precision_at_3
value: 8.107000000000001
verified: no, type: precision_at_5
value: 5.99
verified: no, type: recall_at_1
value: 12.127
verified: no, type: recall_at_10
value: 33.617999999999995
verified: no, type: recall_at_100
value: 55.662
verified: no, type: recall_at_1000
value: 72.697
verified: no, type: recall_at_20
value: 40.369
verified: no, type: recall_at_3
value: 21.91
verified: no, type: recall_at_5
value: 26.985
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (es)
config: es
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 8.068
verified: no, type: map_at_10
value: 19.563
verified: no, type: map_at_100
value: 24.198
verified: no, type: map_at_1000
value: 24.532
verified: no, type: map_at_20
value: 21.929000000000002
verified: no, type: map_at_3
value: 13.652000000000001
verified: no, type: map_at_5
value: 16.226
verified: no, type: mrr_at_1
value: 30.092999999999996
verified: no, type: mrr_at_10
value: 43.312
verified: no, type: mrr_at_100
value: 44.230999999999995
verified: no, type: mrr_at_1000
value: 44.252
verified: no, type: mrr_at_20
value: 43.891000000000005
verified: no, type: mrr_at_3
value: 39.428999999999995
verified: no, type: mrr_at_5
value: 41.682
verified: no, type: ndcg_at_1
value: 30.092999999999996
verified: no, type: ndcg_at_10
value: 30.218
verified: no, type: ndcg_at_100
value: 43.716
verified: no, type: ndcg_at_1000
value: 47.355000000000004
verified: no, type: ndcg_at_20
value: 35.268
verified: no, type: ndcg_at_3
value: 27.232
verified: no, type: ndcg_at_5
value: 26.874
verified: no, type: precision_at_1
value: 30.092999999999996
verified: no, type: precision_at_10
value: 15.293000000000001
verified: no, type: precision_at_100
value: 3.531
verified: no, type: precision_at_1000
value: 0.437
verified: no, type: precision_at_20
value: 10.693999999999999
verified: no, type: precision_at_3
value: 23.868000000000002
verified: no, type: precision_at_5
value: 19.938
verified: no, type: recall_at_1
value: 8.068
verified: no, type: recall_at_10
value: 35.778999999999996
verified: no, type: recall_at_100
value: 76.36699999999999
verified: no, type: recall_at_1000
value: 94.38499999999999
verified: no, type: recall_at_20
value: 48.014
verified: no, type: recall_at_3
value: 17.825
verified: no, type: recall_at_5
value: 24.163999999999998
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (sw)
config: sw
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 12.568999999999999
verified: no, type: map_at_10
value: 18.478
verified: no, type: map_at_100
value: 19.584
verified: no, type: map_at_1000
value: 19.714000000000002
verified: no, type: map_at_20
value: 19.073999999999998
verified: no, type: map_at_3
value: 16.275000000000002
verified: no, type: map_at_5
value: 17.53
verified: no, type: mrr_at_1
value: 20.124
verified: no, type: mrr_at_10
value: 25.951
verified: no, type: mrr_at_100
value: 26.812
verified: no, type: mrr_at_1000
value: 26.876
verified: no, type: mrr_at_20
value: 26.41
verified: no, type: mrr_at_3
value: 23.893
verified: no, type: mrr_at_5
value: 25.055
verified: no, type: ndcg_at_1
value: 20.124
verified: no, type: ndcg_at_10
value: 23.064999999999998
verified: no, type: ndcg_at_100
value: 28.193
verified: no, type: ndcg_at_1000
value: 31.313000000000002
verified: no, type: ndcg_at_20
value: 24.921
verified: no, type: ndcg_at_3
value: 19.436
verified: no, type: ndcg_at_5
value: 20.990000000000002
verified: no, type: precision_at_1
value: 20.124
verified: no, type: precision_at_10
value: 5.021
verified: no, type: precision_at_100
value: 0.927
verified: no, type: precision_at_1000
value: 0.13699999999999998
verified: no, type: precision_at_20
value: 3.1329999999999996
verified: no, type: precision_at_3
value: 10.719
verified: no, type: precision_at_5
value: 8.091
verified: no, type: recall_at_1
value: 12.568999999999999
verified: no, type: recall_at_10
value: 29.727999999999998
verified: no, type: recall_at_100
value: 50.70099999999999
verified: no, type: recall_at_1000
value: 71.856
verified: no, type: recall_at_20
value: 35.831
verified: no, type: recall_at_3
value: 19.758
verified: no, type: recall_at_5
value: 24.035999999999998
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (swahili)
config: swahili
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 15.597
verified: no, type: map_at_10
value: 23.596
verified: no, type: map_at_100
value: 24.32
verified: no, type: map_at_1000
value: 24.377
verified: no, type: map_at_20
value: 23.913999999999998
verified: no, type: map_at_3
value: 21.484
verified: no, type: map_at_5
value: 22.647000000000002
verified: no, type: mrr_at_1
value: 16.866
verified: no, type: mrr_at_10
value: 24.633
verified: no, type: mrr_at_100
value: 25.291000000000004
verified: no, type: mrr_at_1000
value: 25.346999999999998
verified: no, type: mrr_at_20
value: 24.907
verified: no, type: mrr_at_3
value: 22.587
verified: no, type: mrr_at_5
value: 23.677
verified: no, type: ndcg_at_1
value: 16.866
verified: no, type: ndcg_at_10
value: 27.749000000000002
verified: no, type: ndcg_at_100
value: 31.769
verified: no, type: ndcg_at_1000
value: 33.61
verified: no, type: ndcg_at_20
value: 28.849000000000004
verified: no, type: ndcg_at_3
value: 23.462
verified: no, type: ndcg_at_5
value: 25.491000000000003
verified: no, type: precision_at_1
value: 16.866
verified: no, type: precision_at_10
value: 4.343
verified: no, type: precision_at_100
value: 0.649
verified: no, type: precision_at_1000
value: 0.08099999999999999
verified: no, type: precision_at_20
value: 2.41
verified: no, type: precision_at_3
value: 10.149
verified: no, type: precision_at_5
value: 7.134
verified: no, type: recall_at_1
value: 15.597
verified: no, type: recall_at_10
value: 39.652
verified: no, type: recall_at_100
value: 59.477999999999994
verified: no, type: recall_at_1000
value: 74.35300000000001
verified: no, type: recall_at_20
value: 43.905
verified: no, type: recall_at_3
value: 28.109
verified: no, type: recall_at_5
value: 32.934999999999995
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (te)
config: te
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 21.236
verified: no, type: map_at_10
value: 29.841
verified: no, type: map_at_100
value: 30.729
verified: no, type: map_at_1000
value: 30.817
verified: no, type: map_at_20
value: 30.331999999999997
verified: no, type: map_at_3
value: 27.154
verified: no, type: map_at_5
value: 28.719
verified: no, type: mrr_at_1
value: 21.618000000000002
verified: no, type: mrr_at_10
value: 30.192999999999998
verified: no, type: mrr_at_100
value: 31.067
verified: no, type: mrr_at_1000
value: 31.148999999999997
verified: no, type: mrr_at_20
value: 30.668
verified: no, type: mrr_at_3
value: 27.576
verified: no, type: mrr_at_5
value: 29.110000000000003
verified: no, type: ndcg_at_1
value: 21.618000000000002
verified: no, type: ndcg_at_10
value: 34.633
verified: no, type: ndcg_at_100
value: 39.425
verified: no, type: ndcg_at_1000
value: 41.762
verified: no, type: ndcg_at_20
value: 36.428
verified: no, type: ndcg_at_3
value: 29.189
verified: no, type: ndcg_at_5
value: 31.995
verified: no, type: precision_at_1
value: 21.618000000000002
verified: no, type: precision_at_10
value: 5.1209999999999996
verified: no, type: precision_at_100
value: 0.751
verified: no, type: precision_at_1000
value: 0.094
verified: no, type: precision_at_20
value: 2.923
verified: no, type: precision_at_3
value: 11.876000000000001
verified: no, type: precision_at_5
value: 8.551
verified: no, type: recall_at_1
value: 21.236
verified: no, type: recall_at_10
value: 49.436
verified: no, type: recall_at_100
value: 72.94699999999999
verified: no, type: recall_at_1000
value: 91.405
verified: no, type: recall_at_20
value: 56.562
verified: no, type: recall_at_3
value: 34.682
verified: no, type: recall_at_5
value: 41.445
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (telugu)
config: telugu
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 16.872999999999998
verified: no, type: map_at_10
value: 26.543
verified: no, type: map_at_100
value: 27.3
verified: no, type: map_at_1000
value: 27.389999999999997
verified: no, type: map_at_20
value: 26.883000000000003
verified: no, type: map_at_3
value: 23.735999999999997
verified: no, type: map_at_5
value: 25.113999999999997
verified: no, type: mrr_at_1
value: 17.492
verified: no, type: mrr_at_10
value: 27.233
verified: no, type: mrr_at_100
value: 27.950999999999997
verified: no, type: mrr_at_1000
value: 28.037
verified: no, type: mrr_at_20
value: 27.556000000000004
verified: no, type: mrr_at_3
value: 24.458
verified: no, type: mrr_at_5
value: 25.874999999999996
verified: no, type: ndcg_at_1
value: 17.492
verified: no, type: ndcg_at_10
value: 32.013999999999996
verified: no, type: ndcg_at_100
value: 36.299
verified: no, type: ndcg_at_1000
value: 38.868
verified: no, type: ndcg_at_20
value: 33.238
verified: no, type: ndcg_at_3
value: 26.133
verified: no, type: ndcg_at_5
value: 28.632999999999996
verified: no, type: precision_at_1
value: 17.492
verified: no, type: precision_at_10
value: 5.108
verified: no, type: precision_at_100
value: 0.735
verified: no, type: precision_at_1000
value: 0.095
verified: no, type: precision_at_20
value: 2.81
verified: no, type: precision_at_3
value: 11.3
verified: no, type: precision_at_5
value: 8.019
verified: no, type: recall_at_1
value: 16.872999999999998
verified: no, type: recall_at_10
value: 48.684
verified: no, type: recall_at_100
value: 70.04599999999999
verified: no, type: recall_at_1000
value: 90.635
verified: no, type: recall_at_20
value: 53.483000000000004
verified: no, type: recall_at_3
value: 32.353
verified: no, type: recall_at_5
value: 38.39
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (th)
config: th
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 19.205
verified: no, type: map_at_10
value: 32.704
verified: no, type: map_at_100
value: 34.519
verified: no, type: map_at_1000
value: 34.634
verified: no, type: map_at_20
value: 33.762
verified: no, type: map_at_3
value: 27.992
verified: no, type: map_at_5
value: 30.354999999999997
verified: no, type: mrr_at_1
value: 27.558
verified: no, type: mrr_at_10
value: 40.933
verified: no, type: mrr_at_100
value: 41.916
verified: no, type: mrr_at_1000
value: 41.946
verified: no, type: mrr_at_20
value: 41.54
verified: no, type: mrr_at_3
value: 37.312
verified: no, type: mrr_at_5
value: 39.393
verified: no, type: ndcg_at_1
value: 27.558
verified: no, type: ndcg_at_10
value: 41.038999999999994
verified: no, type: ndcg_at_100
value: 48.076
verified: no, type: ndcg_at_1000
value: 49.946
verified: no, type: ndcg_at_20
value: 44.03
verified: no, type: ndcg_at_3
value: 33.013999999999996
verified: no, type: ndcg_at_5
value: 36.519
verified: no, type: precision_at_1
value: 27.558
verified: no, type: precision_at_10
value: 9.523
verified: no, type: precision_at_100
value: 1.52
verified: no, type: precision_at_1000
value: 0.178
verified: no, type: precision_at_20
value: 5.778
verified: no, type: precision_at_3
value: 18.963
verified: no, type: precision_at_5
value: 14.379
verified: no, type: recall_at_1
value: 19.205
verified: no, type: recall_at_10
value: 56.94200000000001
verified: no, type: recall_at_100
value: 84.937
verified: no, type: recall_at_1000
value: 96.86399999999999
verified: no, type: recall_at_20
value: 66.719
verified: no, type: recall_at_3
value: 36.536
verified: no, type: recall_at_5
value: 44.854
verified: no, task: type: retrieval
dataset: type: mteb/mrtydi
name: MTEB MrTydiRetrieval (thai)
config: thai
split: test
revision: fc24a3ce8f09746410daee3d5cd823ff7a0675b7
metrics: type: map_at_1
value: 17.913
verified: no, type: map_at_10
value: 29.006999999999998
verified: no, type: map_at_100
value: 30.184
verified: no, type: map_at_1000
value: 30.249
verified: no, type: map_at_20
value: 29.799999999999997
verified: no, type: map_at_3
value: 25.14
verified: no, type: map_at_5
value: 27.172
verified: no, type: mrr_at_1
value: 19.664
verified: no, type: mrr_at_10
value: 30.891000000000002
verified: no, type: mrr_at_100
value: 31.896
verified: no, type: mrr_at_1000
value: 31.951
verified: no, type: mrr_at_20
value: 31.566
verified: no, type: mrr_at_3
value: 27.128999999999998
verified: no, type: mrr_at_5
value: 29.255
verified: no, type: ndcg_at_1
value: 19.664
verified: no, type: ndcg_at_10
value: 35.674
verified: no, type: ndcg_at_100
value: 40.969
verified: no, type: ndcg_at_1000
value: 42.698
verified: no, type: ndcg_at_20
value: 38.345
verified: no, type: ndcg_at_3
value: 27.826
verified: no, type: ndcg_at_5
value: 31.493
verified: no, type: precision_at_1
value: 19.664
verified: no, type: precision_at_10
value: 6.143
verified: no, type: precision_at_100
value: 0.8909999999999999
verified: no, type: precision_at_1000
value: 0.105
verified: no, type: precision_at_20
value: 3.66
verified: no, type: precision_at_3
value: 12.353
verified: no, type: precision_at_5
value: 9.411999999999999
verified: no, type: recall_at_1
value: 17.913
verified: no, type: recall_at_10
value: 54.705999999999996
verified: no, type: recall_at_100
value: 78.557
verified: no, type: recall_at_1000
value: 91.835
verified: no, type: recall_at_20
value: 64.846
verified: no, type: recall_at_3
value: 33.669
verified: no, type: recall_at_5
value: 42.297000000000004
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (yo)
config: yo
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 7.002999999999999
verified: no, type: map_at_10
value: 9.567
verified: no, type: map_at_100
value: 10.126
verified: no, type: map_at_1000
value: 10.209
verified: no, type: map_at_20
value: 9.944
verified: no, type: map_at_3
value: 8.929
verified: no, type: map_at_5
value: 8.929
verified: no, type: mrr_at_1
value: 7.563000000000001
verified: no, type: mrr_at_10
value: 10.503
verified: no, type: mrr_at_100
value: 11.151
verified: no, type: mrr_at_1000
value: 11.232000000000001
verified: no, type: mrr_at_20
value: 10.965
verified: no, type: mrr_at_3
value: 9.804
verified: no, type: mrr_at_5
value: 9.804
verified: no, type: ndcg_at_1
value: 7.563000000000001
verified: no, type: ndcg_at_10
value: 11.304
verified: no, type: ndcg_at_100
value: 14.526
verified: no, type: ndcg_at_1000
value: 17.253
verified: no, type: ndcg_at_20
value: 12.766
verified: no, type: ndcg_at_3
value: 9.797
verified: no, type: ndcg_at_5
value: 9.754999999999999
verified: no, type: precision_at_1
value: 7.563000000000001
verified: no, type: precision_at_10
value: 1.765
verified: no, type: precision_at_100
value: 0.378
verified: no, type: precision_at_1000
value: 0.064
verified: no, type: precision_at_20
value: 1.261
verified: no, type: precision_at_3
value: 4.202
verified: no, type: precision_at_5
value: 2.521
verified: no, type: recall_at_1
value: 7.002999999999999
verified: no, type: recall_at_10
value: 16.036
verified: no, type: recall_at_100
value: 31.302999999999997
verified: no, type: recall_at_1000
value: 53.010999999999996
verified: no, type: recall_at_20
value: 21.429000000000002
verified: no, type: recall_at_3
value: 11.415000000000001
verified: no, type: recall_at_5
value: 11.415000000000001
verified: no, task: type: retrieval
dataset: type: mteb/miracl-hard-negatives
name: MTEB MIRACLRetrievalHardNegatives (zh)
config: zh
split: dev
revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
metrics: type: map_at_1
value: 8.341999999999999
verified: no, type: map_at_10
value: 18.393
verified: no, type: map_at_100
value: 21.796
verified: no, type: map_at_1000
value: 21.932
verified: no, type: map_at_20
value: 20.238999999999997
verified: no, type: map_at_3
value: 13.386999999999999
verified: no, type: map_at_5
value: 15.568000000000001
verified: no, type: mrr_at_1
value: 15.522
verified: no, type: mrr_at_10
value: 28.386
verified: no, type: mrr_at_100
value: 29.906
verified: no, type: mrr_at_1000
value: 29.925
verified: no, type: mrr_at_20
value: 29.413
verified: no, type: mrr_at_3
value: 23.707
verified: no, type: mrr_at_5
value: 26.073
verified: no, type: ndcg_at_1
value: 15.522
verified: no, type: ndcg_at_10
value: 26.904
verified: no, type: ndcg_at_100
value: 39.336
verified: no, type: ndcg_at_1000
value: 41.244
verified: no, type: ndcg_at_20
value: 32.04
verified: no, type: ndcg_at_3
value: 18.34
verified: no, type: ndcg_at_5
value: 21.29
verified: no, type: precision_at_1
value: 15.522
verified: no, type: precision_at_10
value: 9.084
verified: no, type: precision_at_100
value: 2.1149999999999998
verified: no, type: precision_at_1000
value: 0.244
verified: no, type: precision_at_20
value: 6.5009999999999994
verified: no, type: precision_at_3
value: 13.232
verified: no, type: precision_at_5
value: 11.552
verified: no, type: recall_at_1
value: 8.341999999999999
verified: no, type: recall_at_10
value: 40.553
verified: no, type: recall_at_100
value: 86.33
verified: no, type: recall_at_1000
value: 97.24199999999999
verified: no, type: recall_at_20
value: 56.589999999999996
verified: no, type: recall_at_3
value: 18.82
verified: no, type: recall_at_5
value: 26.304
verified: no
base_model: FacebookAI/xlm-roberta-base
widget: source_sentence: how to get rid of an iron mark
sentences: Quick Answer. A good remedy for removing shiny iron scorch marks from fabric is to use hydrogen peroxide with ammonia. Other options for removing shiny scorch marks include laundry detergent, bleach or vinegar, but it depends on how quickly the scorch is remedied. Keep Learning., Largely due to declining sales, in 2006, Tommy Hilfiger sold his company for $1.6 billion, or $16.80 a share, to Apax Partners, a private investment company. In March 2010, Phillips-Van Heusen, owner of Calvin Klein, bought the Tommy Hilfiger Corporation for $3 billion., You need to heat continuous until it turns to a paste. Use this simple mixture by rubbing it right onto the soleplate. Now, make sure that the iron is unplugged before cleaning it. After rubbing the mixture, with the help of a nice, clean cloth wipe the unsightly scorch marks off your iron. 5 people found this useful., source_sentence: how much does ipl facial cost
sentences: Prices usually vary according to the ipl treatment size. The average cost for a FotoFacial/IPL is $350 - $600 each treatment, depending on the body part.A consultation with a fotofacial specialist and the number of treatments needed will determine your ipl treatment cost.s discussed above, IPL does not damage the skin surface, unlike dermabrasion and laser resurfacing. Therefore, there is virtually no recovery time.â Treatments take approximately 30-45 minutes. Patients can apply makeup before leaving the office and return to work the same day., âN.I., South Kingstown, Rhode IslandGenerally, the oven temperature will not need to be adjusted when baking mini or jumbo muffins, but the baking time will most likely need to be altered. Mini muffins will take anywhere from 10 to 15 minutes while jumbo muffins will bake from 20 to 40 minutes.Check jumbo muffins for doneness after 20 minutes, then every 5 to 10 minutes. Keep in mind that the baking time will vary according to the recipe.The variation is due to the oven temperature and the amount of batter in each muffin cup.heck jumbo muffins for doneness after 20 minutes, then every 5 to 10 minutes. Keep in mind that the baking time will vary according to the recipe. The variation is due to the oven temperature and the amount of batter in each muffin cup., Prices usually vary according to the ipl treatment size. The average cost for a FotoFacial/IPL is $350 - $600 each treatment, depending on the body part.A consultation with a fotofacial specialist and the number of treatments needed will determine your ipl treatment cost.PL, which stands for intensed pulsed light, is non-ablative meaning that is does not damage the surface of the skin. The intense light is delivered to the deeper parts of the skin (dermis) and leaves the superficial aspect of the skin (epidermis) untouched., source_sentence: who voiced scooby doo
sentences: Don Messick originated the voice of Scooby-Doo, and was the voice of the character for over 25 years until his retirement from voice acting in 1996 (he subsequently passed away the following year).rank Welker's Scooby-Doo voice is pretty much identical to the voice he used for Brain on Inspector Gadget.. Hadley Kay and Neil Fanning are the worst, IMO..., because als symptoms include fatigue muscle weakness and muscle twitches early on it can look like other very treatable illnesses one that commonly comes up is lyme disease an infectious disease resulting from a tick bite unlike als lyme is usually treatable with antibiotics lyme disease does not cause als and generally in a diagnostic workup a neurologist can easily separate als from lyme infections either clinically or with testing, Curse Of The Lake Monster while Frank Welker voices him. 1  Don Messick (1969â1996) 2  Hadley Kay (Johnny Bravo) 3  Scott Innes (1998â2001)  Frank Welker (2002âpresent plus Scooby- 1 Doo! Neil Fanning (2002 and 2004 live-action films)  Dave Coulier(2005 in Robot 1  Chicken) In Denmark, Scooby Doo is voiced by Lars Thiesgaard., source_sentence: track lighting that can be mounted  on wall
sentences: Madison is one of 14 Community Plan areas in the Metro Nashville-Davidson County area for which zoning and land use planning is done. The 2015-updated Community Plan for Madison, an 89-page document adopted by the Metropolitan Planning Commission, was updated in 2015 as part of NashvilleNext's long-term planning., This three-light plug-in LED track kit can be surface-mounted anywhere in a room as the power feed cord eliminates the need for a ...junction box. Quick and easy to install, it features three 12 watt LED bullet heads that pivot in a cradle and produce a spotlight beam of energy-saving light., This white finish, three-light LED track kit can be surface-mounted or suspended from the ceiling with pendant lighting accessorie...s. A power feed cord and plug lets you install it easily without the need for a junction box. Arrange the three,..., source_sentence: Most Common Apple Varieties
sentences: Well, rest easy, because this condensed list of the 18 most popular apple varieties breaks down the information every apple eater should knowâhow to cook them, best recipes, and when they are in season. Red Delicious: A popular eating apple that looks just how we all imagine an apple should., Here's a look at the top 50 draft-eligible prospects for next year, led by quarterback Connor Cook, defensive lineman Joey Bosa, cornerback Vernon Hargreaves, and offensive tackle Ronnie Stanley and Laremy Tunsil., The most popular apple varieties are Cortland, Red Delicious, Golden Delicious, Empire, Fuji, Gala, Ida Red, Macoun, McIntosh, Northern Spy, and Winesap. Olwen Woodier also offers descriptions for an additional 20 varieties of apples in this very useful and informative cookbook. Cortland.
pipeline_tag: sentence-similarity
library_name: sentence-transformers
license: mit
Likes: 0 | All-time downloads: 552
Created: 2025-02-04 16:00:49