Model: sentence-transformers/static-retrieval-mrl-en-v1
Author: sentence-transformers
Pipeline: sentence-similarity
Library: sentence-transformers
Tags: sentence-transformers, onnx, safetensors, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:80543469, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss, en, dataset:sentence-transformers/gooaq, dataset:sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1, dataset:sentence-transformers/squad, dataset:sentence-transformers/s2orc, dataset:sentence-transformers/all-nli, dataset:sentence-transformers/paq, dataset:sentence-transformers/trivia-qa, dataset:bclavie/msmarco-10m-triplets, dataset:nthakur/swim-ir-monolingual, dataset:sentence-transformers/pubmedqa, dataset:sentence-transformers/miracl, dataset:sentence-transformers/mldr, dataset:sentence-transformers/mr-tydi, arxiv:1908.10084, arxiv:2205.13147, arxiv:1705.00652, license:apache-2.0, model-index, co2_eq_emissions, endpoints_compatible, deploy:azure, region:us
Card metadata: language: en
license: apache-2.0
tags: sentence-transformers, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:80543469, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss
widget: source_sentence: What was the Office of Foods in charge of?
sentences: This area, stretching northward from the centrally located Great Hall of State, is believed to have been the site of the Office of Foods. This office stocked foods other than the rice that was paid as tax, and was in charge of providing meals for state banquets and rituals held in the palace., In 2002, Barclay Records, then as part of Universal Music France, released a digitally remastered version of the original vinyl in CD and in 10" (25 cm) vinyl record (LP), under the same name, as part of a compilation containing re-releases of all of Dalida's studio albums recorded under the Barclay label. The album was again re-released in 2005., Kevin Jon Davies is a British television and video director primarily associated with documentaries and spin-off videos associated with "Doctor Who", "The Hitchhiker's Guide to the Galaxy" and "Blake's 7". He also worked on the BAFTA award-winning animation sequences of the 1981 "Hitchhiker's Guide" television adaptation., source_sentence: jak wysłać sf do krs?
sentences: Kliknij na pole „Przygotowanie i składanie zgłoszeń”, Następnie kliknij niebieski przycisk Dodaj zgłoszenie i uzupełnij o numer KRS Twojej jednostki na stronie „Rejestracja nowego zgłoszenia – Krok 1”, When you experience a trigger, the insides of your airways swell even more. This narrows the space for air to move in and out of the lungs. The muscles that wrap around your airways also can tighten, making breathing even harder. When that happens, it's called an asthma flare-up, asthma episode or asthma "attack.", Lie (L) – The Lie scale is intended to identify individuals who are deliberately trying to avoid answering the MMPI honestly and in a frank manner. The scale measures attitudes and practices that are culturally laudable, but rarely found in most people., source_sentence: Air Pollution in Eastern Asia: An Integrated Perspective: Chapter 14: Observation of Air Pollution over China Using the IASI Thermal Infrared Space Sensor
sentences: In this chapter we describe what is achievable in terms of pollutant tracking from space using observations provided by thermal infrared remote sensors. After a general introduction on infrared remote sensing, we exploit the data provided by the Infrared Atmospheric Sounding Interferometer (IASI) missions onboard the Metop series of satellite to illustrate pollution detection at various spatial and temporal scales. Then, we focus on air pollution over China and discuss three case studies involving different pollutants. The first example discusses the geophysical conditions for detection of ammonia (NH3) and sulfur dioxide (SO2), both precursors of particulate matter (PM). The second case illustrates the seasonal variation of ozone (O3), in particular during the monsoon period. The third case shows the local accumulation of enhanced levels of carbon monoxide (CO) when pollution episodes occur., This article explores the political aspects of Islamic parties in Jombang, East Java. The issue came about during the controversy arising out of the defection of the leader of the Tarekat Qadiriyah Wa Naqsyabandiyah, an Islamic order, prior to the 1977 general election. It raised questions as to the political orientation of Islamic groups in Indonesia during the 1970s and 1980s., Abstract Unexpected findings on bone scintigraphy such as asymmetrical uptake in extremities may cause confusion for the diagnosis. The authors describe three cases of accidental intraarterial injection of Tc- 99m methylene diphosphonate ( 99m Tc-MDP) on the antecubital region and discuss the findings and differential diagnosis., source_sentence: What type of stimuli do nociceptors response to?
sentences: After independence, Dutch was dropped as an official language and replaced by Malay. Yet the Indonesian language inherited many words from Dutch: words for everyday life as well as scientific and technological terms. One scholar argues that 20% of Indonesian words can be traced back to Dutch words, many of which are transliterated to reflect phonetic pronunciation e.g. kantoor (Dutch for "office") in Indonesian is kantor, while bus ("bus") becomes bis. In addition, many Indonesian words are calques on Dutch, for example, rumah sakit (Indonesian for "hospital") is calqued on the Dutch ziekenhuis (literally "house of the sick"), kebun binatang ("zoo") on dierentuin (literally "animal garden"), undang-undang dasar ("constitution") from grondwet (literally "ground law"). These account for some of the differences in vocabulary between Indonesian and Malay., Wilhelm Erb's (1874) "intensive" theory, that a pain signal can be generated by intense enough stimulation of any sensory receptor, has been soundly disproved. Some sensory fibers do not differentiate between noxious and non-noxious stimuli, while others, nociceptors, respond only to noxious, high intensity stimuli. At the peripheral end of the nociceptor, noxious stimuli generate currents that, above a given threshold, begin to send signals along the nerve fiber to the spinal cord. The "specificity" (whether it responds to thermal, chemical or mechanical features of its environment) of a nociceptor is determined by which ion channels it expresses at its peripheral end. Dozens of different types of nociceptor ion channels have so far been identified, and their exact functions are still being determined., The first attempt to establish a proper governing body and adopted the current set of Rugby rules was the Foot Ball Association of Canada, organized on March 24, 1873 followed by the Canadian Rugby Football Union (CRFU) founded June 12, 1880, which included teams from Ontario and Quebec. Later both the Ontario and Quebec Rugby Football Union (ORFU and QRFU) were formed (January 1883), and then the Interprovincial (1907) and Western Interprovincial Football Union (1936) (IRFU and WIFU). The CRFU reorganized into an umbrella organization forming the Canadian Rugby Union (CRU) in 1891. The original forerunners to the current Canadian Football League, was established in 1956 when the IRFU and WIFU formed an umbrella organization, The Canadian Football Council (CFC). And then in 1958 the CFC left The CRFU to become The CFL., source_sentence: Gadofosveset-enhanced MR angiography of carotid arteries: does steady-state imaging improve accuracy of first-pass imaging?
sentences: Prior studies have demonstrated improved clinical outcomes for surgeons with a high-volume experience with certain open vascular operations. A high-volume experience with carotid artery stenting (CAS) improves clinical outcomes. Moreover, it is not known whether experience with other endovascular procedures, including percutaneous coronary interventions (PCIs), is an adequate substitute for experience with CAS. The goal of this study was to quantify the effect of increasing clinician volume of CAS, endovascular aneurysm repair (EVAR), and thoracic endovascular aortic aneurysm repair (TEVAR), and PCI on the outcomes for CAS., While sensitive to internal carotid artery (ICA) occlusion, carotid ultrasound can produce false-positive results. CT angiography (CTA) has a high specificity for ICA occlusion and is safer and cheaper than catheter angiography, although less accurate. We determined the cost-effectiveness of CTA versus catheter angiography for confirming an ICA occlusion first suggested by carotid ultrasound., Brachial artery FMD and GMD and carotid intima media thickness (cIMT) were studied using ultrasound in 20 patients diagnosed with early RA in whom symptoms had been present for less than 12 months, and in 20 control subjects matched for age, sex and established cardiovascular risk factors. FMD and GMD were re-assessed after 12 months in RA patients and the change in each parameter was calculated. Data were analysed by univariate regression., Compared with preoperative clinical and conventional MR data, (1)H MRS improved the accuracy of MR imaging from 60.9% to 83%. We found (1)H MRS reliably distinguished between abscess and high-grade tumour, and between high-grade glioma and low-grade glioma, but was not able to reliably distinguish between recurrent glioma and radiation necrosis. In 12/23 cases (52%) the (1)H MRS findings positively altered our clinical management. Two representative cases are presented., Different in-plane resolutions have been used for carotid 3T MRI. We compared the reproducibility, as well as the within- and between reader variability of high and routinely used spatial resolution in scans of patients with atherosclerotic carotid artery disease. Since no consensus exists about the optimal segmentation method, we analysed all imaging data using two different segmentation methods., In the population-based Prospective Investigation of the Vasculature in Uppsala Seniors (PIVUS) study (1016 subjects all aged 70), the prevalence of overt plaques and echogenectity (grey scale median, GSM) of carotid artery plaques were recorded by ultrasound in both of the carotid arteries. The thickness (IMT) and echogenicity (IM-GSM) of the intima-media complex were also measured. Bisphenol A (BPA) and 10 phthalate metabolites were analyzed in serum by a API 4000 liquid chromatograph/tandem mass spectrometer., In a longitudinal study we investigated in vivo alterations of CVO during neuroinflammation, applying Gadofluorine M- (Gf) enhanced magnetic resonance imaging (MRI) in experimental autoimmune encephalomyelitis, an animal model of multiple sclerosis. SJL/J mice were monitored by Gadopentate dimeglumine- (Gd-DTPA) and Gf-enhanced MRI after adoptive transfer of proteolipid-protein-specific T cells. Mean Gf intensity ratios were calculated individually for different CVO and correlated to the clinical disease course. Subsequently, the tissue distribution of fluorescence-labeled Gf as well as the extent of cellular inflammation was assessed in corresponding histological slices., Development of an improved MR sequence for examining the lung., Thirty-seven carotid artery disease patients participated in this study, of whom 24 underwent magnetic resonance imaging before and after CEA. Seventeen control subjects spanning 5 decades underwent magnetic resonance imaging to assess age-related changes. Hemodynamic metrics (that is, relative time to peak and amplitude) were calculated with a γ-variate model. Linear regression was used to relate carotid artery disease burden to downstream hemodynamics in the circle of Willis., Carotid artery stenting (CAS) is associated with a higher risk of both hemodynamic depression and new ischemic brain lesions on diffusion-weighted imaging than carotid endarterectomy (CEA). We assessed whether the occurrence of hemodynamic depression is associated with these lesions in patients with symptomatic carotid stenosis treated by CAS or CEA in the randomized International Carotid Stenting Study (ICSS)-MRI substudy., Magnetic resonance imaging (MRI) guidance may improve the accuracy of Gleason score (GS) determination by directing the biopsy to regions of interest (ROI) that are likely to harbor high-grade prostate cancer (CaP). The aim of this study was to determine the frequency and predictors of GS upgrading when a subsequent MRI-guided biopsy is performed on patients with a diagnosis of GS 6 disease on the basis of conventional, transrectal ultrasound-guided biopsy., Measures of carotid-femoral pulse wave velocity (cf-PWV) and carotid augmentation index (cAI) may be affected by the presence of an abdominal aortic aneurysm (AAA). We, therefore, investigated series of various measures of arterial stiffness and wave reflections in patients with AAA, before and 4 weeks after endovascular aneurysm repair (EVAR)., High spatial resolution of dynamic contrast-enhanced (DCE) MR imaging allows characterization of heterogenous tumor microenvironment. Our purpose was to determine which is the best advanced MR imaging protocol, focused on additional MR perfusion method, for predicting recurrent metastatic brain tumor following gamma-knife radiosurgery (GKRS)., To determine whether acromegalic patients have increased thyroidal vascularity and blood flow on colour flow Doppler sonography (CFDS)., To investigate whether an existing method for correction of phase offset errors in phase-contrast velocity quantification is applicable for assessment of main pulmonary artery flow with an MR scanner equipped with a high-power gradient system., Consecutive patients (n = 292) undergoing carotid endarterectomy for symptomatic and asymptomatic carotid stenosis were included in the study. Mortality and cardiovascular ischemic events were recorded during a median follow-up of 5.2 years. Baseline plasma concentrations of adiponectin were measured. Cox regression models stratified for gender were used for estimation of risk of events., To evaluate the diagnostic accuracy of gadofosveset-enhanced magnetic resonance (MR) angiography in the assessment of carotid artery stenosis, with digital subtraction angiography (DSA) as the reference standard, and to determine the value of reading first-pass, steady-state, and "combined" (first-pass plus steady-state) MR angiograms., Phase-contrast Cardiovascular Magnetic Resonance Imaging (CMR) generally requires the analysis of stationary tissue adjacent to a blood vessel to serve as a baseline reference for zero velocity. However, for the heart and great vessels, there is often no stationary tissue immediately adjacent to the vessel. Consequently, uncorrected velocity offsets may introduce substantial errors in flow quantification. The purpose of this study was to assess the magnitude of these flow errors and to validate a clinically applicable method for their correction., This study was a post hoc analysis of a prospective cohort comprising 485 consecutive patients undergoing carotid endarterectomy for high-grade ICAS. Patients were classified by their clinical presentation, ie, asymptomatic (n = 213) or symptomatic (within 6 months of surgery; n = 272, comprising both transient ischemic attack [TIA; n = 163] and stroke [n = 109]). We investigated the association of cl-ICAS with the primary outcome in adjusted regression models., Several studies reported on the moderate diagnostic yield of elective invasive coronary angiography (ICA) regarding the presence of coronary artery disease (CAD), but limited data are available on how prior testing for ischaemia may contribute to improve the diagnostic yield in an every-day clinical setting. This study aimed to assess the value and use of cardiac myocardial perfusion single photon emission computed tomography (MPS) in patient selection prior to elective ICA., The feasibility of carotid stenting (CS) is no longer questionable, although its indications remain debatable. Until the results of randomized trials are available, personal series and registries should help in the comparison of long-term results of CS with those of endarterectomy. We report here the long-term results of a large series of CS in our department with a long follow-up. This retrospective study reviews a single surgeon's 11-year experience with CS. Our results are compared with those of conventional surgery emanating from our own series and the North American Symptomatic Carotid Endarterectomy Trial (NASCET), European Carotid Surgery Trial (ECST), and Asymptomatic Carotid Atherosclerosis Study (ACAS).
datasets: sentence-transformers/gooaq, sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1, sentence-transformers/squad, sentence-transformers/s2orc, sentence-transformers/all-nli, sentence-transformers/paq, sentence-transformers/trivia-qa, bclavie/msmarco-10m-triplets, nthakur/swim-ir-monolingual, sentence-transformers/pubmedqa, sentence-transformers/miracl, sentence-transformers/mldr, sentence-transformers/mr-tydi
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics: cosine_accuracy@1, cosine_accuracy@3, cosine_accuracy@5, cosine_accuracy@10, cosine_precision@1, cosine_precision@3, cosine_precision@5, cosine_precision@10, cosine_recall@1, cosine_recall@3, cosine_recall@5, cosine_recall@10, cosine_ndcg@10, cosine_mrr@10, cosine_map@100
co2_eq_emissions: emissions: 1014.8766030829654
energy_consumed: 2.610937435575236
source: codecarbon
training_type: fine-tuning
on_cloud: no
cpu_model: 13th Gen Intel(R) Core(TM) i7-13700K
ram_total_size: 31.777088165283203
hours_used: 17.883
hardware_used: 1 x NVIDIA GeForce RTX 3090
model-index: name: Static Embeddings with BERT uncased tokenizer finetuned on various datasets
results: task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoClimateFEVER
type: NanoClimateFEVER
metrics: type: cosine_accuracy@1
value: 0.32
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.52
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.6
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.78
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.32
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.19333333333333333
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.14
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.10399999999999998
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.14666666666666664
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.239
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.27899999999999997
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.4196666666666667
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.33085031011968163
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.44530158730158725
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.259819611075427
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoDBPedia
type: NanoDBPedia
metrics: type: cosine_accuracy@1
value: 0.7
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.84
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.9
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.94
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.7
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5866666666666666
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.544
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.45199999999999996
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.0804732343549837
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.16047472236902457
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.21798474210348842
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.31433571884014205
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.5681388031303078
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.7853888888888889
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.4334843491187922
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoFEVER
type: NanoFEVER
metrics: type: cosine_accuracy@1
value: 0.46
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.8
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.84
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.94
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.46
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.26666666666666666
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.18
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.09999999999999998
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.4366666666666667
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.7466666666666667
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.8033333333333332
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.9033333333333333
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6921500788245725
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.639690476190476
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.62054338159709
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoFiQA2018
type: NanoFiQA2018
metrics: type: cosine_accuracy@1
value: 0.28
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.44
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.54
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.64
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.28
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.19333333333333333
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.16
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.10399999999999998
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.15188888888888888
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.29826984126984124
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.3792936507936508
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.4837936507936508
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.3651145030243953
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.3914603174603174
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.3023673541934707
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoHotpotQA
type: NanoHotpotQA
metrics: type: cosine_accuracy@1
value: 0.64
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.82
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.86
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.96
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.64
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.3733333333333333
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.26
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.14799999999999996
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.32
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.56
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.65
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.74
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6547177705459605
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.7485238095238096
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.5797919554359183
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoMSMARCO
type: NanoMSMARCO
metrics: type: cosine_accuracy@1
value: 0.18
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.42
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.5
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.66
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.18
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.13999999999999999
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.10000000000000002
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.066
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.18
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.42
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.5
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.66
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.4040678769319761
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.3244682539682539
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.33886403445504565
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoNFCorpus
type: NanoNFCorpus
metrics: type: cosine_accuracy@1
value: 0.42
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.56
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.62
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.72
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.42
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.3733333333333333
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.32
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.244
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.04278202363094378
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.09842444348194118
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.11962677523904507
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.1389182072247147
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.3241949561078219
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.5040793650793652
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.1448579573714899
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoNQ
type: NanoNQ
metrics: type: cosine_accuracy@1
value: 0.24
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.44
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.58
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.24
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.14666666666666667
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.124
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.07600000000000001
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.24
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.43
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.58
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.69
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.4533881733265689
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.3764047619047619
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.3890107375543526
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoQuoraRetrieval
type: NanoQuoraRetrieval
metrics: type: cosine_accuracy@1
value: 0.8
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.96
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 1
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 1
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.8
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.38666666666666655
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.24799999999999997
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.12999999999999998
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.7106666666666667
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.9253333333333333
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.9626666666666668
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.9793333333333334
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.895097527564125
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.88
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.8594406482406483
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoSCIDOCS
type: NanoSCIDOCS
metrics: type: cosine_accuracy@1
value: 0.28
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.48
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.54
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.28
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.22666666666666666
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.188
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.14
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.059666666666666666
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.14166666666666666
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.19466666666666668
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.2886666666666667
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.26425784158945775
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.39979365079365076
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.20502449880105952
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoArguAna
type: NanoArguAna
metrics: type: cosine_accuracy@1
value: 0.1
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.46
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.56
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.74
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.1
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.15333333333333332
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.11200000000000003
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.07400000000000001
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.1
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.46
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.56
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.74
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.4077879341218404
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.3033888888888889
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.31510434322531095
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoSciFact
type: NanoSciFact
metrics: type: cosine_accuracy@1
value: 0.52
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.6
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.62
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.76
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.52
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.20666666666666667
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.132
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.08399999999999999
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.485
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.57
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.595
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.75
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6111476167014296
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.5836904761904762
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.5683309026222819
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: NanoTouche2020
type: NanoTouche2020
metrics: type: cosine_accuracy@1
value: 0.5714285714285714
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.8979591836734694
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.9795918367346939
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 1
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5714285714285714
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.6054421768707482
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.6204081632653061
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.5306122448979592
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.03980518443040866
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.12364050983083796
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.20953289383493803
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.33697859476017505
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.5702638593808323
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.744047619047619
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.4469881140237455
name: Cosine Map@100
verified: no, task: type: nano-beir
name: Nano BEIR
dataset: name: NanoBEIR mean
type: NanoBEIR_mean
metrics: type: cosine_accuracy@1
value: 0.4239560439560439
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.6336891679748822
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.7030455259026686
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.8107692307692307
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.4239560439560439
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.2963160648874934
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.24064678178963897
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.17327786499215073
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.2302781536901455
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.3979597064321778
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.4654695945105992
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.5726943208937448
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.503167480874536
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.5481721611721612
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.420279068285741
name: Cosine Map@100
verified: no, dataset: config: default
name: MTEB AILACasedocs (default)
revision: 4106e6bcc72e0698d714ea8b101355e3e238431a
split: test
type: mteb/AILA_casedocs
metrics: type: main_score
value: 25.342
verified: no, type: map_at_1
value: 7.2059999999999995
verified: no, type: map_at_10
value: 17.343
verified: no, type: map_at_100
value: 21.356
verified: no, type: map_at_1000
value: 21.719
verified: no, type: map_at_20
value: 18.765
verified: no, type: map_at_3
value: 12.395
verified: no, type: map_at_5
value: 14.796000000000001
verified: no, type: mrr_at_1
value: 20
verified: no, type: mrr_at_10
value: 29.019047619047615
verified: no, type: mrr_at_100
value: 30.079478514482233
verified: no, type: mrr_at_1000
value: 30.11575302428615
verified: no, type: mrr_at_20
value: 29.311976911976913
verified: no, type: mrr_at_3
value: 25
verified: no, type: mrr_at_5
value: 27.399999999999995
verified: no, type: ndcg_at_1
value: 20
verified: no, type: ndcg_at_10
value: 25.342
verified: no, type: ndcg_at_100
value: 39.728
verified: no, type: ndcg_at_1000
value: 42.605
verified: no, type: ndcg_at_20
value: 28.157
verified: no, type: ndcg_at_3
value: 21.041999999999998
verified: no, type: ndcg_at_5
value: 22.147
verified: no, type: precision_at_1
value: 20
verified: no, type: precision_at_10
value: 12.2
verified: no, type: precision_at_100
value: 3.38
verified: no, type: precision_at_1000
value: 0.38999999999999996
verified: no, type: precision_at_20
value: 8.3
verified: no, type: precision_at_3
value: 18
verified: no, type: precision_at_5
value: 16
verified: no, type: recall_at_1
value: 7.2059999999999995
verified: no, type: recall_at_10
value: 32.214
verified: no, type: recall_at_100
value: 85.658
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 39.265
verified: no, type: recall_at_3
value: 16.335
verified: no, type: recall_at_5
value: 21.897
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB AILAStatutes (default)
revision: ebfcd844eadd3d667efa3c57fc5c8c87f5c2867e
split: test
type: mteb/AILA_statutes
metrics: type: main_score
value: 22.184
verified: no, type: map_at_1
value: 5.167
verified: no, type: map_at_10
value: 12.325
verified: no, type: map_at_100
value: 19.326999999999998
verified: no, type: map_at_1000
value: 19.326999999999998
verified: no, type: map_at_20
value: 14.405999999999999
verified: no, type: map_at_3
value: 9.4
verified: no, type: map_at_5
value: 10.05
verified: no, type: mrr_at_1
value: 22
verified: no, type: mrr_at_10
value: 36.64682539682539
verified: no, type: mrr_at_100
value: 37.85209121304697
verified: no, type: mrr_at_1000
value: 37.85209121304697
verified: no, type: mrr_at_20
value: 37.4718241682638
verified: no, type: mrr_at_3
value: 32.666666666666664
verified: no, type: mrr_at_5
value: 33.46666666666667
verified: no, type: ndcg_at_1
value: 22
verified: no, type: ndcg_at_10
value: 22.184
verified: no, type: ndcg_at_100
value: 45.896
verified: no, type: ndcg_at_1000
value: 45.896
verified: no, type: ndcg_at_20
value: 27.881
verified: no, type: ndcg_at_3
value: 18.976000000000003
verified: no, type: ndcg_at_5
value: 16.728
verified: no, type: precision_at_1
value: 22
verified: no, type: precision_at_10
value: 10.8
verified: no, type: precision_at_100
value: 4.34
verified: no, type: precision_at_1000
value: 0.434
verified: no, type: precision_at_20
value: 8.6
verified: no, type: precision_at_3
value: 17.333000000000002
verified: no, type: precision_at_5
value: 12
verified: no, type: recall_at_1
value: 5.167
verified: no, type: recall_at_10
value: 26.133
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 40.5
verified: no, type: recall_at_3
value: 13.633000000000001
verified: no, type: recall_at_5
value: 15.533
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB ARCChallenge (default)
revision: c481e0da3dcbbad8bce7721dea9085b74320a0a3
split: test
type: RAR-b/ARC-Challenge
metrics: type: main_score
value: 6.042
verified: no, type: map_at_1
value: 1.451
verified: no, type: map_at_10
value: 4.253
verified: no, type: map_at_100
value: 4.8340000000000005
verified: no, type: map_at_1000
value: 4.9430000000000005
verified: no, type: map_at_20
value: 4.475
verified: no, type: map_at_3
value: 3.2140000000000004
verified: no, type: map_at_5
value: 3.7600000000000002
verified: no, type: mrr_at_1
value: 1.4505119453924915
verified: no, type: mrr_at_10
value: 4.250196381169083
verified: no, type: mrr_at_100
value: 4.831355631222712
verified: no, type: mrr_at_1000
value: 4.940667606986945
verified: no, type: mrr_at_20
value: 4.472323277417513
verified: no, type: mrr_at_3
value: 3.213879408418658
verified: no, type: mrr_at_5
value: 3.742889647326509
verified: no, type: ndcg_at_1
value: 1.451
verified: no, type: ndcg_at_10
value: 6.042
verified: no, type: ndcg_at_100
value: 9.765
verified: no, type: ndcg_at_1000
value: 13.655000000000001
verified: no, type: ndcg_at_20
value: 6.914
verified: no, type: ndcg_at_3
value: 3.852
verified: no, type: ndcg_at_5
value: 4.836
verified: no, type: precision_at_1
value: 1.451
verified: no, type: precision_at_10
value: 1.1860000000000002
verified: no, type: precision_at_100
value: 0.313
verified: no, type: precision_at_1000
value: 0.064
verified: no, type: precision_at_20
value: 0.772
verified: no, type: precision_at_3
value: 1.9060000000000001
verified: no, type: precision_at_5
value: 1.6209999999999998
verified: no, type: recall_at_1
value: 1.451
verified: no, type: recall_at_10
value: 11.86
verified: no, type: recall_at_100
value: 31.313999999999997
verified: no, type: recall_at_1000
value: 64.078
verified: no, type: recall_at_20
value: 15.443999999999999
verified: no, type: recall_at_3
value: 5.717
verified: no, type: recall_at_5
value: 8.106
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB AlphaNLI (default)
revision: 303f40ef3d50918d3dc43577d33f2f7344ad72c1
split: test
type: RAR-b/alphanli
metrics: type: main_score
value: 20.586
verified: no, type: map_at_1
value: 13.184999999999999
verified: no, type: map_at_10
value: 17.898
verified: no, type: map_at_100
value: 18.593
verified: no, type: map_at_1000
value: 18.679000000000002
verified: no, type: map_at_20
value: 18.238
verified: no, type: map_at_3
value: 16.362
verified: no, type: map_at_5
value: 17.217
verified: no, type: mrr_at_1
value: 13.185378590078328
verified: no, type: mrr_at_10
value: 17.89819822620082
verified: no, type: mrr_at_100
value: 18.5933695842888
verified: no, type: mrr_at_1000
value: 18.679218327500653
verified: no, type: mrr_at_20
value: 18.237717139340596
verified: no, type: mrr_at_3
value: 16.362053959965195
verified: no, type: mrr_at_5
value: 17.21714534377719
verified: no, type: ndcg_at_1
value: 13.184999999999999
verified: no, type: ndcg_at_10
value: 20.586
verified: no, type: ndcg_at_100
value: 24.571
verified: no, type: ndcg_at_1000
value: 27.161
verified: no, type: ndcg_at_20
value: 21.834
verified: no, type: ndcg_at_3
value: 17.375
verified: no, type: ndcg_at_5
value: 18.926000000000002
verified: no, type: precision_at_1
value: 13.184999999999999
verified: no, type: precision_at_10
value: 2.924
verified: no, type: precision_at_100
value: 0.49300000000000005
verified: no, type: precision_at_1000
value: 0.06999999999999999
verified: no, type: precision_at_20
value: 1.71
verified: no, type: precision_at_3
value: 6.7669999999999995
verified: no, type: precision_at_5
value: 4.817
verified: no, type: recall_at_1
value: 13.184999999999999
verified: no, type: recall_at_10
value: 29.243000000000002
verified: no, type: recall_at_100
value: 49.282
verified: no, type: recall_at_1000
value: 70.366
verified: no, type: recall_at_20
value: 34.204
verified: no, type: recall_at_3
value: 20.3
verified: no, type: recall_at_5
value: 24.086
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB AppsRetrieval (default)
revision: f22508f96b7a36c2415181ed8bb76f76e04ae2d5
split: test
type: CoIR-Retrieval/apps
metrics: type: main_score
value: 4.557
verified: no, type: map_at_1
value: 2.895
verified: no, type: map_at_10
value: 3.91
verified: no, type: map_at_100
value: 4.294
verified: no, type: map_at_1000
value: 4.391
verified: no, type: map_at_20
value: 4.089
verified: no, type: map_at_3
value: 3.4750000000000005
verified: no, type: map_at_5
value: 3.7130000000000005
verified: no, type: mrr_at_1
value: 2.895086321381142
verified: no, type: mrr_at_10
value: 3.909515377642868
verified: no, type: mrr_at_100
value: 4.293672586421636
verified: no, type: mrr_at_1000
value: 4.390523922890202
verified: no, type: mrr_at_20
value: 4.08917821169434
verified: no, type: mrr_at_3
value: 3.474988933156263
verified: no, type: mrr_at_5
value: 3.712704736609119
verified: no, type: ndcg_at_1
value: 2.895
verified: no, type: ndcg_at_10
value: 4.557
verified: no, type: ndcg_at_100
value: 6.868
verified: no, type: ndcg_at_1000
value: 10.407
verified: no, type: ndcg_at_20
value: 5.219
verified: no, type: ndcg_at_3
value: 3.6609999999999996
verified: no, type: ndcg_at_5
value: 4.088
verified: no, type: precision_at_1
value: 2.895
verified: no, type: precision_at_10
value: 0.6669999999999999
verified: no, type: precision_at_100
value: 0.185
verified: no, type: precision_at_1000
value: 0.049
verified: no, type: precision_at_20
value: 0.46499999999999997
verified: no, type: precision_at_3
value: 1.399
verified: no, type: precision_at_5
value: 1.046
verified: no, type: recall_at_1
value: 2.895
verified: no, type: recall_at_10
value: 6.666999999999999
verified: no, type: recall_at_100
value: 18.539
verified: no, type: recall_at_1000
value: 48.579
verified: no, type: recall_at_20
value: 9.296
verified: no, type: recall_at_3
value: 4.197
verified: no, type: recall_at_5
value: 5.232
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB ArguAna (default)
revision: c22ab2a51041ffd869aaddef7af8d8215647e41a
split: test
type: mteb/arguana
metrics: type: main_score
value: 44.41
verified: no, type: map_at_1
value: 21.479
verified: no, type: map_at_10
value: 35.995
verified: no, type: map_at_100
value: 37.258
verified: no, type: map_at_1000
value: 37.273
verified: no, type: map_at_20
value: 36.908
verified: no, type: map_at_3
value: 31.247000000000003
verified: no, type: map_at_5
value: 33.751
verified: no, type: mrr_at_1
value: 21.763869132290186
verified: no, type: mrr_at_10
value: 36.12420691368057
verified: no, type: mrr_at_100
value: 37.378777397870884
verified: no, type: mrr_at_1000
value: 37.39392969162474
verified: no, type: mrr_at_20
value: 37.03325723357897
verified: no, type: mrr_at_3
value: 31.33001422475101
verified: no, type: mrr_at_5
value: 33.91180654338541
verified: no, type: ndcg_at_1
value: 21.479
verified: no, type: ndcg_at_10
value: 44.41
verified: no, type: ndcg_at_100
value: 50.032
verified: no, type: ndcg_at_1000
value: 50.388
verified: no, type: ndcg_at_20
value: 47.642
verified: no, type: ndcg_at_3
value: 34.505
verified: no, type: ndcg_at_5
value: 39.031
verified: no, type: precision_at_1
value: 21.479
verified: no, type: precision_at_10
value: 7.148000000000001
verified: no, type: precision_at_100
value: 0.967
verified: no, type: precision_at_1000
value: 0.099
verified: no, type: precision_at_20
value: 4.202999999999999
verified: no, type: precision_at_3
value: 14.651
verified: no, type: precision_at_5
value: 10.996
verified: no, type: recall_at_1
value: 21.479
verified: no, type: recall_at_10
value: 71.479
verified: no, type: recall_at_100
value: 96.65700000000001
verified: no, type: recall_at_1000
value: 99.36
verified: no, type: recall_at_20
value: 84.068
verified: no, type: recall_at_3
value: 43.954
verified: no, type: recall_at_5
value: 54.979
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackAndroidRetrieval (default)
revision: f46a197baaae43b4f621051089b82a364682dfeb
split: test
type: mteb/cqadupstack-android
metrics: type: main_score
value: 31.177
verified: no, type: map_at_1
value: 19.758
verified: no, type: map_at_10
value: 26.619999999999997
verified: no, type: map_at_100
value: 27.784
verified: no, type: map_at_1000
value: 27.937
verified: no, type: map_at_20
value: 27.206999999999997
verified: no, type: map_at_3
value: 24.245
verified: no, type: map_at_5
value: 25.713
verified: no, type: mrr_at_1
value: 24.892703862660944
verified: no, type: mrr_at_10
value: 31.704702863501144
verified: no, type: mrr_at_100
value: 32.608301500063966
verified: no, type: mrr_at_1000
value: 32.68725795268983
verified: no, type: mrr_at_20
value: 32.177359559981575
verified: no, type: mrr_at_3
value: 29.685264663805444
verified: no, type: mrr_at_5
value: 30.958512160228906
verified: no, type: ndcg_at_1
value: 24.893
verified: no, type: ndcg_at_10
value: 31.177
verified: no, type: ndcg_at_100
value: 36.546
verified: no, type: ndcg_at_1000
value: 39.706
verified: no, type: ndcg_at_20
value: 32.926
verified: no, type: ndcg_at_3
value: 27.58
verified: no, type: ndcg_at_5
value: 29.465000000000003
verified: no, type: precision_at_1
value: 24.893
verified: no, type: precision_at_10
value: 5.966
verified: no, type: precision_at_100
value: 1.079
verified: no, type: precision_at_1000
value: 0.166
verified: no, type: precision_at_20
value: 3.5909999999999997
verified: no, type: precision_at_3
value: 13.209000000000001
verified: no, type: precision_at_5
value: 9.728
verified: no, type: recall_at_1
value: 19.758
verified: no, type: recall_at_10
value: 39.397
verified: no, type: recall_at_100
value: 63.446999999999996
verified: no, type: recall_at_1000
value: 85.083
verified: no, type: recall_at_20
value: 45.846
verified: no, type: recall_at_3
value: 28.855999999999998
verified: no, type: recall_at_5
value: 34.165
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackEnglishRetrieval (default)
revision: ad9991cb51e31e31e430383c75ffb2885547b5f0
split: test
type: mteb/cqadupstack-english
metrics: type: main_score
value: 25.901999999999997
verified: no, type: map_at_1
value: 16.730999999999998
verified: no, type: map_at_10
value: 22.24
verified: no, type: map_at_100
value: 23.168
verified: no, type: map_at_1000
value: 23.289
verified: no, type: map_at_20
value: 22.720000000000002
verified: no, type: map_at_3
value: 20.335
verified: no, type: map_at_5
value: 21.371000000000002
verified: no, type: mrr_at_1
value: 20.31847133757962
verified: no, type: mrr_at_10
value: 25.743908603781197
verified: no, type: mrr_at_100
value: 26.511937121538402
verified: no, type: mrr_at_1000
value: 26.58619222690668
verified: no, type: mrr_at_20
value: 26.15910380102564
verified: no, type: mrr_at_3
value: 23.77919320594478
verified: no, type: mrr_at_5
value: 24.846072186836484
verified: no, type: ndcg_at_1
value: 20.318
verified: no, type: ndcg_at_10
value: 25.901999999999997
verified: no, type: ndcg_at_100
value: 30.259999999999998
verified: no, type: ndcg_at_1000
value: 32.984
verified: no, type: ndcg_at_20
value: 27.47
verified: no, type: ndcg_at_3
value: 22.432
verified: no, type: ndcg_at_5
value: 23.999000000000002
verified: no, type: precision_at_1
value: 20.318
verified: no, type: precision_at_10
value: 4.707
verified: no, type: precision_at_100
value: 0.8580000000000001
verified: no, type: precision_at_1000
value: 0.134
verified: no, type: precision_at_20
value: 2.869
verified: no, type: precision_at_3
value: 10.552
verified: no, type: precision_at_5
value: 7.567
verified: no, type: recall_at_1
value: 16.730999999999998
verified: no, type: recall_at_10
value: 33.48
verified: no, type: recall_at_100
value: 52.245
verified: no, type: recall_at_1000
value: 70.634
verified: no, type: recall_at_20
value: 39.189
verified: no, type: recall_at_3
value: 23.805
verified: no, type: recall_at_5
value: 27.898
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackGamingRetrieval (default)
revision: 4885aa143210c98657558c04aaf3dc47cfb54340
split: test
type: mteb/cqadupstack-gaming
metrics: type: main_score
value: 36.312
verified: no, type: map_at_1
value: 23.072
verified: no, type: map_at_10
value: 31.64
verified: no, type: map_at_100
value: 32.761
verified: no, type: map_at_1000
value: 32.862
verified: no, type: map_at_20
value: 32.24
verified: no, type: map_at_3
value: 28.921999999999997
verified: no, type: map_at_5
value: 30.603
verified: no, type: mrr_at_1
value: 26.70846394984326
verified: no, type: mrr_at_10
value: 34.47342886998059
verified: no, type: mrr_at_100
value: 35.406961114894706
verified: no, type: mrr_at_1000
value: 35.47747613970401
verified: no, type: mrr_at_20
value: 34.984787094473404
verified: no, type: mrr_at_3
value: 32.15256008359454
verified: no, type: mrr_at_5
value: 33.544409613375095
verified: no, type: ndcg_at_1
value: 26.708
verified: no, type: ndcg_at_10
value: 36.312
verified: no, type: ndcg_at_100
value: 41.748000000000005
verified: no, type: ndcg_at_1000
value: 44.206
verified: no, type: ndcg_at_20
value: 38.257000000000005
verified: no, type: ndcg_at_3
value: 31.439
verified: no, type: ndcg_at_5
value: 34.036
verified: no, type: precision_at_1
value: 26.708
verified: no, type: precision_at_10
value: 6.0440000000000005
verified: no, type: precision_at_100
value: 0.966
verified: no, type: precision_at_1000
value: 0.125
verified: no, type: precision_at_20
value: 3.549
verified: no, type: precision_at_3
value: 14.086000000000002
verified: no, type: precision_at_5
value: 10.169
verified: no, type: recall_at_1
value: 23.072
verified: no, type: recall_at_10
value: 47.687000000000005
verified: no, type: recall_at_100
value: 72.469
verified: no, type: recall_at_1000
value: 90.568
verified: no, type: recall_at_20
value: 54.861000000000004
verified: no, type: recall_at_3
value: 34.758
verified: no, type: recall_at_5
value: 41.052
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackGisRetrieval (default)
revision: 5003b3064772da1887988e05400cf3806fe491f2
split: test
type: mteb/cqadupstack-gis
metrics: type: main_score
value: 19.756999999999998
verified: no, type: map_at_1
value: 12.546
verified: no, type: map_at_10
value: 17.009
verified: no, type: map_at_100
value: 17.758
verified: no, type: map_at_1000
value: 17.866
verified: no, type: map_at_20
value: 17.399
verified: no, type: map_at_3
value: 15.532000000000002
verified: no, type: map_at_5
value: 16.305
verified: no, type: mrr_at_1
value: 13.559322033898304
verified: no, type: mrr_at_10
value: 18.144067796610162
verified: no, type: mrr_at_100
value: 18.89867843656649
verified: no, type: mrr_at_1000
value: 18.995819754371045
verified: no, type: mrr_at_20
value: 18.54987150762981
verified: no, type: mrr_at_3
value: 16.666666666666664
verified: no, type: mrr_at_5
value: 17.43502824858757
verified: no, type: ndcg_at_1
value: 13.559
verified: no, type: ndcg_at_10
value: 19.756999999999998
verified: no, type: ndcg_at_100
value: 23.931
verified: no, type: ndcg_at_1000
value: 27.203
verified: no, type: ndcg_at_20
value: 21.173000000000002
verified: no, type: ndcg_at_3
value: 16.778000000000002
verified: no, type: ndcg_at_5
value: 18.104
verified: no, type: precision_at_1
value: 13.559
verified: no, type: precision_at_10
value: 3.141
verified: no, type: precision_at_100
value: 0.5539999999999999
verified: no, type: precision_at_1000
value: 0.08800000000000001
verified: no, type: precision_at_20
value: 1.8929999999999998
verified: no, type: precision_at_3
value: 7.156
verified: no, type: precision_at_5
value: 5.04
verified: no, type: recall_at_1
value: 12.546
verified: no, type: recall_at_10
value: 27.093
verified: no, type: recall_at_100
value: 47.325
verified: no, type: recall_at_1000
value: 72.965
verified: no, type: recall_at_20
value: 32.491
verified: no, type: recall_at_3
value: 19.122
verified: no, type: recall_at_5
value: 22.264999999999997
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackMathematicaRetrieval (default)
revision: 90fceea13679c63fe563ded68f3b6f06e50061de
split: test
type: mteb/cqadupstack-mathematica
metrics: type: main_score
value: 12.806000000000001
verified: no, type: map_at_1
value: 5.881
verified: no, type: map_at_10
value: 9.803
verified: no, type: map_at_100
value: 10.717
verified: no, type: map_at_1000
value: 10.816
verified: no, type: map_at_20
value: 10.244
verified: no, type: map_at_3
value: 8.163
verified: no, type: map_at_5
value: 8.956
verified: no, type: mrr_at_1
value: 7.462686567164178
verified: no, type: mrr_at_10
value: 12.077805417357661
verified: no, type: mrr_at_100
value: 12.966483256051529
verified: no, type: mrr_at_1000
value: 13.047246067329347
verified: no, type: mrr_at_20
value: 12.525499289049966
verified: no, type: mrr_at_3
value: 10.261194029850747
verified: no, type: mrr_at_5
value: 11.113184079601991
verified: no, type: ndcg_at_1
value: 7.463
verified: no, type: ndcg_at_10
value: 12.806000000000001
verified: no, type: ndcg_at_100
value: 17.807000000000002
verified: no, type: ndcg_at_1000
value: 20.979999999999997
verified: no, type: ndcg_at_20
value: 14.350999999999999
verified: no, type: ndcg_at_3
value: 9.468
verified: no, type: ndcg_at_5
value: 10.776
verified: no, type: precision_at_1
value: 7.463
verified: no, type: precision_at_10
value: 2.637
verified: no, type: precision_at_100
value: 0.613
verified: no, type: precision_at_1000
value: 0.101
verified: no, type: precision_at_20
value: 1.7229999999999999
verified: no, type: precision_at_3
value: 4.643
verified: no, type: precision_at_5
value: 3.6319999999999997
verified: no, type: recall_at_1
value: 5.881
verified: no, type: recall_at_10
value: 20.013
verified: no, type: recall_at_100
value: 42.92
verified: no, type: recall_at_1000
value: 66.943
verified: no, type: recall_at_20
value: 25.621
verified: no, type: recall_at_3
value: 10.768
verified: no, type: recall_at_5
value: 14.007
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackPhysicsRetrieval (default)
revision: 79531abbd1fb92d06c6d6315a0cbbbf5bb247ea4
split: test
type: mteb/cqadupstack-physics
metrics: type: main_score
value: 28.765
verified: no, type: map_at_1
value: 17.519000000000002
verified: no, type: map_at_10
value: 24.136
verified: no, type: map_at_100
value: 25.352999999999998
verified: no, type: map_at_1000
value: 25.499
verified: no, type: map_at_20
value: 24.776999999999997
verified: no, type: map_at_3
value: 21.59
verified: no, type: map_at_5
value: 23.017000000000003
verified: no, type: mrr_at_1
value: 21.36669874879692
verified: no, type: mrr_at_10
value: 28.47930702598651
verified: no, type: mrr_at_100
value: 29.504734721457147
verified: no, type: mrr_at_1000
value: 29.58610606296599
verified: no, type: mrr_at_20
value: 29.06239382160277
verified: no, type: mrr_at_3
value: 25.85819698427977
verified: no, type: mrr_at_5
value: 27.523259544433753
verified: no, type: ndcg_at_1
value: 21.367
verified: no, type: ndcg_at_10
value: 28.765
verified: no, type: ndcg_at_100
value: 34.772999999999996
verified: no, type: ndcg_at_1000
value: 37.924
verified: no, type: ndcg_at_20
value: 30.891999999999996
verified: no, type: ndcg_at_3
value: 24.248
verified: no, type: ndcg_at_5
value: 26.479999999999997
verified: no, type: precision_at_1
value: 21.367
verified: no, type: precision_at_10
value: 5.351
verified: no, type: precision_at_100
value: 0.989
verified: no, type: precision_at_1000
value: 0.147
verified: no, type: precision_at_20
value: 3.325
verified: no, type: precision_at_3
value: 11.325000000000001
verified: no, type: precision_at_5
value: 8.469999999999999
verified: no, type: recall_at_1
value: 17.519000000000002
verified: no, type: recall_at_10
value: 38.602
verified: no, type: recall_at_100
value: 65.377
verified: no, type: recall_at_1000
value: 86.812
verified: no, type: recall_at_20
value: 46.161
verified: no, type: recall_at_3
value: 25.898
verified: no, type: recall_at_5
value: 31.654
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackProgrammersRetrieval (default)
revision: 6184bc1440d2dbc7612be22b50686b8826d22b32
split: test
type: mteb/cqadupstack-programmers
metrics: type: main_score
value: 22.706
verified: no, type: map_at_1
value: 12.979
verified: no, type: map_at_10
value: 18.898
verified: no, type: map_at_100
value: 20.087
verified: no, type: map_at_1000
value: 20.223
verified: no, type: map_at_20
value: 19.516
verified: no, type: map_at_3
value: 16.955000000000002
verified: no, type: map_at_5
value: 18.043
verified: no, type: mrr_at_1
value: 15.639269406392694
verified: no, type: mrr_at_10
value: 22.00872472276581
verified: no, type: mrr_at_100
value: 23.052476310365996
verified: no, type: mrr_at_1000
value: 23.1408565851826
verified: no, type: mrr_at_20
value: 22.589418169993035
verified: no, type: mrr_at_3
value: 19.99619482496195
verified: no, type: mrr_at_5
value: 21.2062404870624
verified: no, type: ndcg_at_1
value: 15.639
verified: no, type: ndcg_at_10
value: 22.706
verified: no, type: ndcg_at_100
value: 28.477999999999998
verified: no, type: ndcg_at_1000
value: 31.756
verified: no, type: ndcg_at_20
value: 24.836
verified: no, type: ndcg_at_3
value: 19.049
verified: no, type: ndcg_at_5
value: 20.807000000000002
verified: no, type: precision_at_1
value: 15.639
verified: no, type: precision_at_10
value: 4.258
verified: no, type: precision_at_100
value: 0.865
verified: no, type: precision_at_1000
value: 0.133
verified: no, type: precision_at_20
value: 2.7969999999999997
verified: no, type: precision_at_3
value: 9.056000000000001
verified: no, type: precision_at_5
value: 6.758
verified: no, type: recall_at_1
value: 12.979
verified: no, type: recall_at_10
value: 31.16
verified: no, type: recall_at_100
value: 56.245
verified: no, type: recall_at_1000
value: 79.526
verified: no, type: recall_at_20
value: 38.696000000000005
verified: no, type: recall_at_3
value: 21.302
verified: no, type: recall_at_5
value: 25.615
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackRetrieval (default)
revision: CQADupstackRetrieval_is_a_combined_dataset
split: test
type: CQADupstackRetrieval_is_a_combined_dataset
metrics: type: main_score
value: 21.956083333333336
verified: no, type: ndcg_at_10
value: 21.956083333333336
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackStatsRetrieval (default)
revision: 65ac3a16b8e91f9cee4c9828cc7c335575432a2a
split: test
type: mteb/cqadupstack-stats
metrics: type: main_score
value: 17.395
verified: no, type: map_at_1
value: 10.088
verified: no, type: map_at_10
value: 14.539
verified: no, type: map_at_100
value: 15.362
verified: no, type: map_at_1000
value: 15.464
verified: no, type: map_at_20
value: 14.924000000000001
verified: no, type: map_at_3
value: 13.136999999999999
verified: no, type: map_at_5
value: 13.937
verified: no, type: mrr_at_1
value: 11.96319018404908
verified: no, type: mrr_at_10
value: 16.467767065926576
verified: no, type: mrr_at_100
value: 17.283614344094357
verified: no, type: mrr_at_1000
value: 17.375873381573232
verified: no, type: mrr_at_20
value: 16.854301079891787
verified: no, type: mrr_at_3
value: 15.08179959100204
verified: no, type: mrr_at_5
value: 15.848670756646216
verified: no, type: ndcg_at_1
value: 11.963
verified: no, type: ndcg_at_10
value: 17.395
verified: no, type: ndcg_at_100
value: 21.911
verified: no, type: ndcg_at_1000
value: 24.796000000000003
verified: no, type: ndcg_at_20
value: 18.773999999999997
verified: no, type: ndcg_at_3
value: 14.719
verified: no, type: ndcg_at_5
value: 16.032
verified: no, type: precision_at_1
value: 11.963
verified: no, type: precision_at_10
value: 2.96
verified: no, type: precision_at_100
value: 0.569
verified: no, type: precision_at_1000
value: 0.08800000000000001
verified: no, type: precision_at_20
value: 1.817
verified: no, type: precision_at_3
value: 6.748
verified: no, type: precision_at_5
value: 4.877
verified: no, type: recall_at_1
value: 10.088
verified: no, type: recall_at_10
value: 24.356
verified: no, type: recall_at_100
value: 45.73
verified: no, type: recall_at_1000
value: 67.577
verified: no, type: recall_at_20
value: 29.534
verified: no, type: recall_at_3
value: 16.944
verified: no, type: recall_at_5
value: 20.392
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackTexRetrieval (default)
revision: 46989137a86843e03a6195de44b09deda022eec7
split: test
type: mteb/cqadupstack-tex
metrics: type: main_score
value: 12.592999999999998
verified: no, type: map_at_1
value: 7.1290000000000004
verified: no, type: map_at_10
value: 10.302
verified: no, type: map_at_100
value: 10.994
verified: no, type: map_at_1000
value: 11.118
verified: no, type: map_at_20
value: 10.653
verified: no, type: map_at_3
value: 9.361
verified: no, type: map_at_5
value: 9.803
verified: no, type: mrr_at_1
value: 8.843771507226428
verified: no, type: mrr_at_10
value: 12.421700040419921
verified: no, type: mrr_at_100
value: 13.14928923530448
verified: no, type: mrr_at_1000
value: 13.252448388769883
verified: no, type: mrr_at_20
value: 12.803691756524197
verified: no, type: mrr_at_3
value: 11.344345033264513
verified: no, type: mrr_at_5
value: 11.824386327139244
verified: no, type: ndcg_at_1
value: 8.844000000000001
verified: no, type: ndcg_at_10
value: 12.592999999999998
verified: no, type: ndcg_at_100
value: 16.409000000000002
verified: no, type: ndcg_at_1000
value: 19.906
verified: no, type: ndcg_at_20
value: 13.831
verified: no, type: ndcg_at_3
value: 10.7
verified: no, type: ndcg_at_5
value: 11.359
verified: no, type: precision_at_1
value: 8.844000000000001
verified: no, type: precision_at_10
value: 2.33
verified: no, type: precision_at_100
value: 0.506
verified: no, type: precision_at_1000
value: 0.096
verified: no, type: precision_at_20
value: 1.512
verified: no, type: precision_at_3
value: 5.116
verified: no, type: precision_at_5
value: 3.599
verified: no, type: recall_at_1
value: 7.1290000000000004
verified: no, type: recall_at_10
value: 17.549999999999997
verified: no, type: recall_at_100
value: 35.393
verified: no, type: recall_at_1000
value: 61.23800000000001
verified: no, type: recall_at_20
value: 22.124
verified: no, type: recall_at_3
value: 12.109
verified: no, type: recall_at_5
value: 13.832
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackUnixRetrieval (default)
revision: 6c6430d3a6d36f8d2a829195bc5dc94d7e063e53
split: test
type: mteb/cqadupstack-unix
metrics: type: main_score
value: 19.111
verified: no, type: map_at_1
value: 12.577
verified: no, type: map_at_10
value: 16.275000000000002
verified: no, type: map_at_100
value: 17.083000000000002
verified: no, type: map_at_1000
value: 17.206
verified: no, type: map_at_20
value: 16.68
verified: no, type: map_at_3
value: 14.783
verified: no, type: map_at_5
value: 15.654000000000002
verified: no, type: mrr_at_1
value: 14.645522388059701
verified: no, type: mrr_at_10
value: 18.617404051172702
verified: no, type: mrr_at_100
value: 19.434952661619388
verified: no, type: mrr_at_1000
value: 19.536374825069274
verified: no, type: mrr_at_20
value: 19.039596975787966
verified: no, type: mrr_at_3
value: 16.977611940298516
verified: no, type: mrr_at_5
value: 17.938432835820894
verified: no, type: ndcg_at_1
value: 14.646
verified: no, type: ndcg_at_10
value: 19.111
verified: no, type: ndcg_at_100
value: 23.541999999999998
verified: no, type: ndcg_at_1000
value: 26.901999999999997
verified: no, type: ndcg_at_20
value: 20.593
verified: no, type: ndcg_at_3
value: 16.104
verified: no, type: ndcg_at_5
value: 17.577
verified: no, type: precision_at_1
value: 14.646
verified: no, type: precision_at_10
value: 3.237
verified: no, type: precision_at_100
value: 0.607
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 1.9869999999999999
verified: no, type: precision_at_3
value: 7.027
verified: no, type: precision_at_5
value: 5.187
verified: no, type: recall_at_1
value: 12.577
verified: no, type: recall_at_10
value: 25.642
verified: no, type: recall_at_100
value: 46.296
verified: no, type: recall_at_1000
value: 70.901
verified: no, type: recall_at_20
value: 31.202
verified: no, type: recall_at_3
value: 17.396
verified: no, type: recall_at_5
value: 21.046
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackWebmastersRetrieval (default)
revision: 160c094312a0e1facb97e55eeddb698c0abe3571
split: test
type: mteb/cqadupstack-webmasters
metrics: type: main_score
value: 22.359
verified: no, type: map_at_1
value: 14.202
verified: no, type: map_at_10
value: 18.528
verified: no, type: map_at_100
value: 19.649
verified: no, type: map_at_1000
value: 19.838
verified: no, type: map_at_20
value: 19.067
verified: no, type: map_at_3
value: 16.656000000000002
verified: no, type: map_at_5
value: 17.564
verified: no, type: mrr_at_1
value: 17.786561264822133
verified: no, type: mrr_at_10
value: 22.50015684798293
verified: no, type: mrr_at_100
value: 23.36103535586478
verified: no, type: mrr_at_1000
value: 23.447240155046412
verified: no, type: mrr_at_20
value: 22.897233666294404
verified: no, type: mrr_at_3
value: 20.685111989459813
verified: no, type: mrr_at_5
value: 21.58432147562582
verified: no, type: ndcg_at_1
value: 17.787
verified: no, type: ndcg_at_10
value: 22.359
verified: no, type: ndcg_at_100
value: 27.339999999999996
verified: no, type: ndcg_at_1000
value: 30.94
verified: no, type: ndcg_at_20
value: 23.915
verified: no, type: ndcg_at_3
value: 19.187
verified: no, type: ndcg_at_5
value: 20.415
verified: no, type: precision_at_1
value: 17.787
verified: no, type: precision_at_10
value: 4.348
verified: no, type: precision_at_100
value: 1.016
verified: no, type: precision_at_1000
value: 0.187
verified: no, type: precision_at_20
value: 2.826
verified: no, type: precision_at_3
value: 8.959
verified: no, type: precision_at_5
value: 6.601
verified: no, type: recall_at_1
value: 14.202
verified: no, type: recall_at_10
value: 29.507
verified: no, type: recall_at_100
value: 52.574
verified: no, type: recall_at_1000
value: 77.41799999999999
verified: no, type: recall_at_20
value: 35.733
verified: no, type: recall_at_3
value: 19.345000000000002
verified: no, type: recall_at_5
value: 22.99
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CQADupstackWordpressRetrieval (default)
revision: 4ffe81d471b1924886b33c7567bfb200e9eec5c4
split: test
type: mteb/cqadupstack-wordpress
metrics: type: main_score
value: 14.59
verified: no, type: map_at_1
value: 9.341000000000001
verified: no, type: map_at_10
value: 12.495000000000001
verified: no, type: map_at_100
value: 13.328000000000001
verified: no, type: map_at_1000
value: 13.443
verified: no, type: map_at_20
value: 12.919
verified: no, type: map_at_3
value: 11.448
verified: no, type: map_at_5
value: 12.016
verified: no, type: mrr_at_1
value: 10.536044362292053
verified: no, type: mrr_at_10
value: 13.933045799958926
verified: no, type: mrr_at_100
value: 14.753327128738034
verified: no, type: mrr_at_1000
value: 14.84798752653836
verified: no, type: mrr_at_20
value: 14.348175993628182
verified: no, type: mrr_at_3
value: 12.6309303758472
verified: no, type: mrr_at_5
value: 13.28712261244609
verified: no, type: ndcg_at_1
value: 10.536
verified: no, type: ndcg_at_10
value: 14.59
verified: no, type: ndcg_at_100
value: 19.322
verified: no, type: ndcg_at_1000
value: 22.735
verified: no, type: ndcg_at_20
value: 16.072
verified: no, type: ndcg_at_3
value: 12.36
verified: no, type: ndcg_at_5
value: 13.364999999999998
verified: no, type: precision_at_1
value: 10.536
verified: no, type: precision_at_10
value: 2.311
verified: no, type: precision_at_100
value: 0.508
verified: no, type: precision_at_1000
value: 0.086
verified: no, type: precision_at_20
value: 1.488
verified: no, type: precision_at_3
value: 5.176
verified: no, type: precision_at_5
value: 3.66
verified: no, type: recall_at_1
value: 9.341000000000001
verified: no, type: recall_at_10
value: 19.707
verified: no, type: recall_at_100
value: 42.89
verified: no, type: recall_at_1000
value: 69.447
verified: no, type: recall_at_20
value: 25.330000000000002
verified: no, type: recall_at_3
value: 13.814000000000002
verified: no, type: recall_at_5
value: 16.217000000000002
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB ClimateFEVER (default)
revision: 47f2ac6acb640fc46020b02a5b59fdda04d39380
split: test
type: mteb/climate-fever
metrics: type: main_score
value: 20.433
verified: no, type: map_at_1
value: 7.469
verified: no, type: map_at_10
value: 13.536999999999999
verified: no, type: map_at_100
value: 15.222
verified: no, type: map_at_1000
value: 15.424
verified: no, type: map_at_20
value: 14.41
verified: no, type: map_at_3
value: 10.911999999999999
verified: no, type: map_at_5
value: 12.232
verified: no, type: mrr_at_1
value: 17.133550488599347
verified: no, type: mrr_at_10
value: 27.41355152267201
verified: no, type: mrr_at_100
value: 28.50611626391541
verified: no, type: mrr_at_1000
value: 28.568789326404005
verified: no, type: mrr_at_20
value: 28.08885051017031
verified: no, type: mrr_at_3
value: 23.724212812160687
verified: no, type: mrr_at_5
value: 25.8707926167209
verified: no, type: ndcg_at_1
value: 17.134
verified: no, type: ndcg_at_10
value: 20.433
verified: no, type: ndcg_at_100
value: 27.783
verified: no, type: ndcg_at_1000
value: 31.787
verified: no, type: ndcg_at_20
value: 23.108999999999998
verified: no, type: ndcg_at_3
value: 15.565999999999999
verified: no, type: ndcg_at_5
value: 17.354
verified: no, type: precision_at_1
value: 17.134
verified: no, type: precision_at_10
value: 6.866
verified: no, type: precision_at_100
value: 1.47
verified: no, type: precision_at_1000
value: 0.22100000000000003
verified: no, type: precision_at_20
value: 4.531000000000001
verified: no, type: precision_at_3
value: 11.965
verified: no, type: precision_at_5
value: 9.707
verified: no, type: recall_at_1
value: 7.469
verified: no, type: recall_at_10
value: 26.285999999999998
verified: no, type: recall_at_100
value: 52.376999999999995
verified: no, type: recall_at_1000
value: 75.261
verified: no, type: recall_at_20
value: 34.035
verified: no, type: recall_at_3
value: 14.526
verified: no, type: recall_at_5
value: 19.306
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB ClimateFEVERHardNegatives (default)
revision: 3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
split: test
type: mteb/ClimateFEVER_test_top_250_only_w_correct-v2
metrics: type: main_score
value: 22.605
verified: no, type: map_at_1
value: 8.6
verified: no, type: map_at_10
value: 15.281
verified: no, type: map_at_100
value: 17.282
verified: no, type: map_at_1000
value: 17.522
verified: no, type: map_at_20
value: 16.339000000000002
verified: no, type: map_at_3
value: 12.429
verified: no, type: map_at_5
value: 13.922
verified: no, type: mrr_at_1
value: 18.5
verified: no, type: mrr_at_10
value: 29.625952380952388
verified: no, type: mrr_at_100
value: 30.77892068089231
verified: no, type: mrr_at_1000
value: 30.83853566495065
verified: no, type: mrr_at_20
value: 30.3662752048433
verified: no, type: mrr_at_3
value: 25.833333333333357
verified: no, type: mrr_at_5
value: 27.89333333333332
verified: no, type: ndcg_at_1
value: 18.5
verified: no, type: ndcg_at_10
value: 22.605
verified: no, type: ndcg_at_100
value: 31.097
verified: no, type: ndcg_at_1000
value: 35.576
verified: no, type: ndcg_at_20
value: 25.775
verified: no, type: ndcg_at_3
value: 17.43
verified: no, type: ndcg_at_5
value: 19.368
verified: no, type: precision_at_1
value: 18.5
verified: no, type: precision_at_10
value: 7.46
verified: no, type: precision_at_100
value: 1.6580000000000001
verified: no, type: precision_at_1000
value: 0.25
verified: no, type: precision_at_20
value: 5.06
verified: no, type: precision_at_3
value: 13.433
verified: no, type: precision_at_5
value: 10.74
verified: no, type: recall_at_1
value: 8.6
verified: no, type: recall_at_10
value: 28.882
verified: no, type: recall_at_100
value: 58.998
verified: no, type: recall_at_1000
value: 84.243
verified: no, type: recall_at_20
value: 37.957
verified: no, type: recall_at_3
value: 16.55
verified: no, type: recall_at_5
value: 21.648
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CodeFeedbackMT (default)
revision: b0f12fa0c0dd67f59c95a5c33d02aeeb4c398c5f
split: test
type: CoIR-Retrieval/codefeedback-mt
metrics: type: main_score
value: 46.045
verified: no, type: map_at_1
value: 38.412
verified: no, type: map_at_10
value: 43.41
verified: no, type: map_at_100
value: 43.976
verified: no, type: map_at_1000
value: 44.037
verified: no, type: map_at_20
value: 43.736000000000004
verified: no, type: map_at_3
value: 42.055
verified: no, type: map_at_5
value: 42.829
verified: no, type: mrr_at_1
value: 38.41229193341869
verified: no, type: mrr_at_10
value: 43.40960498582686
verified: no, type: mrr_at_100
value: 43.97561445897139
verified: no, type: mrr_at_1000
value: 44.03658359938551
verified: no, type: mrr_at_20
value: 43.73609592536922
verified: no, type: mrr_at_3
value: 42.05518314880356
verified: no, type: mrr_at_5
value: 42.828701262835196
verified: no, type: ndcg_at_1
value: 38.412
verified: no, type: ndcg_at_10
value: 46.045
verified: no, type: ndcg_at_100
value: 49.061
verified: no, type: ndcg_at_1000
value: 50.941
verified: no, type: ndcg_at_20
value: 47.245
verified: no, type: ndcg_at_3
value: 43.245
verified: no, type: ndcg_at_5
value: 44.639
verified: no, type: precision_at_1
value: 38.412
verified: no, type: precision_at_10
value: 5.442
verified: no, type: precision_at_100
value: 0.6910000000000001
verified: no, type: precision_at_1000
value: 0.08499999999999999
verified: no, type: precision_at_20
value: 2.959
verified: no, type: precision_at_3
value: 15.562999999999999
verified: no, type: precision_at_5
value: 10.014000000000001
verified: no, type: recall_at_1
value: 38.412
verified: no, type: recall_at_10
value: 54.417
verified: no, type: recall_at_100
value: 69.15
verified: no, type: recall_at_1000
value: 84.515
verified: no, type: recall_at_20
value: 59.185
verified: no, type: recall_at_3
value: 46.69
verified: no, type: recall_at_5
value: 50.072
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CodeFeedbackST (default)
revision: d213819e87aab9010628da8b73ab4eb337c89340
split: test
type: CoIR-Retrieval/codefeedback-st
metrics: type: main_score
value: 45.592
verified: no, type: map_at_1
value: 34.54
verified: no, type: map_at_10
value: 41.855
verified: no, type: map_at_100
value: 42.528
verified: no, type: map_at_1000
value: 42.587
verified: no, type: map_at_20
value: 42.239
verified: no, type: map_at_3
value: 39.985
verified: no, type: map_at_5
value: 41.075
verified: no, type: mrr_at_1
value: 34.42151664217722
verified: no, type: mrr_at_10
value: 41.78311069737728
verified: no, type: mrr_at_100
value: 42.45614518998771
verified: no, type: mrr_at_1000
value: 42.51517890438335
verified: no, type: mrr_at_20
value: 42.16798542795404
verified: no, type: mrr_at_3
value: 39.90715304840442
verified: no, type: mrr_at_5
value: 41.00055367448295
verified: no, type: ndcg_at_1
value: 34.54
verified: no, type: ndcg_at_10
value: 45.592
verified: no, type: ndcg_at_100
value: 49.13
verified: no, type: ndcg_at_1000
value: 50.885999999999996
verified: no, type: ndcg_at_20
value: 46.989999999999995
verified: no, type: ndcg_at_3
value: 41.754000000000005
verified: no, type: ndcg_at_5
value: 43.714999999999996
verified: no, type: precision_at_1
value: 34.54
verified: no, type: precision_at_10
value: 5.74
verified: no, type: precision_at_100
value: 0.746
verified: no, type: precision_at_1000
value: 0.089
verified: no, type: precision_at_20
value: 3.1460000000000004
verified: no, type: precision_at_3
value: 15.623999999999999
verified: no, type: precision_at_5
value: 10.325
verified: no, type: recall_at_1
value: 34.54
verified: no, type: recall_at_10
value: 57.403999999999996
verified: no, type: recall_at_100
value: 74.577
verified: no, type: recall_at_1000
value: 88.801
verified: no, type: recall_at_20
value: 62.927
verified: no, type: recall_at_3
value: 46.873
verified: no, type: recall_at_5
value: 51.623
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB CosQA (default)
revision: bc5efb7e9d437246ce393ed19d772e08e4a79535
split: test
type: CoIR-Retrieval/cosqa
metrics: type: main_score
value: 7.939
verified: no, type: map_at_1
value: 3.2
verified: no, type: map_at_10
value: 6.1240000000000006
verified: no, type: map_at_100
value: 6.961
verified: no, type: map_at_1000
value: 7.124
verified: no, type: map_at_20
value: 6.494
verified: no, type: map_at_3
value: 5.033
verified: no, type: map_at_5
value: 5.623
verified: no, type: mrr_at_1
value: 3.2
verified: no, type: mrr_at_10
value: 5.470238095238093
verified: no, type: mrr_at_100
value: 6.320663781727482
verified: no, type: mrr_at_1000
value: 6.484552484927204
verified: no, type: mrr_at_20
value: 5.840692146690597
verified: no, type: mrr_at_3
value: 4.3999999999999995
verified: no, type: mrr_at_5
value: 4.919999999999999
verified: no, type: ndcg_at_1
value: 3.2
verified: no, type: ndcg_at_10
value: 7.939
verified: no, type: ndcg_at_100
value: 12.909
verified: no, type: ndcg_at_1000
value: 17.705000000000002
verified: no, type: ndcg_at_20
value: 9.266
verified: no, type: ndcg_at_3
value: 5.688
verified: no, type: ndcg_at_5
value: 6.755
verified: no, type: precision_at_1
value: 3.2
verified: no, type: precision_at_10
value: 1.38
verified: no, type: precision_at_100
value: 0.392
verified: no, type: precision_at_1000
value: 0.078
verified: no, type: precision_at_20
value: 0.95
verified: no, type: precision_at_3
value: 2.533
verified: no, type: precision_at_5
value: 2.04
verified: no, type: recall_at_1
value: 3.2
verified: no, type: recall_at_10
value: 13.8
verified: no, type: recall_at_100
value: 39.2
verified: no, type: recall_at_1000
value: 78
verified: no, type: recall_at_20
value: 19
verified: no, type: recall_at_3
value: 7.6
verified: no, type: recall_at_5
value: 10.2
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB DBPedia (default)
revision: c0f706b76e590d620bd6618b3ca8efdd34e2d659
split: dev
type: mteb/dbpedia
metrics: type: main_score
value: 29.817
verified: no, type: map_at_1
value: 6.151
verified: no, type: map_at_10
value: 12.292
verified: no, type: map_at_100
value: 18.139
verified: no, type: map_at_1000
value: 19.84
verified: no, type: map_at_20
value: 14.495
verified: no, type: map_at_3
value: 8.426
verified: no, type: map_at_5
value: 10.192
verified: no, type: mrr_at_1
value: 46.26865671641791
verified: no, type: mrr_at_10
value: 57.92466240227434
verified: no, type: mrr_at_100
value: 58.67349319471301
verified: no, type: mrr_at_1000
value: 58.68212283999546
verified: no, type: mrr_at_20
value: 58.47241542478595
verified: no, type: mrr_at_3
value: 54.726368159203986
verified: no, type: mrr_at_5
value: 57.33830845771145
verified: no, type: ndcg_at_1
value: 38.06
verified: no, type: ndcg_at_10
value: 29.817
verified: no, type: ndcg_at_100
value: 36.472
verified: no, type: ndcg_at_1000
value: 45.576
verified: no, type: ndcg_at_20
value: 30.009000000000004
verified: no, type: ndcg_at_3
value: 32.839
verified: no, type: ndcg_at_5
value: 32.301
verified: no, type: precision_at_1
value: 46.269
verified: no, type: precision_at_10
value: 25.820999999999998
verified: no, type: precision_at_100
value: 8.552
verified: no, type: precision_at_1000
value: 1.576
verified: no, type: precision_at_20
value: 20.075000000000003
verified: no, type: precision_at_3
value: 35.821
verified: no, type: precision_at_5
value: 34.327999999999996
verified: no, type: recall_at_1
value: 6.151
verified: no, type: recall_at_10
value: 16.838
verified: no, type: recall_at_100
value: 48.427
verified: no, type: recall_at_1000
value: 77.018
verified: no, type: recall_at_20
value: 26.147
verified: no, type: recall_at_3
value: 9.221
verified: no, type: recall_at_5
value: 12.453
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB DBPedia (default)
revision: c0f706b76e590d620bd6618b3ca8efdd34e2d659
split: test
type: mteb/dbpedia
metrics: type: main_score
value: 27.377000000000002
verified: no, type: map_at_1
value: 5.527
verified: no, type: map_at_10
value: 12.384
verified: no, type: map_at_100
value: 17.660999999999998
verified: no, type: map_at_1000
value: 18.98
verified: no, type: map_at_20
value: 14.424999999999999
verified: no, type: map_at_3
value: 8.484
verified: no, type: map_at_5
value: 10.174
verified: no, type: mrr_at_1
value: 44.25
verified: no, type: mrr_at_10
value: 55.620238095238086
verified: no, type: mrr_at_100
value: 56.311713506324445
verified: no, type: mrr_at_1000
value: 56.33739917164095
verified: no, type: mrr_at_20
value: 56.11873017655717
verified: no, type: mrr_at_3
value: 52.95833333333334
verified: no, type: mrr_at_5
value: 54.595833333333324
verified: no, type: ndcg_at_1
value: 31.75
verified: no, type: ndcg_at_10
value: 27.377000000000002
verified: no, type: ndcg_at_100
value: 32.164
verified: no, type: ndcg_at_1000
value: 40.050000000000004
verified: no, type: ndcg_at_20
value: 27.424
verified: no, type: ndcg_at_3
value: 28.683999999999997
verified: no, type: ndcg_at_5
value: 28.283
verified: no, type: precision_at_1
value: 44.25
verified: no, type: precision_at_10
value: 24.45
verified: no, type: precision_at_100
value: 7.704999999999999
verified: no, type: precision_at_1000
value: 1.5970000000000002
verified: no, type: precision_at_20
value: 18.462
verified: no, type: precision_at_3
value: 35.167
verified: no, type: precision_at_5
value: 30.95
verified: no, type: recall_at_1
value: 5.527
verified: no, type: recall_at_10
value: 18.016
verified: no, type: recall_at_100
value: 41.656
verified: no, type: recall_at_1000
value: 67.38300000000001
verified: no, type: recall_at_20
value: 24.21
verified: no, type: recall_at_3
value: 9.936
verified: no, type: recall_at_5
value: 13.187999999999999
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB DBPediaHardNegatives (default)
revision: 943ec7fdfef3728b2ad1966c5b6479ff9ffd26c9
split: test
type: mteb/DBPedia_test_top_250_only_w_correct-v2
metrics: type: main_score
value: 30.444
verified: no, type: map_at_1
value: 5.722
verified: no, type: map_at_10
value: 13.688
verified: no, type: map_at_100
value: 22.032
verified: no, type: map_at_1000
value: 25.386999999999997
verified: no, type: map_at_20
value: 16.307
verified: no, type: map_at_3
value: 9.008
verified: no, type: map_at_5
value: 11.056000000000001
verified: no, type: mrr_at_1
value: 47
verified: no, type: mrr_at_10
value: 59.097420634920624
verified: no, type: mrr_at_100
value: 59.821938296328106
verified: no, type: mrr_at_1000
value: 59.83760663887243
verified: no, type: mrr_at_20
value: 59.59489258161859
verified: no, type: mrr_at_3
value: 56.458333333333336
verified: no, type: mrr_at_5
value: 58.18333333333333
verified: no, type: ndcg_at_1
value: 33.5
verified: no, type: ndcg_at_10
value: 30.444
verified: no, type: ndcg_at_100
value: 40.474
verified: no, type: ndcg_at_1000
value: 51.964
verified: no, type: ndcg_at_20
value: 31.356
verified: no, type: ndcg_at_3
value: 30.772
verified: no, type: ndcg_at_5
value: 30.576999999999998
verified: no, type: precision_at_1
value: 47
verified: no, type: precision_at_10
value: 27.975
verified: no, type: precision_at_100
value: 12.055
verified: no, type: precision_at_1000
value: 2.9579999999999997
verified: no, type: precision_at_20
value: 22.275
verified: no, type: precision_at_3
value: 38.083
verified: no, type: precision_at_5
value: 33.75
verified: no, type: recall_at_1
value: 5.722
verified: no, type: recall_at_10
value: 20.571
verified: no, type: recall_at_100
value: 55.967999999999996
verified: no, type: recall_at_1000
value: 91.362
verified: no, type: recall_at_20
value: 28.526
verified: no, type: recall_at_3
value: 10.761999999999999
verified: no, type: recall_at_5
value: 14.854999999999999
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB FEVER (default)
revision: bea83ef9e8fb933d90a2f1d5515737465d613e12
split: test
type: mteb/fever
metrics: type: main_score
value: 42.997
verified: no, type: map_at_1
value: 22.017
verified: no, type: map_at_10
value: 35.199000000000005
verified: no, type: map_at_100
value: 36.254999999999995
verified: no, type: map_at_1000
value: 36.298
verified: no, type: map_at_20
value: 35.855
verified: no, type: map_at_3
value: 31.072
verified: no, type: map_at_5
value: 33.461
verified: no, type: mrr_at_1
value: 23.582358235823584
verified: no, type: mrr_at_10
value: 37.35784888012616
verified: no, type: mrr_at_100
value: 38.36344206815839
verified: no, type: mrr_at_1000
value: 38.39238175644681
verified: no, type: mrr_at_20
value: 38.01212529885376
verified: no, type: mrr_at_3
value: 33.098309830982956
verified: no, type: mrr_at_5
value: 35.579557955795615
verified: no, type: ndcg_at_1
value: 23.582
verified: no, type: ndcg_at_10
value: 42.997
verified: no, type: ndcg_at_100
value: 47.979
verified: no, type: ndcg_at_1000
value: 48.994
verified: no, type: ndcg_at_20
value: 45.35
verified: no, type: ndcg_at_3
value: 34.579
verified: no, type: ndcg_at_5
value: 38.851
verified: no, type: precision_at_1
value: 23.582
verified: no, type: precision_at_10
value: 7.1290000000000004
verified: no, type: precision_at_100
value: 0.9820000000000001
verified: no, type: precision_at_1000
value: 0.109
verified: no, type: precision_at_20
value: 4.0840000000000005
verified: no, type: precision_at_3
value: 15.342
verified: no, type: precision_at_5
value: 11.479000000000001
verified: no, type: recall_at_1
value: 22.017
verified: no, type: recall_at_10
value: 65.354
verified: no, type: recall_at_100
value: 87.75800000000001
verified: no, type: recall_at_1000
value: 95.212
verified: no, type: recall_at_20
value: 74.38
verified: no, type: recall_at_3
value: 42.581
verified: no, type: recall_at_5
value: 52.844
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB FEVERHardNegatives (default)
revision: 080c9ed6267b65029207906e815d44a9240bafca
split: test
type: mteb/FEVER_test_top_250_only_w_correct-v2
metrics: type: main_score
value: 46.277
verified: no, type: map_at_1
value: 23.945
verified: no, type: map_at_10
value: 37.564
verified: no, type: map_at_100
value: 38.562000000000005
verified: no, type: map_at_1000
value: 38.602
verified: no, type: map_at_20
value: 38.173
verified: no, type: map_at_3
value: 32.208999999999996
verified: no, type: map_at_5
value: 35.538
verified: no, type: mrr_at_1
value: 25.5
verified: no, type: mrr_at_10
value: 39.60134920634916
verified: no, type: mrr_at_100
value: 40.523753358000675
verified: no, type: mrr_at_1000
value: 40.53762691263701
verified: no, type: mrr_at_20
value: 40.19828779622504
verified: no, type: mrr_at_3
value: 34.14999999999997
verified: no, type: mrr_at_5
value: 37.579999999999934
verified: no, type: ndcg_at_1
value: 25.5
verified: no, type: ndcg_at_10
value: 46.277
verified: no, type: ndcg_at_100
value: 51.07000000000001
verified: no, type: ndcg_at_1000
value: 51.783
verified: no, type: ndcg_at_20
value: 48.473
verified: no, type: ndcg_at_3
value: 35.497
verified: no, type: ndcg_at_5
value: 41.467
verified: no, type: precision_at_1
value: 25.5
verified: no, type: precision_at_10
value: 7.76
verified: no, type: precision_at_100
value: 1.036
verified: no, type: precision_at_1000
value: 0.11299999999999999
verified: no, type: precision_at_20
value: 4.3549999999999995
verified: no, type: precision_at_3
value: 15.367
verified: no, type: precision_at_5
value: 12.280000000000001
verified: no, type: recall_at_1
value: 23.945
verified: no, type: recall_at_10
value: 71.967
verified: no, type: recall_at_100
value: 93.765
verified: no, type: recall_at_1000
value: 98.47
verified: no, type: recall_at_20
value: 80.497
verified: no, type: recall_at_3
value: 43.033
verified: no, type: recall_at_5
value: 57.447
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB FaithDial (default)
revision: 7a414e80725eac766f2602676dc8b39f80b061e4
split: test
type: McGill-NLP/FaithDial
metrics: type: main_score
value: 20.793
verified: no, type: map_at_1
value: 5.779
verified: no, type: map_at_10
value: 14.64
verified: no, type: map_at_100
value: 16.412
verified: no, type: map_at_1000
value: 16.478
verified: no, type: map_at_20
value: 15.638
verified: no, type: map_at_3
value: 10.545
verified: no, type: map_at_5
value: 12.82
verified: no, type: mrr_at_1
value: 5.093046033300686
verified: no, type: mrr_at_10
value: 14.511255693919727
verified: no, type: mrr_at_100
value: 16.266082070705043
verified: no, type: mrr_at_1000
value: 16.333152055297443
verified: no, type: mrr_at_20
value: 15.49481390088696
verified: no, type: mrr_at_3
value: 10.381978452497567
verified: no, type: mrr_at_5
value: 12.74975514201763
verified: no, type: ndcg_at_1
value: 5.779
verified: no, type: ndcg_at_10
value: 20.793
verified: no, type: ndcg_at_100
value: 30.137000000000004
verified: no, type: ndcg_at_1000
value: 31.706
verified: no, type: ndcg_at_20
value: 24.431
verified: no, type: ndcg_at_3
value: 12.264
verified: no, type: ndcg_at_5
value: 16.35
verified: no, type: precision_at_1
value: 5.779
verified: no, type: precision_at_10
value: 4.099
verified: no, type: precision_at_100
value: 0.8630000000000001
verified: no, type: precision_at_1000
value: 0.098
verified: no, type: precision_at_20
value: 2.769
verified: no, type: precision_at_3
value: 5.762
verified: no, type: precision_at_5
value: 5.436
verified: no, type: recall_at_1
value: 5.779
verified: no, type: recall_at_10
value: 40.989
verified: no, type: recall_at_100
value: 86.337
verified: no, type: recall_at_1000
value: 98.335
verified: no, type: recall_at_20
value: 55.387
verified: no, type: recall_at_3
value: 17.287
verified: no, type: recall_at_5
value: 27.179
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB FeedbackQARetrieval (default)
revision: 1ee1cd0
split: test
type: lt2c/fqa
metrics: type: main_score
value: 27.159
verified: no, type: map_at_1
value: 27.159
verified: no, type: map_at_10
value: 36.533
verified: no, type: map_at_100
value: 37.653999999999996
verified: no, type: map_at_1000
value: 37.719
verified: no, type: map_at_20
value: 37.19
verified: no, type: map_at_3
value: 33.650999999999996
verified: no, type: map_at_5
value: 35.338
verified: no, type: mrr_at_1
value: 27.158634538152608
verified: no, type: mrr_at_10
value: 36.53293730477466
verified: no, type: mrr_at_100
value: 37.65359357224721
verified: no, type: mrr_at_1000
value: 37.71854110065475
verified: no, type: mrr_at_20
value: 37.18989930977979
verified: no, type: mrr_at_3
value: 33.65127175368139
verified: no, type: mrr_at_5
value: 35.33801874163323
verified: no, type: ndcg_at_1
value: 27.159
verified: no, type: ndcg_at_10
value: 41.756
verified: no, type: ndcg_at_100
value: 47.424
verified: no, type: ndcg_at_1000
value: 49.128
verified: no, type: ndcg_at_20
value: 44.111
verified: no, type: ndcg_at_3
value: 35.798
verified: no, type: ndcg_at_5
value: 38.827
verified: no, type: precision_at_1
value: 27.159
verified: no, type: precision_at_10
value: 5.848
verified: no, type: precision_at_100
value: 0.855
verified: no, type: precision_at_1000
value: 0.099
verified: no, type: precision_at_20
value: 3.386
verified: no, type: precision_at_3
value: 14.005999999999998
verified: no, type: precision_at_5
value: 9.869
verified: no, type: recall_at_1
value: 27.159
verified: no, type: recall_at_10
value: 58.484
verified: no, type: recall_at_100
value: 85.492
verified: no, type: recall_at_1000
value: 98.845
verified: no, type: recall_at_20
value: 67.721
verified: no, type: recall_at_3
value: 42.018
verified: no, type: recall_at_5
value: 49.347
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB FiQA2018 (default)
revision: 27a168819829fe9bcd655c2df245fb19452e8e06
split: dev
type: mteb/fiqa
metrics: type: main_score
value: 19.159000000000002
verified: no, type: map_at_1
value: 9.577
verified: no, type: map_at_10
value: 14.629
verified: no, type: map_at_100
value: 15.926000000000002
verified: no, type: map_at_1000
value: 16.099
verified: no, type: map_at_20
value: 15.204
verified: no, type: map_at_3
value: 12.788
verified: no, type: map_at_5
value: 13.821
verified: no, type: mrr_at_1
value: 16.2
verified: no, type: mrr_at_10
value: 22.73920634920635
verified: no, type: mrr_at_100
value: 23.811442879807622
verified: no, type: mrr_at_1000
value: 23.904303078394555
verified: no, type: mrr_at_20
value: 23.37503016505339
verified: no, type: mrr_at_3
value: 20.733333333333327
verified: no, type: mrr_at_5
value: 21.873333333333328
verified: no, type: ndcg_at_1
value: 16.2
verified: no, type: ndcg_at_10
value: 19.159000000000002
verified: no, type: ndcg_at_100
value: 25.229000000000003
verified: no, type: ndcg_at_1000
value: 29.294999999999998
verified: no, type: ndcg_at_20
value: 21.109
verified: no, type: ndcg_at_3
value: 16.481
verified: no, type: ndcg_at_5
value: 17.488999999999997
verified: no, type: precision_at_1
value: 16.2
verified: no, type: precision_at_10
value: 5.04
verified: no, type: precision_at_100
value: 1.124
verified: no, type: precision_at_1000
value: 0.179
verified: no, type: precision_at_20
value: 3.34
verified: no, type: precision_at_3
value: 10.133000000000001
verified: no, type: precision_at_5
value: 7.76
verified: no, type: recall_at_1
value: 9.577
verified: no, type: recall_at_10
value: 24.362000000000002
verified: no, type: recall_at_100
value: 48.222
verified: no, type: recall_at_1000
value: 74.358
verified: no, type: recall_at_20
value: 30.465999999999998
verified: no, type: recall_at_3
value: 16.057
verified: no, type: recall_at_5
value: 19.516
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB FiQA2018 (default)
revision: 27a168819829fe9bcd655c2df245fb19452e8e06
split: test
type: mteb/fiqa
metrics: type: main_score
value: 19.986
verified: no, type: map_at_1
value: 9.157
verified: no, type: map_at_10
value: 14.877
verified: no, type: map_at_100
value: 16.185
verified: no, type: map_at_1000
value: 16.366
verified: no, type: map_at_20
value: 15.551
verified: no, type: map_at_3
value: 12.574
verified: no, type: map_at_5
value: 13.694999999999999
verified: no, type: mrr_at_1
value: 16.51234567901235
verified: no, type: mrr_at_10
value: 23.66169410150891
verified: no, type: mrr_at_100
value: 24.6092001023614
verified: no, type: mrr_at_1000
value: 24.695544929151346
verified: no, type: mrr_at_20
value: 24.17998019538123
verified: no, type: mrr_at_3
value: 20.98765432098765
verified: no, type: mrr_at_5
value: 22.32253086419753
verified: no, type: ndcg_at_1
value: 16.512
verified: no, type: ndcg_at_10
value: 19.986
verified: no, type: ndcg_at_100
value: 25.840999999999998
verified: no, type: ndcg_at_1000
value: 29.999
verified: no, type: ndcg_at_20
value: 22.047
verified: no, type: ndcg_at_3
value: 16.401
verified: no, type: ndcg_at_5
value: 17.552
verified: no, type: precision_at_1
value: 16.512
verified: no, type: precision_at_10
value: 5.602
verified: no, type: precision_at_100
value: 1.171
verified: no, type: precision_at_1000
value: 0.19
verified: no, type: precision_at_20
value: 3.588
verified: no, type: precision_at_3
value: 10.545
verified: no, type: precision_at_5
value: 8.025
verified: no, type: recall_at_1
value: 9.157
verified: no, type: recall_at_10
value: 26.253999999999998
verified: no, type: recall_at_100
value: 48.175000000000004
verified: no, type: recall_at_1000
value: 74.236
verified: no, type: recall_at_20
value: 32.786
verified: no, type: recall_at_3
value: 15.631999999999998
verified: no, type: recall_at_5
value: 19.608
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB FiQA2018 (default)
revision: 27a168819829fe9bcd655c2df245fb19452e8e06
split: train
type: mteb/fiqa
metrics: type: main_score
value: 17.858
verified: no, type: map_at_1
value: 8.012
verified: no, type: map_at_10
value: 13.209000000000001
verified: no, type: map_at_100
value: 14.477
verified: no, type: map_at_1000
value: 14.671000000000001
verified: no, type: map_at_20
value: 13.864
verified: no, type: map_at_3
value: 11.218
verified: no, type: map_at_5
value: 12.239
verified: no, type: mrr_at_1
value: 15.363636363636363
verified: no, type: mrr_at_10
value: 21.62342712842711
verified: no, type: mrr_at_100
value: 22.63936235019517
verified: no, type: mrr_at_1000
value: 22.735838806851703
verified: no, type: mrr_at_20
value: 22.175914005467874
verified: no, type: mrr_at_3
value: 19.448484848484895
verified: no, type: mrr_at_5
value: 20.589393939394007
verified: no, type: ndcg_at_1
value: 15.364
verified: no, type: ndcg_at_10
value: 17.858
verified: no, type: ndcg_at_100
value: 23.794999999999998
verified: no, type: ndcg_at_1000
value: 28.17
verified: no, type: ndcg_at_20
value: 19.901
verified: no, type: ndcg_at_3
value: 14.888000000000002
verified: no, type: ndcg_at_5
value: 15.926000000000002
verified: no, type: precision_at_1
value: 15.364
verified: no, type: precision_at_10
value: 5.024
verified: no, type: precision_at_100
value: 1.087
verified: no, type: precision_at_1000
value: 0.184
verified: no, type: precision_at_20
value: 3.293
verified: no, type: precision_at_3
value: 9.751999999999999
verified: no, type: precision_at_5
value: 7.465
verified: no, type: recall_at_1
value: 8.012
verified: no, type: recall_at_10
value: 23.233999999999998
verified: no, type: recall_at_100
value: 46.623999999999995
verified: no, type: recall_at_1000
value: 74.092
verified: no, type: recall_at_20
value: 29.854000000000003
verified: no, type: recall_at_3
value: 14.216000000000001
verified: no, type: recall_at_5
value: 17.713
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB HellaSwag (default)
revision: a5c990205e017d10761197ccab3000936689c3ae
split: test
type: RAR-b/hellaswag
metrics: type: main_score
value: 16.377
verified: no, type: map_at_1
value: 8.474
verified: no, type: map_at_10
value: 13.479
verified: no, type: map_at_100
value: 14.296000000000001
verified: no, type: map_at_1000
value: 14.393
verified: no, type: map_at_20
value: 13.905000000000001
verified: no, type: map_at_3
value: 11.878
verified: no, type: map_at_5
value: 12.733
verified: no, type: mrr_at_1
value: 8.474407488548099
verified: no, type: mrr_at_10
value: 13.47926012335491
verified: no, type: mrr_at_100
value: 14.296018190032331
verified: no, type: mrr_at_1000
value: 14.39320635735857
verified: no, type: mrr_at_20
value: 13.905283977590932
verified: no, type: mrr_at_3
value: 11.878443869083188
verified: no, type: mrr_at_5
value: 12.733353249684685
verified: no, type: ndcg_at_1
value: 8.474
verified: no, type: ndcg_at_10
value: 16.377
verified: no, type: ndcg_at_100
value: 20.878
verified: no, type: ndcg_at_1000
value: 23.878
verified: no, type: ndcg_at_20
value: 17.93
verified: no, type: ndcg_at_3
value: 13.014999999999999
verified: no, type: ndcg_at_5
value: 14.557999999999998
verified: no, type: precision_at_1
value: 8.474
verified: no, type: precision_at_10
value: 2.571
verified: no, type: precision_at_100
value: 0.48
verified: no, type: precision_at_1000
value: 0.073
verified: no, type: precision_at_20
value: 1.593
verified: no, type: precision_at_3
value: 5.437
verified: no, type: precision_at_5
value: 4.013
verified: no, type: recall_at_1
value: 8.474
verified: no, type: recall_at_10
value: 25.712000000000003
verified: no, type: recall_at_100
value: 48.008
verified: no, type: recall_at_1000
value: 72.52499999999999
verified: no, type: recall_at_20
value: 31.856
verified: no, type: recall_at_3
value: 16.311
verified: no, type: recall_at_5
value: 20.066
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB HotpotQA (default)
revision: ab518f4d6fcca38d87c25209f94beba119d02014
split: dev
type: mteb/hotpotqa
metrics: type: main_score
value: 49.524
verified: no, type: map_at_1
value: 27.583999999999996
verified: no, type: map_at_10
value: 40.455000000000005
verified: no, type: map_at_100
value: 41.567
verified: no, type: map_at_1000
value: 41.665
verified: no, type: map_at_20
value: 41.099000000000004
verified: no, type: map_at_3
value: 37.438
verified: no, type: map_at_5
value: 39.202999999999996
verified: no, type: mrr_at_1
value: 55.16798237561961
verified: no, type: mrr_at_10
value: 63.83496376336482
verified: no, type: mrr_at_100
value: 64.32844309604842
verified: no, type: mrr_at_1000
value: 64.35048997347738
verified: no, type: mrr_at_20
value: 64.14047945884145
verified: no, type: mrr_at_3
value: 61.93929380086919
verified: no, type: mrr_at_5
value: 63.0802888440121
verified: no, type: ndcg_at_1
value: 55.16799999999999
verified: no, type: ndcg_at_10
value: 49.524
verified: no, type: ndcg_at_100
value: 53.879
verified: no, type: ndcg_at_1000
value: 55.911
verified: no, type: ndcg_at_20
value: 51.31
verified: no, type: ndcg_at_3
value: 44.527
verified: no, type: ndcg_at_5
value: 47.102
verified: no, type: precision_at_1
value: 55.16799999999999
verified: no, type: precision_at_10
value: 10.718
verified: no, type: precision_at_100
value: 1.4160000000000001
verified: no, type: precision_at_1000
value: 0.169
verified: no, type: precision_at_20
value: 5.935
verified: no, type: precision_at_3
value: 28.26
verified: no, type: precision_at_5
value: 18.990000000000002
verified: no, type: recall_at_1
value: 27.583999999999996
verified: no, type: recall_at_10
value: 53.589
verified: no, type: recall_at_100
value: 70.782
verified: no, type: recall_at_1000
value: 84.276
verified: no, type: recall_at_20
value: 59.354
verified: no, type: recall_at_3
value: 42.39
verified: no, type: recall_at_5
value: 47.476
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB HotpotQAHardNegatives (default)
revision: 617612fa63afcb60e3b134bed8b7216a99707c37
split: test
type: mteb/HotpotQA_test_top_250_only_w_correct-v2
metrics: type: main_score
value: 50.415
verified: no, type: map_at_1
value: 26.8
verified: no, type: map_at_10
value: 40.503
verified: no, type: map_at_100
value: 42.092
verified: no, type: map_at_1000
value: 42.198
verified: no, type: map_at_20
value: 41.394999999999996
verified: no, type: map_at_3
value: 36.75
verified: no, type: map_at_5
value: 38.945
verified: no, type: mrr_at_1
value: 53.6
verified: no, type: mrr_at_10
value: 63.90658730158732
verified: no, type: mrr_at_100
value: 64.46665914282829
verified: no, type: mrr_at_1000
value: 64.4775151418674
verified: no, type: mrr_at_20
value: 64.20681999545006
verified: no, type: mrr_at_3
value: 61.40000000000001
verified: no, type: mrr_at_5
value: 62.98000000000005
verified: no, type: ndcg_at_1
value: 53.6
verified: no, type: ndcg_at_10
value: 50.415
verified: no, type: ndcg_at_100
value: 56.48800000000001
verified: no, type: ndcg_at_1000
value: 58.388
verified: no, type: ndcg_at_20
value: 52.68000000000001
verified: no, type: ndcg_at_3
value: 44.165
verified: no, type: ndcg_at_5
value: 47.429
verified: no, type: precision_at_1
value: 53.6
verified: no, type: precision_at_10
value: 11.31
verified: no, type: precision_at_100
value: 1.614
verified: no, type: precision_at_1000
value: 0.186
verified: no, type: precision_at_20
value: 6.375
verified: no, type: precision_at_3
value: 28.433000000000003
verified: no, type: precision_at_5
value: 19.62
verified: no, type: recall_at_1
value: 26.8
verified: no, type: recall_at_10
value: 56.55
verified: no, type: recall_at_100
value: 80.7
verified: no, type: recall_at_1000
value: 93.05
verified: no, type: recall_at_20
value: 63.74999999999999
verified: no, type: recall_at_3
value: 42.65
verified: no, type: recall_at_5
value: 49.05
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBNarrativeQARetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test
type: dwzhu/LongEmbed
metrics: type: main_score
value: 47.11
verified: no, type: map_at_1
value: 38.176
verified: no, type: map_at_10
value: 44.11
verified: no, type: map_at_100
value: 44.885999999999996
verified: no, type: map_at_1000
value: 45.005
verified: no, type: map_at_20
value: 44.486
verified: no, type: map_at_3
value: 42.669000000000004
verified: no, type: map_at_5
value: 43.441
verified: no, type: mrr_at_1
value: 38.17590200019141
verified: no, type: mrr_at_10
value: 44.109989260003694
verified: no, type: mrr_at_100
value: 44.886475970293596
verified: no, type: mrr_at_1000
value: 45.00541901614199
verified: no, type: mrr_at_20
value: 44.48565175776022
verified: no, type: mrr_at_3
value: 42.66915494305687
verified: no, type: mrr_at_5
value: 43.44052062398311
verified: no, type: ndcg_at_1
value: 38.176
verified: no, type: ndcg_at_10
value: 47.11
verified: no, type: ndcg_at_100
value: 51.644999999999996
verified: no, type: ndcg_at_1000
value: 54.366
verified: no, type: ndcg_at_20
value: 48.475
verified: no, type: ndcg_at_3
value: 44.101
verified: no, type: ndcg_at_5
value: 45.494
verified: no, type: precision_at_1
value: 38.176
verified: no, type: precision_at_10
value: 5.6610000000000005
verified: no, type: precision_at_100
value: 0.796
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 3.1
verified: no, type: precision_at_3
value: 16.078
verified: no, type: precision_at_5
value: 10.324
verified: no, type: recall_at_1
value: 38.176
verified: no, type: recall_at_10
value: 56.608000000000004
verified: no, type: recall_at_100
value: 79.644
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 61.995999999999995
verified: no, type: recall_at_3
value: 48.234
verified: no, type: recall_at_5
value: 51.622
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBNeedleRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_1024
type: dwzhu/LongEmbed
metrics: type: main_score
value: 90
verified: no, type: map_at_1
value: 90
verified: no, type: map_at_10
value: 94.667
verified: no, type: map_at_100
value: 94.667
verified: no, type: map_at_1000
value: 94.667
verified: no, type: map_at_20
value: 94.667
verified: no, type: map_at_3
value: 94.667
verified: no, type: map_at_5
value: 94.667
verified: no, type: mrr_at_1
value: 90
verified: no, type: mrr_at_10
value: 94.66666666666666
verified: no, type: mrr_at_100
value: 94.66666666666666
verified: no, type: mrr_at_1000
value: 94.66666666666666
verified: no, type: mrr_at_20
value: 94.66666666666666
verified: no, type: mrr_at_3
value: 94.66666666666666
verified: no, type: mrr_at_5
value: 94.66666666666666
verified: no, type: ndcg_at_1
value: 90
verified: no, type: ndcg_at_10
value: 96.04700000000001
verified: no, type: ndcg_at_100
value: 96.04700000000001
verified: no, type: ndcg_at_1000
value: 96.04700000000001
verified: no, type: ndcg_at_20
value: 96.04700000000001
verified: no, type: ndcg_at_3
value: 96.04700000000001
verified: no, type: ndcg_at_5
value: 96.04700000000001
verified: no, type: precision_at_1
value: 90
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 90
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBNeedleRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_16384
type: dwzhu/LongEmbed
metrics: type: main_score
value: 90
verified: no, type: map_at_1
value: 90
verified: no, type: map_at_10
value: 94.167
verified: no, type: map_at_100
value: 94.167
verified: no, type: map_at_1000
value: 94.167
verified: no, type: map_at_20
value: 94.167
verified: no, type: map_at_3
value: 93.667
verified: no, type: map_at_5
value: 94.167
verified: no, type: mrr_at_1
value: 90
verified: no, type: mrr_at_10
value: 94.16666666666666
verified: no, type: mrr_at_100
value: 94.16666666666666
verified: no, type: mrr_at_1000
value: 94.16666666666666
verified: no, type: mrr_at_20
value: 94.16666666666666
verified: no, type: mrr_at_3
value: 93.66666666666666
verified: no, type: mrr_at_5
value: 94.16666666666666
verified: no, type: ndcg_at_1
value: 90
verified: no, type: ndcg_at_10
value: 95.647
verified: no, type: ndcg_at_100
value: 95.647
verified: no, type: ndcg_at_1000
value: 95.647
verified: no, type: ndcg_at_20
value: 95.647
verified: no, type: ndcg_at_3
value: 94.786
verified: no, type: ndcg_at_5
value: 95.647
verified: no, type: precision_at_1
value: 90
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 32.667
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 90
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 98
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBNeedleRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_2048
type: dwzhu/LongEmbed
metrics: type: main_score
value: 92
verified: no, type: map_at_1
value: 92
verified: no, type: map_at_10
value: 95.667
verified: no, type: map_at_100
value: 95.667
verified: no, type: map_at_1000
value: 95.667
verified: no, type: map_at_20
value: 95.667
verified: no, type: map_at_3
value: 95.667
verified: no, type: map_at_5
value: 95.667
verified: no, type: mrr_at_1
value: 92
verified: no, type: mrr_at_10
value: 95.66666666666666
verified: no, type: mrr_at_100
value: 95.66666666666666
verified: no, type: mrr_at_1000
value: 95.66666666666666
verified: no, type: mrr_at_20
value: 95.66666666666666
verified: no, type: mrr_at_3
value: 95.66666666666666
verified: no, type: mrr_at_5
value: 95.66666666666666
verified: no, type: ndcg_at_1
value: 92
verified: no, type: ndcg_at_10
value: 96.786
verified: no, type: ndcg_at_100
value: 96.786
verified: no, type: ndcg_at_1000
value: 96.786
verified: no, type: ndcg_at_20
value: 96.786
verified: no, type: ndcg_at_3
value: 96.786
verified: no, type: ndcg_at_5
value: 96.786
verified: no, type: precision_at_1
value: 92
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 92
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBNeedleRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_256
type: dwzhu/LongEmbed
metrics: type: main_score
value: 90
verified: no, type: map_at_1
value: 90
verified: no, type: map_at_10
value: 95
verified: no, type: map_at_100
value: 95
verified: no, type: map_at_1000
value: 95
verified: no, type: map_at_20
value: 95
verified: no, type: map_at_3
value: 95
verified: no, type: map_at_5
value: 95
verified: no, type: mrr_at_1
value: 90
verified: no, type: mrr_at_10
value: 95
verified: no, type: mrr_at_100
value: 95
verified: no, type: mrr_at_1000
value: 95
verified: no, type: mrr_at_20
value: 95
verified: no, type: mrr_at_3
value: 95
verified: no, type: mrr_at_5
value: 95
verified: no, type: ndcg_at_1
value: 90
verified: no, type: ndcg_at_10
value: 96.309
verified: no, type: ndcg_at_100
value: 96.309
verified: no, type: ndcg_at_1000
value: 96.309
verified: no, type: ndcg_at_20
value: 96.309
verified: no, type: ndcg_at_3
value: 96.309
verified: no, type: ndcg_at_5
value: 96.309
verified: no, type: precision_at_1
value: 90
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 90
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBNeedleRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_32768
type: dwzhu/LongEmbed
metrics: type: main_score
value: 84
verified: no, type: map_at_1
value: 84
verified: no, type: map_at_10
value: 91.167
verified: no, type: map_at_100
value: 91.167
verified: no, type: map_at_1000
value: 91.167
verified: no, type: map_at_20
value: 91.167
verified: no, type: map_at_3
value: 90.667
verified: no, type: map_at_5
value: 91.167
verified: no, type: mrr_at_1
value: 84
verified: no, type: mrr_at_10
value: 91.16666666666666
verified: no, type: mrr_at_100
value: 91.16666666666666
verified: no, type: mrr_at_1000
value: 91.16666666666666
verified: no, type: mrr_at_20
value: 91.16666666666666
verified: no, type: mrr_at_3
value: 90.66666666666666
verified: no, type: mrr_at_5
value: 91.16666666666666
verified: no, type: ndcg_at_1
value: 84
verified: no, type: ndcg_at_10
value: 93.43299999999999
verified: no, type: ndcg_at_100
value: 93.43299999999999
verified: no, type: ndcg_at_1000
value: 93.43299999999999
verified: no, type: ndcg_at_20
value: 93.43299999999999
verified: no, type: ndcg_at_3
value: 92.571
verified: no, type: ndcg_at_5
value: 93.43299999999999
verified: no, type: precision_at_1
value: 84
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 32.667
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 84
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 98
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBNeedleRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_4096
type: dwzhu/LongEmbed
metrics: type: main_score
value: 92
verified: no, type: map_at_1
value: 92
verified: no, type: map_at_10
value: 96
verified: no, type: map_at_100
value: 96
verified: no, type: map_at_1000
value: 96
verified: no, type: map_at_20
value: 96
verified: no, type: map_at_3
value: 96
verified: no, type: map_at_5
value: 96
verified: no, type: mrr_at_1
value: 92
verified: no, type: mrr_at_10
value: 96
verified: no, type: mrr_at_100
value: 96
verified: no, type: mrr_at_1000
value: 96
verified: no, type: mrr_at_20
value: 96
verified: no, type: mrr_at_3
value: 96
verified: no, type: mrr_at_5
value: 96
verified: no, type: ndcg_at_1
value: 92
verified: no, type: ndcg_at_10
value: 97.04700000000001
verified: no, type: ndcg_at_100
value: 97.04700000000001
verified: no, type: ndcg_at_1000
value: 97.04700000000001
verified: no, type: ndcg_at_20
value: 97.04700000000001
verified: no, type: ndcg_at_3
value: 97.04700000000001
verified: no, type: ndcg_at_5
value: 97.04700000000001
verified: no, type: precision_at_1
value: 92
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 92
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBNeedleRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_512
type: dwzhu/LongEmbed
metrics: type: main_score
value: 94
verified: no, type: map_at_1
value: 94
verified: no, type: map_at_10
value: 97
verified: no, type: map_at_100
value: 97
verified: no, type: map_at_1000
value: 97
verified: no, type: map_at_20
value: 97
verified: no, type: map_at_3
value: 97
verified: no, type: map_at_5
value: 97
verified: no, type: mrr_at_1
value: 94
verified: no, type: mrr_at_10
value: 97
verified: no, type: mrr_at_100
value: 97
verified: no, type: mrr_at_1000
value: 97
verified: no, type: mrr_at_20
value: 97
verified: no, type: mrr_at_3
value: 97
verified: no, type: mrr_at_5
value: 97
verified: no, type: ndcg_at_1
value: 94
verified: no, type: ndcg_at_10
value: 97.786
verified: no, type: ndcg_at_100
value: 97.786
verified: no, type: ndcg_at_1000
value: 97.786
verified: no, type: ndcg_at_20
value: 97.786
verified: no, type: ndcg_at_3
value: 97.786
verified: no, type: ndcg_at_5
value: 97.786
verified: no, type: precision_at_1
value: 94
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 94
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBNeedleRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_8192
type: dwzhu/LongEmbed
metrics: type: main_score
value: 88
verified: no, type: map_at_1
value: 88
verified: no, type: map_at_10
value: 93.167
verified: no, type: map_at_100
value: 93.167
verified: no, type: map_at_1000
value: 93.167
verified: no, type: map_at_20
value: 93.167
verified: no, type: map_at_3
value: 92.667
verified: no, type: map_at_5
value: 93.167
verified: no, type: mrr_at_1
value: 88
verified: no, type: mrr_at_10
value: 93.16666666666666
verified: no, type: mrr_at_100
value: 93.16666666666666
verified: no, type: mrr_at_1000
value: 93.16666666666666
verified: no, type: mrr_at_20
value: 93.16666666666666
verified: no, type: mrr_at_3
value: 92.66666666666666
verified: no, type: mrr_at_5
value: 93.16666666666666
verified: no, type: ndcg_at_1
value: 88
verified: no, type: ndcg_at_10
value: 94.90899999999999
verified: no, type: ndcg_at_100
value: 94.90899999999999
verified: no, type: ndcg_at_1000
value: 94.90899999999999
verified: no, type: ndcg_at_20
value: 94.90899999999999
verified: no, type: ndcg_at_3
value: 94.047
verified: no, type: ndcg_at_5
value: 94.90899999999999
verified: no, type: precision_at_1
value: 88
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 32.667
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 88
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 98
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBPasskeyRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_1024
type: dwzhu/LongEmbed
metrics: type: main_score
value: 100
verified: no, type: map_at_1
value: 100
verified: no, type: map_at_10
value: 100
verified: no, type: map_at_100
value: 100
verified: no, type: map_at_1000
value: 100
verified: no, type: map_at_20
value: 100
verified: no, type: map_at_3
value: 100
verified: no, type: map_at_5
value: 100
verified: no, type: mrr_at_1
value: 100
verified: no, type: mrr_at_10
value: 100
verified: no, type: mrr_at_100
value: 100
verified: no, type: mrr_at_1000
value: 100
verified: no, type: mrr_at_20
value: 100
verified: no, type: mrr_at_3
value: 100
verified: no, type: mrr_at_5
value: 100
verified: no, type: ndcg_at_1
value: 100
verified: no, type: ndcg_at_10
value: 100
verified: no, type: ndcg_at_100
value: 100
verified: no, type: ndcg_at_1000
value: 100
verified: no, type: ndcg_at_20
value: 100
verified: no, type: ndcg_at_3
value: 100
verified: no, type: ndcg_at_5
value: 100
verified: no, type: precision_at_1
value: 100
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 100
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBPasskeyRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_16384
type: dwzhu/LongEmbed
metrics: type: main_score
value: 100
verified: no, type: map_at_1
value: 100
verified: no, type: map_at_10
value: 100
verified: no, type: map_at_100
value: 100
verified: no, type: map_at_1000
value: 100
verified: no, type: map_at_20
value: 100
verified: no, type: map_at_3
value: 100
verified: no, type: map_at_5
value: 100
verified: no, type: mrr_at_1
value: 100
verified: no, type: mrr_at_10
value: 100
verified: no, type: mrr_at_100
value: 100
verified: no, type: mrr_at_1000
value: 100
verified: no, type: mrr_at_20
value: 100
verified: no, type: mrr_at_3
value: 100
verified: no, type: mrr_at_5
value: 100
verified: no, type: ndcg_at_1
value: 100
verified: no, type: ndcg_at_10
value: 100
verified: no, type: ndcg_at_100
value: 100
verified: no, type: ndcg_at_1000
value: 100
verified: no, type: ndcg_at_20
value: 100
verified: no, type: ndcg_at_3
value: 100
verified: no, type: ndcg_at_5
value: 100
verified: no, type: precision_at_1
value: 100
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 100
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBPasskeyRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_2048
type: dwzhu/LongEmbed
metrics: type: main_score
value: 100
verified: no, type: map_at_1
value: 100
verified: no, type: map_at_10
value: 100
verified: no, type: map_at_100
value: 100
verified: no, type: map_at_1000
value: 100
verified: no, type: map_at_20
value: 100
verified: no, type: map_at_3
value: 100
verified: no, type: map_at_5
value: 100
verified: no, type: mrr_at_1
value: 100
verified: no, type: mrr_at_10
value: 100
verified: no, type: mrr_at_100
value: 100
verified: no, type: mrr_at_1000
value: 100
verified: no, type: mrr_at_20
value: 100
verified: no, type: mrr_at_3
value: 100
verified: no, type: mrr_at_5
value: 100
verified: no, type: ndcg_at_1
value: 100
verified: no, type: ndcg_at_10
value: 100
verified: no, type: ndcg_at_100
value: 100
verified: no, type: ndcg_at_1000
value: 100
verified: no, type: ndcg_at_20
value: 100
verified: no, type: ndcg_at_3
value: 100
verified: no, type: ndcg_at_5
value: 100
verified: no, type: precision_at_1
value: 100
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 100
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBPasskeyRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_256
type: dwzhu/LongEmbed
metrics: type: main_score
value: 100
verified: no, type: map_at_1
value: 100
verified: no, type: map_at_10
value: 100
verified: no, type: map_at_100
value: 100
verified: no, type: map_at_1000
value: 100
verified: no, type: map_at_20
value: 100
verified: no, type: map_at_3
value: 100
verified: no, type: map_at_5
value: 100
verified: no, type: mrr_at_1
value: 100
verified: no, type: mrr_at_10
value: 100
verified: no, type: mrr_at_100
value: 100
verified: no, type: mrr_at_1000
value: 100
verified: no, type: mrr_at_20
value: 100
verified: no, type: mrr_at_3
value: 100
verified: no, type: mrr_at_5
value: 100
verified: no, type: ndcg_at_1
value: 100
verified: no, type: ndcg_at_10
value: 100
verified: no, type: ndcg_at_100
value: 100
verified: no, type: ndcg_at_1000
value: 100
verified: no, type: ndcg_at_20
value: 100
verified: no, type: ndcg_at_3
value: 100
verified: no, type: ndcg_at_5
value: 100
verified: no, type: precision_at_1
value: 100
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 100
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBPasskeyRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_32768
type: dwzhu/LongEmbed
metrics: type: main_score
value: 100
verified: no, type: map_at_1
value: 100
verified: no, type: map_at_10
value: 100
verified: no, type: map_at_100
value: 100
verified: no, type: map_at_1000
value: 100
verified: no, type: map_at_20
value: 100
verified: no, type: map_at_3
value: 100
verified: no, type: map_at_5
value: 100
verified: no, type: mrr_at_1
value: 100
verified: no, type: mrr_at_10
value: 100
verified: no, type: mrr_at_100
value: 100
verified: no, type: mrr_at_1000
value: 100
verified: no, type: mrr_at_20
value: 100
verified: no, type: mrr_at_3
value: 100
verified: no, type: mrr_at_5
value: 100
verified: no, type: ndcg_at_1
value: 100
verified: no, type: ndcg_at_10
value: 100
verified: no, type: ndcg_at_100
value: 100
verified: no, type: ndcg_at_1000
value: 100
verified: no, type: ndcg_at_20
value: 100
verified: no, type: ndcg_at_3
value: 100
verified: no, type: ndcg_at_5
value: 100
verified: no, type: precision_at_1
value: 100
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 100
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBPasskeyRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_4096
type: dwzhu/LongEmbed
metrics: type: main_score
value: 100
verified: no, type: map_at_1
value: 100
verified: no, type: map_at_10
value: 100
verified: no, type: map_at_100
value: 100
verified: no, type: map_at_1000
value: 100
verified: no, type: map_at_20
value: 100
verified: no, type: map_at_3
value: 100
verified: no, type: map_at_5
value: 100
verified: no, type: mrr_at_1
value: 100
verified: no, type: mrr_at_10
value: 100
verified: no, type: mrr_at_100
value: 100
verified: no, type: mrr_at_1000
value: 100
verified: no, type: mrr_at_20
value: 100
verified: no, type: mrr_at_3
value: 100
verified: no, type: mrr_at_5
value: 100
verified: no, type: ndcg_at_1
value: 100
verified: no, type: ndcg_at_10
value: 100
verified: no, type: ndcg_at_100
value: 100
verified: no, type: ndcg_at_1000
value: 100
verified: no, type: ndcg_at_20
value: 100
verified: no, type: ndcg_at_3
value: 100
verified: no, type: ndcg_at_5
value: 100
verified: no, type: precision_at_1
value: 100
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 100
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBPasskeyRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_512
type: dwzhu/LongEmbed
metrics: type: main_score
value: 100
verified: no, type: map_at_1
value: 100
verified: no, type: map_at_10
value: 100
verified: no, type: map_at_100
value: 100
verified: no, type: map_at_1000
value: 100
verified: no, type: map_at_20
value: 100
verified: no, type: map_at_3
value: 100
verified: no, type: map_at_5
value: 100
verified: no, type: mrr_at_1
value: 100
verified: no, type: mrr_at_10
value: 100
verified: no, type: mrr_at_100
value: 100
verified: no, type: mrr_at_1000
value: 100
verified: no, type: mrr_at_20
value: 100
verified: no, type: mrr_at_3
value: 100
verified: no, type: mrr_at_5
value: 100
verified: no, type: ndcg_at_1
value: 100
verified: no, type: ndcg_at_10
value: 100
verified: no, type: ndcg_at_100
value: 100
verified: no, type: ndcg_at_1000
value: 100
verified: no, type: ndcg_at_20
value: 100
verified: no, type: ndcg_at_3
value: 100
verified: no, type: ndcg_at_5
value: 100
verified: no, type: precision_at_1
value: 100
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 100
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBPasskeyRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test_8192
type: dwzhu/LongEmbed
metrics: type: main_score
value: 100
verified: no, type: map_at_1
value: 100
verified: no, type: map_at_10
value: 100
verified: no, type: map_at_100
value: 100
verified: no, type: map_at_1000
value: 100
verified: no, type: map_at_20
value: 100
verified: no, type: map_at_3
value: 100
verified: no, type: map_at_5
value: 100
verified: no, type: mrr_at_1
value: 100
verified: no, type: mrr_at_10
value: 100
verified: no, type: mrr_at_100
value: 100
verified: no, type: mrr_at_1000
value: 100
verified: no, type: mrr_at_20
value: 100
verified: no, type: mrr_at_3
value: 100
verified: no, type: mrr_at_5
value: 100
verified: no, type: ndcg_at_1
value: 100
verified: no, type: ndcg_at_10
value: 100
verified: no, type: ndcg_at_100
value: 100
verified: no, type: ndcg_at_1000
value: 100
verified: no, type: ndcg_at_20
value: 100
verified: no, type: ndcg_at_3
value: 100
verified: no, type: ndcg_at_5
value: 100
verified: no, type: precision_at_1
value: 100
verified: no, type: precision_at_10
value: 10
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 20
verified: no, type: recall_at_1
value: 100
verified: no, type: recall_at_10
value: 100
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 100
verified: no, type: recall_at_5
value: 100
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBQMSumRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test
type: dwzhu/LongEmbed
metrics: type: main_score
value: 29.847
verified: no, type: map_at_1
value: 18.271
verified: no, type: map_at_10
value: 25.415
verified: no, type: map_at_100
value: 27.086
verified: no, type: map_at_1000
value: 27.134000000000004
verified: no, type: map_at_20
value: 26.135
verified: no, type: map_at_3
value: 22.659000000000002
verified: no, type: map_at_5
value: 24.198
verified: no, type: mrr_at_1
value: 18.271119842829076
verified: no, type: mrr_at_10
value: 25.414678641594147
verified: no, type: mrr_at_100
value: 27.086094547163714
verified: no, type: mrr_at_1000
value: 27.13383971528746
verified: no, type: mrr_at_20
value: 26.13474777243653
verified: no, type: mrr_at_3
value: 22.658808120497696
verified: no, type: mrr_at_5
value: 24.197773411918757
verified: no, type: ndcg_at_1
value: 18.271
verified: no, type: ndcg_at_10
value: 29.847
verified: no, type: ndcg_at_100
value: 39.669
verified: no, type: ndcg_at_1000
value: 40.528999999999996
verified: no, type: ndcg_at_20
value: 32.509
verified: no, type: ndcg_at_3
value: 24.151
verified: no, type: ndcg_at_5
value: 26.927
verified: no, type: precision_at_1
value: 18.271
verified: no, type: precision_at_10
value: 4.42
verified: no, type: precision_at_100
value: 0.9400000000000001
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 2.741
verified: no, type: precision_at_3
value: 9.496
verified: no, type: precision_at_5
value: 7.045999999999999
verified: no, type: recall_at_1
value: 18.271
verified: no, type: recall_at_10
value: 44.204
verified: no, type: recall_at_100
value: 93.975
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 54.813
verified: no, type: recall_at_3
value: 28.487000000000002
verified: no, type: recall_at_5
value: 35.232
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBSummScreenFDRetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: validation
type: dwzhu/LongEmbed
metrics: type: main_score
value: 90.19
verified: no, type: map_at_1
value: 81.548
verified: no, type: map_at_10
value: 87.57300000000001
verified: no, type: map_at_100
value: 87.703
verified: no, type: map_at_1000
value: 87.703
verified: no, type: map_at_20
value: 87.703
verified: no, type: map_at_3
value: 86.657
verified: no, type: map_at_5
value: 87.178
verified: no, type: mrr_at_1
value: 81.54761904761905
verified: no, type: mrr_at_10
value: 87.57345993953139
verified: no, type: mrr_at_100
value: 87.70306685222651
verified: no, type: mrr_at_1000
value: 87.70306685222651
verified: no, type: mrr_at_20
value: 87.70306685222651
verified: no, type: mrr_at_3
value: 86.65674603174602
verified: no, type: mrr_at_5
value: 87.17757936507935
verified: no, type: ndcg_at_1
value: 81.548
verified: no, type: ndcg_at_10
value: 90.19
verified: no, type: ndcg_at_100
value: 90.648
verified: no, type: ndcg_at_1000
value: 90.648
verified: no, type: ndcg_at_20
value: 90.648
verified: no, type: ndcg_at_3
value: 88.325
verified: no, type: ndcg_at_5
value: 89.286
verified: no, type: precision_at_1
value: 81.548
verified: no, type: precision_at_10
value: 9.821
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 5
verified: no, type: precision_at_3
value: 31.052000000000003
verified: no, type: precision_at_5
value: 19.107
verified: no, type: recall_at_1
value: 81.548
verified: no, type: recall_at_10
value: 98.214
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 100
verified: no, type: recall_at_3
value: 93.155
verified: no, type: recall_at_5
value: 95.536
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LEMBWikimQARetrieval (default)
revision: 6e346642246bfb4928c560ee08640dc84d074e8c
split: test
type: dwzhu/LongEmbed
metrics: type: main_score
value: 77.203
verified: no, type: map_at_1
value: 69.333
verified: no, type: map_at_10
value: 74.787
verified: no, type: map_at_100
value: 75.348
verified: no, type: map_at_1000
value: 75.369
verified: no, type: map_at_20
value: 75.16000000000001
verified: no, type: map_at_3
value: 73.611
verified: no, type: map_at_5
value: 74.42800000000001
verified: no, type: mrr_at_1
value: 69.33333333333334
verified: no, type: mrr_at_10
value: 74.78743386243384
verified: no, type: mrr_at_100
value: 75.34827076805841
verified: no, type: mrr_at_1000
value: 75.36876455686495
verified: no, type: mrr_at_20
value: 75.16008204758204
verified: no, type: mrr_at_3
value: 73.61111111111111
verified: no, type: mrr_at_5
value: 74.42777777777778
verified: no, type: ndcg_at_1
value: 69.333
verified: no, type: ndcg_at_10
value: 77.203
verified: no, type: ndcg_at_100
value: 79.87100000000001
verified: no, type: ndcg_at_1000
value: 80.286
verified: no, type: ndcg_at_20
value: 78.55499999999999
verified: no, type: ndcg_at_3
value: 74.917
verified: no, type: ndcg_at_5
value: 76.337
verified: no, type: precision_at_1
value: 69.333
verified: no, type: precision_at_10
value: 8.466999999999999
verified: no, type: precision_at_100
value: 0.97
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 4.5
verified: no, type: precision_at_3
value: 26.222
verified: no, type: precision_at_5
value: 16.400000000000002
verified: no, type: recall_at_1
value: 69.333
verified: no, type: recall_at_10
value: 84.667
verified: no, type: recall_at_100
value: 97
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 90
verified: no, type: recall_at_3
value: 78.667
verified: no, type: recall_at_5
value: 82
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LegalBenchConsumerContractsQA (default)
revision: b23590301ec94e8087e2850b21d43d4956b1cca9
split: test
type: mteb/legalbench_consumer_contracts_qa
metrics: type: main_score
value: 61.623000000000005
verified: no, type: map_at_1
value: 40.909
verified: no, type: map_at_10
value: 54.376999999999995
verified: no, type: map_at_100
value: 55.150999999999996
verified: no, type: map_at_1000
value: 55.150999999999996
verified: no, type: map_at_20
value: 54.881
verified: no, type: map_at_3
value: 49.916
verified: no, type: map_at_5
value: 52.883
verified: no, type: mrr_at_1
value: 41.16161616161616
verified: no, type: mrr_at_10
value: 54.502765752765725
verified: no, type: mrr_at_100
value: 55.27732053682153
verified: no, type: mrr_at_1000
value: 55.27732053682153
verified: no, type: mrr_at_20
value: 55.00715286102044
verified: no, type: mrr_at_3
value: 50.04208754208756
verified: no, type: mrr_at_5
value: 53.00925925925923
verified: no, type: ndcg_at_1
value: 40.909
verified: no, type: ndcg_at_10
value: 61.623000000000005
verified: no, type: ndcg_at_100
value: 65.08500000000001
verified: no, type: ndcg_at_1000
value: 65.08500000000001
verified: no, type: ndcg_at_20
value: 63.427
verified: no, type: ndcg_at_3
value: 52.735
verified: no, type: ndcg_at_5
value: 58.114
verified: no, type: precision_at_1
value: 40.909
verified: no, type: precision_at_10
value: 8.459999999999999
verified: no, type: precision_at_100
value: 1
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 4.583
verified: no, type: precision_at_3
value: 20.286
verified: no, type: precision_at_5
value: 14.798
verified: no, type: recall_at_1
value: 40.909
verified: no, type: recall_at_10
value: 84.596
verified: no, type: recall_at_100
value: 100
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 91.667
verified: no, type: recall_at_3
value: 60.858999999999995
verified: no, type: recall_at_5
value: 73.99
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LegalBenchCorporateLobbying (default)
revision: f69691c650464e62546d7f2a4536f8f87c891e38
split: test
type: mteb/legalbench_corporate_lobbying
metrics: type: main_score
value: 89.377
verified: no, type: map_at_1
value: 79.706
verified: no, type: map_at_10
value: 86.652
verified: no, type: map_at_100
value: 86.756
verified: no, type: map_at_1000
value: 86.76
verified: no, type: map_at_20
value: 86.749
verified: no, type: map_at_3
value: 85.784
verified: no, type: map_at_5
value: 86.387
verified: no, type: mrr_at_1
value: 79.70588235294119
verified: no, type: mrr_at_10
value: 86.65184407096169
verified: no, type: mrr_at_100
value: 86.75604621101796
verified: no, type: mrr_at_1000
value: 86.76035993650815
verified: no, type: mrr_at_20
value: 86.7486932698415
verified: no, type: mrr_at_3
value: 85.78431372549021
verified: no, type: mrr_at_5
value: 86.38725490196077
verified: no, type: ndcg_at_1
value: 79.706
verified: no, type: ndcg_at_10
value: 89.377
verified: no, type: ndcg_at_100
value: 89.79700000000001
verified: no, type: ndcg_at_1000
value: 89.88000000000001
verified: no, type: ndcg_at_20
value: 89.742
verified: no, type: ndcg_at_3
value: 87.63300000000001
verified: no, type: ndcg_at_5
value: 88.721
verified: no, type: precision_at_1
value: 79.706
verified: no, type: precision_at_10
value: 9.765
verified: no, type: precision_at_100
value: 0.9939999999999999
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 4.956
verified: no, type: precision_at_3
value: 30.98
verified: no, type: precision_at_5
value: 19.118
verified: no, type: recall_at_1
value: 79.706
verified: no, type: recall_at_10
value: 97.64699999999999
verified: no, type: recall_at_100
value: 99.412
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 99.118
verified: no, type: recall_at_3
value: 92.941
verified: no, type: recall_at_5
value: 95.588
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LegalSummarization (default)
revision: 3bb1a05c66872889662af04c5691c14489cebd72
split: test
type: mteb/legal_summarization
metrics: type: main_score
value: 54.98800000000001
verified: no, type: map_at_1
value: 37.468
verified: no, type: map_at_10
value: 48.509
verified: no, type: map_at_100
value: 49.681
verified: no, type: map_at_1000
value: 49.757
verified: no, type: map_at_20
value: 49.021
verified: no, type: map_at_3
value: 44.59
verified: no, type: map_at_5
value: 46.867999999999995
verified: no, type: mrr_at_1
value: 42.6056338028169
verified: no, type: mrr_at_10
value: 53.24223116476639
verified: no, type: mrr_at_100
value: 53.82518326740263
verified: no, type: mrr_at_1000
value: 53.86171229208665
verified: no, type: mrr_at_20
value: 53.51133505321795
verified: no, type: mrr_at_3
value: 49.76525821596244
verified: no, type: mrr_at_5
value: 51.87793427230047
verified: no, type: ndcg_at_1
value: 42.606
verified: no, type: ndcg_at_10
value: 54.98800000000001
verified: no, type: ndcg_at_100
value: 60.111000000000004
verified: no, type: ndcg_at_1000
value: 61.382000000000005
verified: no, type: ndcg_at_20
value: 56.428999999999995
verified: no, type: ndcg_at_3
value: 48.367
verified: no, type: ndcg_at_5
value: 51.72
verified: no, type: precision_at_1
value: 42.606
verified: no, type: precision_at_10
value: 9.331
verified: no, type: precision_at_100
value: 1.398
verified: no, type: precision_at_1000
value: 0.155
verified: no, type: precision_at_20
value: 5.176
verified: no, type: precision_at_3
value: 21.009
verified: no, type: precision_at_5
value: 15.211
verified: no, type: recall_at_1
value: 37.468
verified: no, type: recall_at_10
value: 69.607
verified: no, type: recall_at_100
value: 91.57
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 74.553
verified: no, type: recall_at_3
value: 51.856
verified: no, type: recall_at_5
value: 60.309999999999995
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB LitSearchRetrieval (default)
revision: 9573fb284a1026c998df47024b888a163f0f0e25
split: test
type: princeton-nlp/LitSearch
metrics: type: main_score
value: 25.226
verified: no, type: map_at_1
value: 15.326999999999998
verified: no, type: map_at_10
value: 21.394
verified: no, type: map_at_100
value: 22.343
verified: no, type: map_at_1000
value: 22.429
verified: no, type: map_at_20
value: 21.941
verified: no, type: map_at_3
value: 19.123
verified: no, type: map_at_5
value: 20.14
verified: no, type: mrr_at_1
value: 15.745393634840871
verified: no, type: mrr_at_10
value: 21.745699396453173
verified: no, type: mrr_at_100
value: 22.713350239272813
verified: no, type: mrr_at_1000
value: 22.79392349547639
verified: no, type: mrr_at_20
value: 22.30884258376597
verified: no, type: mrr_at_3
value: 19.458403126744827
verified: no, type: mrr_at_5
value: 20.538805136795084
verified: no, type: ndcg_at_1
value: 15.494
verified: no, type: ndcg_at_10
value: 25.226
verified: no, type: ndcg_at_100
value: 30.263
verified: no, type: ndcg_at_1000
value: 32.994
verified: no, type: ndcg_at_20
value: 27.183
verified: no, type: ndcg_at_3
value: 20.385
verified: no, type: ndcg_at_5
value: 22.21
verified: no, type: precision_at_1
value: 15.745000000000001
verified: no, type: precision_at_10
value: 3.987
verified: no, type: precision_at_100
value: 0.657
verified: no, type: precision_at_1000
value: 0.09
verified: no, type: precision_at_20
value: 2.404
verified: no, type: precision_at_3
value: 8.319
verified: no, type: precision_at_5
value: 5.93
verified: no, type: recall_at_1
value: 15.326999999999998
verified: no, type: recall_at_10
value: 37.968
verified: no, type: recall_at_100
value: 62.546
verified: no, type: recall_at_1000
value: 84.87700000000001
verified: no, type: recall_at_20
value: 45.739999999999995
verified: no, type: recall_at_3
value: 24.204
verified: no, type: recall_at_5
value: 28.615000000000002
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB MSMARCO (default)
revision: c5a29a104738b98a9e76336939199e264163d4a0
split: test
type: mteb/msmarco
metrics: type: main_score
value: 39.988
verified: no, type: map_at_1
value: 1.055
verified: no, type: map_at_10
value: 7.149
verified: no, type: map_at_100
value: 21.816
verified: no, type: map_at_1000
value: 29.885
verified: no, type: map_at_20
value: 11.162999999999998
verified: no, type: map_at_3
value: 2.735
verified: no, type: map_at_5
value: 4.199
verified: no, type: mrr_at_1
value: 60.46511627906976
verified: no, type: mrr_at_10
value: 71.29844961240309
verified: no, type: mrr_at_100
value: 71.4438037073023
verified: no, type: mrr_at_1000
value: 71.45852257689312
verified: no, type: mrr_at_20
value: 71.29844961240309
verified: no, type: mrr_at_3
value: 69.3798449612403
verified: no, type: mrr_at_5
value: 71.00775193798448
verified: no, type: ndcg_at_1
value: 39.535
verified: no, type: ndcg_at_10
value: 39.988
verified: no, type: ndcg_at_100
value: 41.952
verified: no, type: ndcg_at_1000
value: 55.149
verified: no, type: ndcg_at_20
value: 39.861000000000004
verified: no, type: ndcg_at_3
value: 39.713
verified: no, type: ndcg_at_5
value: 40.2
verified: no, type: precision_at_1
value: 60.465
verified: no, type: precision_at_10
value: 52.791
verified: no, type: precision_at_100
value: 29.558
verified: no, type: precision_at_1000
value: 6.952999999999999
verified: no, type: precision_at_20
value: 47.209
verified: no, type: precision_at_3
value: 57.364000000000004
verified: no, type: precision_at_5
value: 56.279
verified: no, type: recall_at_1
value: 1.055
verified: no, type: recall_at_10
value: 8.778
verified: no, type: recall_at_100
value: 36.775999999999996
verified: no, type: recall_at_1000
value: 72.783
verified: no, type: recall_at_20
value: 14.529
verified: no, type: recall_at_3
value: 3.019
verified: no, type: recall_at_5
value: 4.987
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB MSMARCOHardNegatives (default)
revision: 67c0b4f7f15946e0b15cf6cf3b8993d04cb3efc6
split: test
type: mteb/MSMARCO_test_top_250_only_w_correct-v2
metrics: type: main_score
value: 49.17
verified: no, type: map_at_1
value: 1.871
verified: no, type: map_at_10
value: 11.155
verified: no, type: map_at_100
value: 38.995000000000005
verified: no, type: map_at_1000
value: 58.543
verified: no, type: map_at_20
value: 16.564
verified: no, type: map_at_3
value: 5.378
verified: no, type: map_at_5
value: 7.403
verified: no, type: mrr_at_1
value: 69.76744186046511
verified: no, type: mrr_at_10
value: 78.7624584717608
verified: no, type: mrr_at_100
value: 78.97387496224707
verified: no, type: mrr_at_1000
value: 78.97387496224707
verified: no, type: mrr_at_20
value: 78.97387496224707
verified: no, type: mrr_at_3
value: 76.74418604651163
verified: no, type: mrr_at_5
value: 77.90697674418605
verified: no, type: ndcg_at_1
value: 46.899
verified: no, type: ndcg_at_10
value: 49.17
verified: no, type: ndcg_at_100
value: 62.022
verified: no, type: ndcg_at_1000
value: 76.946
verified: no, type: ndcg_at_20
value: 50.113
verified: no, type: ndcg_at_3
value: 47.809000000000005
verified: no, type: ndcg_at_5
value: 47.947
verified: no, type: precision_at_1
value: 69.767
verified: no, type: precision_at_10
value: 63.256
verified: no, type: precision_at_100
value: 46.302
verified: no, type: precision_at_1000
value: 9.419
verified: no, type: precision_at_20
value: 58.48799999999999
verified: no, type: precision_at_3
value: 69.767
verified: no, type: precision_at_5
value: 66.047
verified: no, type: recall_at_1
value: 1.871
verified: no, type: recall_at_10
value: 12.928999999999998
verified: no, type: recall_at_100
value: 60.528000000000006
verified: no, type: recall_at_1000
value: 98.18599999999999
verified: no, type: recall_at_20
value: 20.534
verified: no, type: recall_at_3
value: 5.611
verified: no, type: recall_at_5
value: 8.054
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB MedicalQARetrieval (default)
revision: ae763399273d8b20506b80cf6f6f9a31a6a2b238
split: test
type: mteb/medical_qa
metrics: type: main_score
value: 47.905
verified: no, type: map_at_1
value: 23.926
verified: no, type: map_at_10
value: 39.777
verified: no, type: map_at_100
value: 40.449
verified: no, type: map_at_1000
value: 40.486
verified: no, type: map_at_20
value: 40.204
verified: no, type: map_at_3
value: 35.531
verified: no, type: map_at_5
value: 38.25
verified: no, type: mrr_at_1
value: 23.876953125
verified: no, type: mrr_at_10
value: 39.77653382316477
verified: no, type: mrr_at_100
value: 40.449022311809415
verified: no, type: mrr_at_1000
value: 40.485791901682774
verified: no, type: mrr_at_20
value: 40.20422058322255
verified: no, type: mrr_at_3
value: 35.53873697916675
verified: no, type: mrr_at_5
value: 38.25846354166688
verified: no, type: ndcg_at_1
value: 23.926
verified: no, type: ndcg_at_10
value: 47.905
verified: no, type: ndcg_at_100
value: 51.186
verified: no, type: ndcg_at_1000
value: 52.297000000000004
verified: no, type: ndcg_at_20
value: 49.445
verified: no, type: ndcg_at_3
value: 39.391
verified: no, type: ndcg_at_5
value: 44.254
verified: no, type: precision_at_1
value: 23.926
verified: no, type: precision_at_10
value: 7.349
verified: no, type: precision_at_100
value: 0.889
verified: no, type: precision_at_1000
value: 0.098
verified: no, type: precision_at_20
value: 3.977
verified: no, type: precision_at_3
value: 16.862
verified: no, type: precision_at_5
value: 12.461
verified: no, type: recall_at_1
value: 23.926
verified: no, type: recall_at_10
value: 73.48599999999999
verified: no, type: recall_at_100
value: 88.86699999999999
verified: no, type: recall_at_1000
value: 97.89999999999999
verified: no, type: recall_at_20
value: 79.541
verified: no, type: recall_at_3
value: 50.586
verified: no, type: recall_at_5
value: 62.305
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB NFCorpus (default)
revision: ec0fa4fe99da2ff19ca1214b7966684033a58814
split: test
type: mteb/nfcorpus
metrics: type: main_score
value: 30.044999999999998
verified: no, type: map_at_1
value: 5.015
verified: no, type: map_at_10
value: 10.93
verified: no, type: map_at_100
value: 13.592
verified: no, type: map_at_1000
value: 14.890999999999998
verified: no, type: map_at_20
value: 12.005
verified: no, type: map_at_3
value: 8.518
verified: no, type: map_at_5
value: 9.646
verified: no, type: mrr_at_1
value: 41.17647058823529
verified: no, type: mrr_at_10
value: 49.96486313823774
verified: no, type: mrr_at_100
value: 50.73871199227761
verified: no, type: mrr_at_1000
value: 50.788364180879874
verified: no, type: mrr_at_20
value: 50.53695651632227
verified: no, type: mrr_at_3
value: 47.936016511867905
verified: no, type: mrr_at_5
value: 49.267285861713106
verified: no, type: ndcg_at_1
value: 39.164
verified: no, type: ndcg_at_10
value: 30.044999999999998
verified: no, type: ndcg_at_100
value: 27.654
verified: no, type: ndcg_at_1000
value: 36.397
verified: no, type: ndcg_at_20
value: 28.016000000000002
verified: no, type: ndcg_at_3
value: 35.476
verified: no, type: ndcg_at_5
value: 33.123999999999995
verified: no, type: precision_at_1
value: 41.176
verified: no, type: precision_at_10
value: 21.765
verified: no, type: precision_at_100
value: 7.127
verified: no, type: precision_at_1000
value: 1.9959999999999998
verified: no, type: precision_at_20
value: 16.223000000000003
verified: no, type: precision_at_3
value: 33.333
verified: no, type: precision_at_5
value: 28.421000000000003
verified: no, type: recall_at_1
value: 5.015
verified: no, type: recall_at_10
value: 14.618999999999998
verified: no, type: recall_at_100
value: 27.755000000000003
verified: no, type: recall_at_1000
value: 59.302
verified: no, type: recall_at_20
value: 17.743000000000002
verified: no, type: recall_at_3
value: 9.769
verified: no, type: recall_at_5
value: 11.912
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB NQ (default)
revision: b774495ed302d8c44a3a7ea25c90dbce03968f31
split: test
type: mteb/nq
metrics: type: main_score
value: 23.105
verified: no, type: map_at_1
value: 9.2
verified: no, type: map_at_10
value: 17.564
verified: no, type: map_at_100
value: 19.226
verified: no, type: map_at_1000
value: 19.323
verified: no, type: map_at_20
value: 18.507
verified: no, type: map_at_3
value: 14.274999999999999
verified: no, type: map_at_5
value: 15.98
verified: no, type: mrr_at_1
value: 10.573580533024334
verified: no, type: mrr_at_10
value: 19.264677481653145
verified: no, type: mrr_at_100
value: 20.746572887142992
verified: no, type: mrr_at_1000
value: 20.823910481320183
verified: no, type: mrr_at_20
value: 20.119865220550533
verified: no, type: mrr_at_3
value: 16.005214368482008
verified: no, type: mrr_at_5
value: 17.75057937427577
verified: no, type: ndcg_at_1
value: 10.545
verified: no, type: ndcg_at_10
value: 23.105
verified: no, type: ndcg_at_100
value: 31.249
verified: no, type: ndcg_at_1000
value: 33.69
verified: no, type: ndcg_at_20
value: 26.334999999999997
verified: no, type: ndcg_at_3
value: 16.357
verified: no, type: ndcg_at_5
value: 19.403000000000002
verified: no, type: precision_at_1
value: 10.545
verified: no, type: precision_at_10
value: 4.565
verified: no, type: precision_at_100
value: 0.9169999999999999
verified: no, type: precision_at_1000
value: 0.11499999999999999
verified: no, type: precision_at_20
value: 3.023
verified: no, type: precision_at_3
value: 8.033999999999999
verified: no, type: precision_at_5
value: 6.524000000000001
verified: no, type: recall_at_1
value: 9.2
verified: no, type: recall_at_10
value: 38.775
verified: no, type: recall_at_100
value: 76.188
verified: no, type: recall_at_1000
value: 94.56599999999999
verified: no, type: recall_at_20
value: 50.9
verified: no, type: recall_at_3
value: 20.676
verified: no, type: recall_at_5
value: 27.810000000000002
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB NQHardNegatives (default)
revision: d700fe4f167a5db8e6c9b03e8c26e7eaf66faf97
split: test
type: mteb/NQ_test_top_250_only_w_correct-v2
metrics: type: main_score
value: 25.072
verified: no, type: map_at_1
value: 9.767000000000001
verified: no, type: map_at_10
value: 18.782
verified: no, type: map_at_100
value: 20.74
verified: no, type: map_at_1000
value: 20.821
verified: no, type: map_at_20
value: 19.819
verified: no, type: map_at_3
value: 15.089
verified: no, type: map_at_5
value: 16.929
verified: no, type: mrr_at_1
value: 11
verified: no, type: mrr_at_10
value: 20.55162698412698
verified: no, type: mrr_at_100
value: 22.24001716934204
verified: no, type: mrr_at_1000
value: 22.296375463042438
verified: no, type: mrr_at_20
value: 21.45978809546147
verified: no, type: mrr_at_3
value: 16.683333333333337
verified: no, type: mrr_at_5
value: 18.738333333333344
verified: no, type: ndcg_at_1
value: 11
verified: no, type: ndcg_at_10
value: 25.072
verified: no, type: ndcg_at_100
value: 34.695
verified: no, type: ndcg_at_1000
value: 36.312
verified: no, type: ndcg_at_20
value: 28.595
verified: no, type: ndcg_at_3
value: 17.273
verified: no, type: ndcg_at_5
value: 20.663999999999998
verified: no, type: precision_at_1
value: 11
verified: no, type: precision_at_10
value: 5.01
verified: no, type: precision_at_100
value: 1.05
verified: no, type: precision_at_1000
value: 0.12
verified: no, type: precision_at_20
value: 3.335
verified: no, type: precision_at_3
value: 8.433
verified: no, type: precision_at_5
value: 6.959999999999999
verified: no, type: recall_at_1
value: 9.767000000000001
verified: no, type: recall_at_10
value: 43.175000000000004
verified: no, type: recall_at_100
value: 87.467
verified: no, type: recall_at_1000
value: 98.917
verified: no, type: recall_at_20
value: 56.325
verified: no, type: recall_at_3
value: 22.033
verified: no, type: recall_at_5
value: 29.975
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB PIQA (default)
revision: bb30be7e9184e6b6b1d99bbfe1bb90a3a81842e6
split: test
type: RAR-b/piqa
metrics: type: main_score
value: 15.254000000000001
verified: no, type: map_at_1
value: 7.073
verified: no, type: map_at_10
value: 12.281
verified: no, type: map_at_100
value: 13.178
verified: no, type: map_at_1000
value: 13.26
verified: no, type: map_at_20
value: 12.753999999999998
verified: no, type: map_at_3
value: 10.591000000000001
verified: no, type: map_at_5
value: 11.522
verified: no, type: mrr_at_1
value: 7.127312295973885
verified: no, type: mrr_at_10
value: 12.307826830405721
verified: no, type: mrr_at_100
value: 13.205659849576772
verified: no, type: mrr_at_1000
value: 13.28739675923323
verified: no, type: mrr_at_20
value: 12.781972613283662
verified: no, type: mrr_at_3
value: 10.618425825172299
verified: no, type: mrr_at_5
value: 11.548784911135296
verified: no, type: ndcg_at_1
value: 7.073
verified: no, type: ndcg_at_10
value: 15.254000000000001
verified: no, type: ndcg_at_100
value: 20.077
verified: no, type: ndcg_at_1000
value: 22.43
verified: no, type: ndcg_at_20
value: 16.948
verified: no, type: ndcg_at_3
value: 11.741
verified: no, type: ndcg_at_5
value: 13.420000000000002
verified: no, type: precision_at_1
value: 7.073
verified: no, type: precision_at_10
value: 2.481
verified: no, type: precision_at_100
value: 0.484
verified: no, type: precision_at_1000
value: 0.067
verified: no, type: precision_at_20
value: 1.572
verified: no, type: precision_at_3
value: 5.024
verified: no, type: precision_at_5
value: 3.83
verified: no, type: recall_at_1
value: 7.073
verified: no, type: recall_at_10
value: 24.81
verified: no, type: recall_at_100
value: 48.422
verified: no, type: recall_at_1000
value: 67.35600000000001
verified: no, type: recall_at_20
value: 31.447000000000003
verified: no, type: recall_at_3
value: 15.071000000000002
verified: no, type: recall_at_5
value: 19.151
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB Quail (default)
revision: 1851bc536f8bdab29e03e29191c4586b1d8d7c5a
split: test
type: RAR-b/quail
metrics: type: main_score
value: 3.605
verified: no, type: map_at_1
value: 0.882
verified: no, type: map_at_10
value: 2.467
verified: no, type: map_at_100
value: 2.9659999999999997
verified: no, type: map_at_1000
value: 3.052
verified: no, type: map_at_20
value: 2.711
verified: no, type: map_at_3
value: 1.746
verified: no, type: map_at_5
value: 2.0629999999999997
verified: no, type: mrr_at_1
value: 0.8823529411764706
verified: no, type: mrr_at_10
value: 2.4645337301587333
verified: no, type: mrr_at_100
value: 2.9670174083352596
verified: no, type: mrr_at_1000
value: 3.0527771606810092
verified: no, type: mrr_at_20
value: 2.7112556752180152
verified: no, type: mrr_at_3
value: 1.7463235294117647
verified: no, type: mrr_at_5
value: 2.0625000000000013
verified: no, type: ndcg_at_1
value: 0.882
verified: no, type: ndcg_at_10
value: 3.605
verified: no, type: ndcg_at_100
value: 6.494999999999999
verified: no, type: ndcg_at_1000
value: 9.27
verified: no, type: ndcg_at_20
value: 4.502
verified: no, type: ndcg_at_3
value: 2.0340000000000003
verified: no, type: ndcg_at_5
value: 2.614
verified: no, type: precision_at_1
value: 0.882
verified: no, type: precision_at_10
value: 0.739
verified: no, type: precision_at_100
value: 0.22
verified: no, type: precision_at_1000
value: 0.045
verified: no, type: precision_at_20
value: 0.5479999999999999
verified: no, type: precision_at_3
value: 0.9560000000000001
verified: no, type: precision_at_5
value: 0.86
verified: no, type: recall_at_1
value: 0.882
verified: no, type: recall_at_10
value: 7.39
verified: no, type: recall_at_100
value: 21.985
verified: no, type: recall_at_1000
value: 44.926
verified: no, type: recall_at_20
value: 10.956000000000001
verified: no, type: recall_at_3
value: 2.868
verified: no, type: recall_at_5
value: 4.301
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB QuoraRetrieval (default)
revision: e4e08e0b7dbe3c8700f0daef558ff32256715259
split: dev
type: mteb/quora
metrics: type: main_score
value: 77.63
verified: no, type: map_at_1
value: 60.195
verified: no, type: map_at_10
value: 72.834
verified: no, type: map_at_100
value: 73.657
verified: no, type: map_at_1000
value: 73.68900000000001
verified: no, type: map_at_20
value: 73.358
verified: no, type: map_at_3
value: 69.834
verified: no, type: map_at_5
value: 71.622
verified: no, type: mrr_at_1
value: 69.12
verified: no, type: mrr_at_10
value: 76.90555555555562
verified: no, type: mrr_at_100
value: 77.22690418927783
verified: no, type: mrr_at_1000
value: 77.23378887488153
verified: no, type: mrr_at_20
value: 77.12735614892509
verified: no, type: mrr_at_3
value: 75.29666666666685
verified: no, type: mrr_at_5
value: 76.29566666666672
verified: no, type: ndcg_at_1
value: 69.06
verified: no, type: ndcg_at_10
value: 77.63
verified: no, type: ndcg_at_100
value: 80.143
verified: no, type: ndcg_at_1000
value: 80.57900000000001
verified: no, type: ndcg_at_20
value: 78.886
verified: no, type: ndcg_at_3
value: 73.735
verified: no, type: ndcg_at_5
value: 75.689
verified: no, type: precision_at_1
value: 69.06
verified: no, type: precision_at_10
value: 11.804
verified: no, type: precision_at_100
value: 1.417
verified: no, type: precision_at_1000
value: 0.151
verified: no, type: precision_at_20
value: 6.383
verified: no, type: precision_at_3
value: 32
verified: no, type: precision_at_5
value: 21.279999999999998
verified: no, type: recall_at_1
value: 60.195
verified: no, type: recall_at_10
value: 87.35300000000001
verified: no, type: recall_at_100
value: 97.055
verified: no, type: recall_at_1000
value: 99.669
verified: no, type: recall_at_20
value: 91.628
verified: no, type: recall_at_3
value: 76.40599999999999
verified: no, type: recall_at_5
value: 81.636
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB QuoraRetrieval (default)
revision: e4e08e0b7dbe3c8700f0daef558ff32256715259
split: test
type: mteb/quora
metrics: type: main_score
value: 77.529
verified: no, type: map_at_1
value: 60.492000000000004
verified: no, type: map_at_10
value: 72.82499999999999
verified: no, type: map_at_100
value: 73.668
verified: no, type: map_at_1000
value: 73.706
verified: no, type: map_at_20
value: 73.351
verified: no, type: map_at_3
value: 69.887
verified: no, type: map_at_5
value: 71.66
verified: no, type: mrr_at_1
value: 69.59
verified: no, type: mrr_at_10
value: 76.96056349206305
verified: no, type: mrr_at_100
value: 77.29271487249463
verified: no, type: mrr_at_1000
value: 77.30133384825908
verified: no, type: mrr_at_20
value: 77.1902356844216
verified: no, type: mrr_at_3
value: 75.39499999999957
verified: no, type: mrr_at_5
value: 76.38149999999933
verified: no, type: ndcg_at_1
value: 69.61
verified: no, type: ndcg_at_10
value: 77.529
verified: no, type: ndcg_at_100
value: 80.067
verified: no, type: ndcg_at_1000
value: 80.54299999999999
verified: no, type: ndcg_at_20
value: 78.76100000000001
verified: no, type: ndcg_at_3
value: 73.786
verified: no, type: ndcg_at_5
value: 75.696
verified: no, type: precision_at_1
value: 69.61
verified: no, type: precision_at_10
value: 11.756
verified: no, type: precision_at_100
value: 1.436
verified: no, type: precision_at_1000
value: 0.154
verified: no, type: precision_at_20
value: 6.382000000000001
verified: no, type: precision_at_3
value: 31.996999999999996
verified: no, type: precision_at_5
value: 21.198
verified: no, type: recall_at_1
value: 60.492000000000004
verified: no, type: recall_at_10
value: 86.887
verified: no, type: recall_at_100
value: 96.67999999999999
verified: no, type: recall_at_1000
value: 99.438
verified: no, type: recall_at_20
value: 91.081
verified: no, type: recall_at_3
value: 76.212
verified: no, type: recall_at_5
value: 81.48100000000001
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB QuoraRetrievalHardNegatives (default)
revision: 907a33577e9506221d3ba20f5a851b7c3f8dc6d3
split: test
type: mteb/QuoraRetrieval_test_top_250_only_w_correct-v2
metrics: type: main_score
value: 77.352
verified: no, type: map_at_1
value: 60.285999999999994
verified: no, type: map_at_10
value: 72.541
verified: no, type: map_at_100
value: 73.576
verified: no, type: map_at_1000
value: 73.61999999999999
verified: no, type: map_at_20
value: 73.236
verified: no, type: map_at_3
value: 69.434
verified: no, type: map_at_5
value: 71.177
verified: no, type: mrr_at_1
value: 69.6
verified: no, type: mrr_at_10
value: 76.9061111111111
verified: no, type: mrr_at_100
value: 77.25264059161483
verified: no, type: mrr_at_1000
value: 77.25961973203633
verified: no, type: mrr_at_20
value: 77.14650618344506
verified: no, type: mrr_at_3
value: 75.20000000000002
verified: no, type: mrr_at_5
value: 76.18
verified: no, type: ndcg_at_1
value: 69.6
verified: no, type: ndcg_at_10
value: 77.352
verified: no, type: ndcg_at_100
value: 80.24
verified: no, type: ndcg_at_1000
value: 80.658
verified: no, type: ndcg_at_20
value: 78.90599999999999
verified: no, type: ndcg_at_3
value: 73.534
verified: no, type: ndcg_at_5
value: 75.18599999999999
verified: no, type: precision_at_1
value: 69.6
verified: no, type: precision_at_10
value: 12.08
verified: no, type: precision_at_100
value: 1.514
verified: no, type: precision_at_1000
value: 0.16199999999999998
verified: no, type: precision_at_20
value: 6.69
verified: no, type: precision_at_3
value: 32.067
verified: no, type: precision_at_5
value: 21.279999999999998
verified: no, type: recall_at_1
value: 60.285999999999994
verified: no, type: recall_at_10
value: 86.75399999999999
verified: no, type: recall_at_100
value: 97.328
verified: no, type: recall_at_1000
value: 99.551
verified: no, type: recall_at_20
value: 91.85900000000001
verified: no, type: recall_at_3
value: 75.408
verified: no, type: recall_at_5
value: 80.353
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB RARbCode (default)
revision: 25f7d11a7ac12dcbb8d3836eb2de682b98c825e4
split: test
type: RAR-b/humanevalpack-mbpp-pooled
metrics: type: main_score
value: 10.407
verified: no, type: map_at_1
value: 6.132
verified: no, type: map_at_10
value: 8.741
verified: no, type: map_at_100
value: 9.198
verified: no, type: map_at_1000
value: 9.264
verified: no, type: map_at_20
value: 8.991
verified: no, type: map_at_3
value: 7.637
verified: no, type: map_at_5
value: 8.21
verified: no, type: mrr_at_1
value: 6.132075471698113
verified: no, type: mrr_at_10
value: 8.741389637616054
verified: no, type: mrr_at_100
value: 9.19843044441297
verified: no, type: mrr_at_1000
value: 9.263870046532622
verified: no, type: mrr_at_20
value: 8.991124756997893
verified: no, type: mrr_at_3
value: 7.637017070979335
verified: no, type: mrr_at_5
value: 8.209793351302785
verified: no, type: ndcg_at_1
value: 6.132
verified: no, type: ndcg_at_10
value: 10.407
verified: no, type: ndcg_at_100
value: 12.959000000000001
verified: no, type: ndcg_at_1000
value: 14.991
verified: no, type: ndcg_at_20
value: 11.324
verified: no, type: ndcg_at_3
value: 8.117
verified: no, type: ndcg_at_5
value: 9.146
verified: no, type: precision_at_1
value: 6.132
verified: no, type: precision_at_10
value: 1.584
verified: no, type: precision_at_100
value: 0.28600000000000003
verified: no, type: precision_at_1000
value: 0.045
verified: no, type: precision_at_20
value: 0.9740000000000001
verified: no, type: precision_at_3
value: 3.167
verified: no, type: precision_at_5
value: 2.399
verified: no, type: recall_at_1
value: 6.132
verified: no, type: recall_at_10
value: 15.836
verified: no, type: recall_at_100
value: 28.571
verified: no, type: recall_at_1000
value: 45.216
verified: no, type: recall_at_20
value: 19.474
verified: no, type: recall_at_3
value: 9.501
verified: no, type: recall_at_5
value: 11.995000000000001
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB RARbMath (default)
revision: 2393603c0221ff52f448d12dd75f0856103c6cca
split: test
type: RAR-b/math-pooled
metrics: type: main_score
value: 23.658
verified: no, type: map_at_1
value: 19.686999999999998
verified: no, type: map_at_10
value: 22.178
verified: no, type: map_at_100
value: 22.765
verified: no, type: map_at_1000
value: 22.844
verified: no, type: map_at_20
value: 22.462
verified: no, type: map_at_3
value: 21.29
verified: no, type: map_at_5
value: 21.787
verified: no, type: mrr_at_1
value: 19.686659281531888
verified: no, type: mrr_at_10
value: 22.177553460588754
verified: no, type: mrr_at_100
value: 22.7654510715158
verified: no, type: mrr_at_1000
value: 22.843891574167113
verified: no, type: mrr_at_20
value: 22.46217836587706
verified: no, type: mrr_at_3
value: 21.290288547765996
verified: no, type: mrr_at_5
value: 21.787202616447765
verified: no, type: ndcg_at_1
value: 19.686999999999998
verified: no, type: ndcg_at_10
value: 23.658
verified: no, type: ndcg_at_100
value: 27
verified: no, type: ndcg_at_1000
value: 29.509999999999998
verified: no, type: ndcg_at_20
value: 24.715
verified: no, type: ndcg_at_3
value: 21.817
verified: no, type: ndcg_at_5
value: 22.711000000000002
verified: no, type: precision_at_1
value: 19.686999999999998
verified: no, type: precision_at_10
value: 2.844
verified: no, type: precision_at_100
value: 0.45199999999999996
verified: no, type: precision_at_1000
value: 0.066
verified: no, type: precision_at_20
value: 1.633
verified: no, type: precision_at_3
value: 7.781000000000001
verified: no, type: precision_at_5
value: 5.102
verified: no, type: recall_at_1
value: 19.686999999999998
verified: no, type: recall_at_10
value: 28.438000000000002
verified: no, type: recall_at_100
value: 45.165
verified: no, type: recall_at_1000
value: 65.865
verified: no, type: recall_at_20
value: 32.663
verified: no, type: recall_at_3
value: 23.342
verified: no, type: recall_at_5
value: 25.509999999999998
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB SCIDOCS (default)
revision: f8c2fcf00f625baaa80f62ec5bd9e1fff3b8ae88
split: test
type: mteb/scidocs
metrics: type: main_score
value: 13.222999999999999
verified: no, type: map_at_1
value: 2.9979999999999998
verified: no, type: map_at_10
value: 7.475
verified: no, type: map_at_100
value: 8.903
verified: no, type: map_at_1000
value: 9.16
verified: no, type: map_at_20
value: 8.136000000000001
verified: no, type: map_at_3
value: 5.329
verified: no, type: map_at_5
value: 6.411
verified: no, type: mrr_at_1
value: 14.7
verified: no, type: mrr_at_10
value: 22.86599206349206
verified: no, type: mrr_at_100
value: 24.016847471793167
verified: no, type: mrr_at_1000
value: 24.09878143285336
verified: no, type: mrr_at_20
value: 23.487873612455665
verified: no, type: mrr_at_3
value: 19.850000000000016
verified: no, type: mrr_at_5
value: 21.385000000000005
verified: no, type: ndcg_at_1
value: 14.7
verified: no, type: ndcg_at_10
value: 13.222999999999999
verified: no, type: ndcg_at_100
value: 19.725
verified: no, type: ndcg_at_1000
value: 24.723
verified: no, type: ndcg_at_20
value: 15.215
verified: no, type: ndcg_at_3
value: 12.073
verified: no, type: ndcg_at_5
value: 10.707
verified: no, type: precision_at_1
value: 14.7
verified: no, type: precision_at_10
value: 7.049999999999999
verified: no, type: precision_at_100
value: 1.6650000000000003
verified: no, type: precision_at_1000
value: 0.28600000000000003
verified: no, type: precision_at_20
value: 4.68
verified: no, type: precision_at_3
value: 11.3
verified: no, type: precision_at_5
value: 9.48
verified: no, type: recall_at_1
value: 2.9979999999999998
verified: no, type: recall_at_10
value: 14.277999999999999
verified: no, type: recall_at_100
value: 33.772000000000006
verified: no, type: recall_at_1000
value: 58.15
verified: no, type: recall_at_20
value: 18.956999999999997
verified: no, type: recall_at_3
value: 6.883
verified: no, type: recall_at_5
value: 9.613
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB SIQA (default)
revision: 4ed8415e9dc24060deefc84be59e2db0aacbadcc
split: test
type: RAR-b/siqa
metrics: type: main_score
value: 0.517
verified: no, type: map_at_1
value: 0.307
verified: no, type: map_at_10
value: 0.42700000000000005
verified: no, type: map_at_100
value: 0.511
verified: no, type: map_at_1000
value: 0.5640000000000001
verified: no, type: map_at_20
value: 0.477
verified: no, type: map_at_3
value: 0.358
verified: no, type: map_at_5
value: 0.384
verified: no, type: mrr_at_1
value: 0.3070624360286591
verified: no, type: mrr_at_10
value: 0.42667868921707197
verified: no, type: mrr_at_100
value: 0.5106947806513232
verified: no, type: mrr_at_1000
value: 0.5637065102894676
verified: no, type: mrr_at_20
value: 0.476660924594987
verified: no, type: mrr_at_3
value: 0.35823950870010235
verified: no, type: mrr_at_5
value: 0.3838280450358239
verified: no, type: ndcg_at_1
value: 0.307
verified: no, type: ndcg_at_10
value: 0.517
verified: no, type: ndcg_at_100
value: 0.9570000000000001
verified: no, type: ndcg_at_1000
value: 3.83
verified: no, type: ndcg_at_20
value: 0.69
verified: no, type: ndcg_at_3
value: 0.372
verified: no, type: ndcg_at_5
value: 0.416
verified: no, type: precision_at_1
value: 0.307
verified: no, type: precision_at_10
value: 0.082
verified: no, type: precision_at_100
value: 0.03
verified: no, type: precision_at_1000
value: 0.029
verified: no, type: precision_at_20
value: 0.074
verified: no, type: precision_at_3
value: 0.136
verified: no, type: precision_at_5
value: 0.10200000000000001
verified: no, type: recall_at_1
value: 0.307
verified: no, type: recall_at_10
value: 0.819
verified: no, type: recall_at_100
value: 2.968
verified: no, type: recall_at_1000
value: 29.017
verified: no, type: recall_at_20
value: 1.484
verified: no, type: recall_at_3
value: 0.409
verified: no, type: recall_at_5
value: 0.512
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB SciFact (default)
revision: 0228b52cf27578f30900b9e5271d331663a030d7
split: test
type: mteb/scifact
metrics: type: main_score
value: 59.348
verified: no, type: map_at_1
value: 45.306000000000004
verified: no, type: map_at_10
value: 54.547000000000004
verified: no, type: map_at_100
value: 55.535000000000004
verified: no, type: map_at_1000
value: 55.582
verified: no, type: map_at_20
value: 55.242000000000004
verified: no, type: map_at_3
value: 51.763000000000005
verified: no, type: map_at_5
value: 53.27499999999999
verified: no, type: mrr_at_1
value: 47
verified: no, type: mrr_at_10
value: 55.67632275132276
verified: no, type: mrr_at_100
value: 56.50056008171798
verified: no, type: mrr_at_1000
value: 56.54270500751058
verified: no, type: mrr_at_20
value: 56.277193298903846
verified: no, type: mrr_at_3
value: 53.22222222222223
verified: no, type: mrr_at_5
value: 54.70555555555556
verified: no, type: ndcg_at_1
value: 47
verified: no, type: ndcg_at_10
value: 59.348
verified: no, type: ndcg_at_100
value: 63.42100000000001
verified: no, type: ndcg_at_1000
value: 64.534
verified: no, type: ndcg_at_20
value: 61.622
verified: no, type: ndcg_at_3
value: 54.117000000000004
verified: no, type: ndcg_at_5
value: 56.669000000000004
verified: no, type: precision_at_1
value: 47
verified: no, type: precision_at_10
value: 8.1
verified: no, type: precision_at_100
value: 1.027
verified: no, type: precision_at_1000
value: 0.11199999999999999
verified: no, type: precision_at_20
value: 4.583
verified: no, type: precision_at_3
value: 21.221999999999998
verified: no, type: precision_at_5
value: 14.2
verified: no, type: recall_at_1
value: 45.306000000000004
verified: no, type: recall_at_10
value: 72.95
verified: no, type: recall_at_100
value: 90.533
verified: no, type: recall_at_1000
value: 99.1
verified: no, type: recall_at_20
value: 81.389
verified: no, type: recall_at_3
value: 58.9
verified: no, type: recall_at_5
value: 65.261
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB SciFact (default)
revision: 0228b52cf27578f30900b9e5271d331663a030d7
split: train
type: mteb/scifact
metrics: type: main_score
value: 61.812999999999995
verified: no, type: map_at_1
value: 45.328
verified: no, type: map_at_10
value: 56.464000000000006
verified: no, type: map_at_100
value: 57.282
verified: no, type: map_at_1000
value: 57.312
verified: no, type: map_at_20
value: 57.019
verified: no, type: map_at_3
value: 53.447
verified: no, type: map_at_5
value: 55.452999999999996
verified: no, type: mrr_at_1
value: 47.83683559950556
verified: no, type: mrr_at_10
value: 58.03147134420309
verified: no, type: mrr_at_100
value: 58.65513617901087
verified: no, type: mrr_at_1000
value: 58.680986977449564
verified: no, type: mrr_at_20
value: 58.47209594120791
verified: no, type: mrr_at_3
value: 55.418211784095575
verified: no, type: mrr_at_5
value: 57.222908941079474
verified: no, type: ndcg_at_1
value: 47.837
verified: no, type: ndcg_at_10
value: 61.812999999999995
verified: no, type: ndcg_at_100
value: 65.254
verified: no, type: ndcg_at_1000
value: 66.116
verified: no, type: ndcg_at_20
value: 63.634
verified: no, type: ndcg_at_3
value: 56.239
verified: no, type: ndcg_at_5
value: 59.550000000000004
verified: no, type: precision_at_1
value: 47.837
verified: no, type: precision_at_10
value: 8.554
verified: no, type: precision_at_100
value: 1.043
verified: no, type: precision_at_1000
value: 0.11199999999999999
verified: no, type: precision_at_20
value: 4.697
verified: no, type: precision_at_3
value: 22.579
verified: no, type: precision_at_5
value: 15.476
verified: no, type: recall_at_1
value: 45.328
verified: no, type: recall_at_10
value: 76.667
verified: no, type: recall_at_100
value: 91.801
verified: no, type: recall_at_1000
value: 98.578
verified: no, type: recall_at_20
value: 83.531
verified: no, type: recall_at_3
value: 61.988
verified: no, type: recall_at_5
value: 69.868
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB SpartQA (default)
revision: 9ab3ca3ccdd0d43f9cd6d346a363935d127f4f45
split: test
type: RAR-b/spartqa
metrics: type: main_score
value: 15.065999999999999
verified: no, type: map_at_1
value: 2.94
verified: no, type: map_at_10
value: 9.815999999999999
verified: no, type: map_at_100
value: 11.514000000000001
verified: no, type: map_at_1000
value: 11.578
verified: no, type: map_at_20
value: 11.016
verified: no, type: map_at_3
value: 6.734999999999999
verified: no, type: map_at_5
value: 8.337
verified: no, type: mrr_at_1
value: 5.982192543127435
verified: no, type: mrr_at_10
value: 13.466734681258858
verified: no, type: mrr_at_100
value: 15.23447840689604
verified: no, type: mrr_at_1000
value: 15.301367917746896
verified: no, type: mrr_at_20
value: 14.71801235668512
verified: no, type: mrr_at_3
value: 9.98423298089408
verified: no, type: mrr_at_5
value: 11.894360971990297
verified: no, type: ndcg_at_1
value: 5.982
verified: no, type: ndcg_at_10
value: 15.065999999999999
verified: no, type: ndcg_at_100
value: 22.867
verified: no, type: ndcg_at_1000
value: 24.808
verified: no, type: ndcg_at_20
value: 19.363
verified: no, type: ndcg_at_3
value: 8.397
verified: no, type: ndcg_at_5
value: 11.453000000000001
verified: no, type: precision_at_1
value: 5.982
verified: no, type: precision_at_10
value: 4.413
verified: no, type: precision_at_100
value: 0.9809999999999999
verified: no, type: precision_at_1000
value: 0.123
verified: no, type: precision_at_20
value: 3.415
verified: no, type: precision_at_3
value: 5.9270000000000005
verified: no, type: precision_at_5
value: 5.659
verified: no, type: recall_at_1
value: 2.94
verified: no, type: recall_at_10
value: 26.951999999999998
verified: no, type: recall_at_100
value: 58.11500000000001
verified: no, type: recall_at_1000
value: 71.777
verified: no, type: recall_at_20
value: 42.042
verified: no, type: recall_at_3
value: 9.915000000000001
verified: no, type: recall_at_5
value: 16.814999999999998
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB StackOverflowQA (default)
revision: db8f169f3894c14a00251061f957b2063eef2bd5
split: test
type: CoIR-Retrieval/stackoverflow-qa
metrics: type: main_score
value: 55.907
verified: no, type: map_at_1
value: 46.991
verified: no, type: map_at_10
value: 52.763000000000005
verified: no, type: map_at_100
value: 53.386
verified: no, type: map_at_1000
value: 53.432
verified: no, type: map_at_20
value: 53.141000000000005
verified: no, type: map_at_3
value: 51.044999999999995
verified: no, type: map_at_5
value: 51.98500000000001
verified: no, type: mrr_at_1
value: 46.99097291875627
verified: no, type: mrr_at_10
value: 52.76291175112643
verified: no, type: mrr_at_100
value: 53.386278433480506
verified: no, type: mrr_at_1000
value: 53.431881088094414
verified: no, type: mrr_at_20
value: 53.140779558381865
verified: no, type: mrr_at_3
value: 51.04480106987634
verified: no, type: mrr_at_5
value: 51.985122032765055
verified: no, type: ndcg_at_1
value: 46.991
verified: no, type: ndcg_at_10
value: 55.907
verified: no, type: ndcg_at_100
value: 59.019
verified: no, type: ndcg_at_1000
value: 60.416000000000004
verified: no, type: ndcg_at_20
value: 57.269999999999996
verified: no, type: ndcg_at_3
value: 52.337
verified: no, type: ndcg_at_5
value: 54.053
verified: no, type: precision_at_1
value: 46.991
verified: no, type: precision_at_10
value: 6.595
verified: no, type: precision_at_100
value: 0.807
verified: no, type: precision_at_1000
value: 0.092
verified: no, type: precision_at_20
value: 3.566
verified: no, type: precision_at_3
value: 18.689
verified: no, type: precision_at_5
value: 12.056000000000001
verified: no, type: recall_at_1
value: 46.991
verified: no, type: recall_at_10
value: 65.948
verified: no, type: recall_at_100
value: 80.692
verified: no, type: recall_at_1000
value: 92.07600000000001
verified: no, type: recall_at_20
value: 71.314
verified: no, type: recall_at_3
value: 56.068
verified: no, type: recall_at_5
value: 60.281
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB SyntheticText2SQL (default)
revision: 686b87296c3a0191b5d9415a00526c62db9fce09
split: test
type: CoIR-Retrieval/synthetic-text2sql
metrics: type: main_score
value: 35.068
verified: no, type: map_at_1
value: 2.547
verified: no, type: map_at_10
value: 26.267000000000003
verified: no, type: map_at_100
value: 27.162999999999997
verified: no, type: map_at_1000
value: 27.229
verified: no, type: map_at_20
value: 26.789
verified: no, type: map_at_3
value: 23.717
verified: no, type: map_at_5
value: 25.237
verified: no, type: mrr_at_1
value: 21.329687232951635
verified: no, type: mrr_at_10
value: 36.61716352922974
verified: no, type: mrr_at_100
value: 37.472046007482554
verified: no, type: mrr_at_1000
value: 37.53687081095924
verified: no, type: mrr_at_20
value: 37.10337925231122
verified: no, type: mrr_at_3
value: 34.30752577906894
verified: no, type: mrr_at_5
value: 35.66712242921432
verified: no, type: ndcg_at_1
value: 2.547
verified: no, type: ndcg_at_10
value: 35.068
verified: no, type: ndcg_at_100
value: 39.708
verified: no, type: ndcg_at_1000
value: 41.454
verified: no, type: ndcg_at_20
value: 36.943
verified: no, type: ndcg_at_3
value: 29.837000000000003
verified: no, type: ndcg_at_5
value: 32.583
verified: no, type: precision_at_1
value: 2.547
verified: no, type: precision_at_10
value: 6.165
verified: no, type: precision_at_100
value: 0.84
verified: no, type: precision_at_1000
value: 0.098
verified: no, type: precision_at_20
value: 3.451
verified: no, type: precision_at_3
value: 15.769
verified: no, type: precision_at_5
value: 10.798
verified: no, type: recall_at_1
value: 2.547
verified: no, type: recall_at_10
value: 61.648
verified: no, type: recall_at_100
value: 84.03699999999999
verified: no, type: recall_at_1000
value: 97.77799999999999
verified: no, type: recall_at_20
value: 69.014
verified: no, type: recall_at_3
value: 47.308
verified: no, type: recall_at_5
value: 53.991
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB TRECCOVID (default)
revision: bb9466bac8153a0349341eb1b22e06409e78ef4e
split: test
type: mteb/trec-covid
metrics: type: main_score
value: 44.603
verified: no, type: map_at_1
value: 0.128
verified: no, type: map_at_10
value: 1.012
verified: no, type: map_at_100
value: 4.585999999999999
verified: no, type: map_at_1000
value: 11.622
verified: no, type: map_at_20
value: 1.611
verified: no, type: map_at_3
value: 0.35500000000000004
verified: no, type: map_at_5
value: 0.586
verified: no, type: mrr_at_1
value: 50
verified: no, type: mrr_at_10
value: 61.15555555555555
verified: no, type: mrr_at_100
value: 61.673274833274824
verified: no, type: mrr_at_1000
value: 61.70384154456443
verified: no, type: mrr_at_20
value: 61.43174603174602
verified: no, type: mrr_at_3
value: 59.33333333333333
verified: no, type: mrr_at_5
value: 60.73333333333333
verified: no, type: ndcg_at_1
value: 45
verified: no, type: ndcg_at_10
value: 44.603
verified: no, type: ndcg_at_100
value: 32.218
verified: no, type: ndcg_at_1000
value: 28.721999999999998
verified: no, type: ndcg_at_20
value: 40.752
verified: no, type: ndcg_at_3
value: 45.641999999999996
verified: no, type: ndcg_at_5
value: 45.903
verified: no, type: precision_at_1
value: 50
verified: no, type: precision_at_10
value: 48.4
verified: no, type: precision_at_100
value: 33.339999999999996
verified: no, type: precision_at_1000
value: 13.794
verified: no, type: precision_at_20
value: 43.3
verified: no, type: precision_at_3
value: 51.333
verified: no, type: precision_at_5
value: 51.6
verified: no, type: recall_at_1
value: 0.128
verified: no, type: recall_at_10
value: 1.226
verified: no, type: recall_at_100
value: 7.185999999999999
verified: no, type: recall_at_1000
value: 27.279999999999998
verified: no, type: recall_at_20
value: 2.088
verified: no, type: recall_at_3
value: 0.40299999999999997
verified: no, type: recall_at_5
value: 0.69
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB TempReasonL1 (default)
revision: 9097e99aa8c9d827189c65f2e11bfe756af439f6
split: test
type: RAR-b/TempReason-l1
metrics: type: main_score
value: 1.8399999999999999
verified: no, type: map_at_1
value: 0
verified: no, type: map_at_10
value: 1.0370000000000001
verified: no, type: map_at_100
value: 1.275
verified: no, type: map_at_1000
value: 1.322
verified: no, type: map_at_20
value: 1.16
verified: no, type: map_at_3
value: 0.512
verified: no, type: map_at_5
value: 0.767
verified: no, type: mrr_at_1
value: 0
verified: no, type: mrr_at_10
value: 1.036884920634922
verified: no, type: mrr_at_100
value: 1.274587207544468
verified: no, type: mrr_at_1000
value: 1.3215562619414125
verified: no, type: mrr_at_20
value: 1.1597194843769947
verified: no, type: mrr_at_3
value: 0.5125
verified: no, type: mrr_at_5
value: 0.7674999999999993
verified: no, type: ndcg_at_1
value: 0
verified: no, type: ndcg_at_10
value: 1.8399999999999999
verified: no, type: ndcg_at_100
value: 3.206
verified: no, type: ndcg_at_1000
value: 4.7940000000000005
verified: no, type: ndcg_at_20
value: 2.2800000000000002
verified: no, type: ndcg_at_3
value: 0.7000000000000001
verified: no, type: ndcg_at_5
value: 1.167
verified: no, type: precision_at_1
value: 0
verified: no, type: precision_at_10
value: 0.45199999999999996
verified: no, type: precision_at_100
value: 0.11399999999999999
verified: no, type: precision_at_1000
value: 0.025
verified: no, type: precision_at_20
value: 0.313
verified: no, type: precision_at_3
value: 0.41700000000000004
verified: no, type: precision_at_5
value: 0.48
verified: no, type: recall_at_1
value: 0
verified: no, type: recall_at_10
value: 4.5249999999999995
verified: no, type: recall_at_100
value: 11.450000000000001
verified: no, type: recall_at_1000
value: 24.75
verified: no, type: recall_at_20
value: 6.25
verified: no, type: recall_at_3
value: 1.25
verified: no, type: recall_at_5
value: 2.4
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB TempReasonL2Context (default)
revision: f2dc4764024ae93cc42d9c09bc53a31da1af84b2
split: test
type: RAR-b/TempReason-l2-context
metrics: type: main_score
value: 10.853
verified: no, type: map_at_1
value: 4.317
verified: no, type: map_at_10
value: 8.261000000000001
verified: no, type: map_at_100
value: 9.324
verified: no, type: map_at_1000
value: 9.443
verified: no, type: map_at_20
value: 8.738999999999999
verified: no, type: map_at_3
value: 6.658
verified: no, type: map_at_5
value: 7.475
verified: no, type: mrr_at_1
value: 4.317213266629609
verified: no, type: mrr_at_10
value: 8.260541570713873
verified: no, type: mrr_at_100
value: 9.324279575140654
verified: no, type: mrr_at_1000
value: 9.44289907211348
verified: no, type: mrr_at_20
value: 8.738944029983301
verified: no, type: mrr_at_3
value: 6.658019887591863
verified: no, type: mrr_at_5
value: 7.475140510159946
verified: no, type: ndcg_at_1
value: 4.317
verified: no, type: ndcg_at_10
value: 10.853
verified: no, type: ndcg_at_100
value: 17.087
verified: no, type: ndcg_at_1000
value: 20.593
verified: no, type: ndcg_at_20
value: 12.598999999999998
verified: no, type: ndcg_at_3
value: 7.467
verified: no, type: ndcg_at_5
value: 8.931000000000001
verified: no, type: precision_at_1
value: 4.317
verified: no, type: precision_at_10
value: 1.934
verified: no, type: precision_at_100
value: 0.51
verified: no, type: precision_at_1000
value: 0.079
verified: no, type: precision_at_20
value: 1.313
verified: no, type: precision_at_3
value: 3.273
verified: no, type: precision_at_5
value: 2.672
verified: no, type: recall_at_1
value: 4.317
verified: no, type: recall_at_10
value: 19.344
verified: no, type: recall_at_100
value: 50.973
verified: no, type: recall_at_1000
value: 79.35900000000001
verified: no, type: recall_at_20
value: 26.255
verified: no, type: recall_at_3
value: 9.82
verified: no, type: recall_at_5
value: 13.358999999999998
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB TempReasonL2Fact (default)
revision: 13758bcf978613b249d0de4d0840f57815122bdf
split: test
type: RAR-b/TempReason-l2-fact
metrics: type: main_score
value: 6.4430000000000005
verified: no, type: map_at_1
value: 1.538
verified: no, type: map_at_10
value: 4.381
verified: no, type: map_at_100
value: 5.583
verified: no, type: map_at_1000
value: 5.755
verified: no, type: map_at_20
value: 4.888
verified: no, type: map_at_3
value: 3.042
verified: no, type: map_at_5
value: 3.6929999999999996
verified: no, type: mrr_at_1
value: 1.5378914211599035
verified: no, type: mrr_at_10
value: 4.380615627141467
verified: no, type: mrr_at_100
value: 5.582481340163152
verified: no, type: mrr_at_1000
value: 5.7543358690140085
verified: no, type: mrr_at_20
value: 4.888341522384855
verified: no, type: mrr_at_3
value: 3.041813353097401
verified: no, type: mrr_at_5
value: 3.693101105552468
verified: no, type: ndcg_at_1
value: 1.538
verified: no, type: ndcg_at_10
value: 6.4430000000000005
verified: no, type: ndcg_at_100
value: 14.17
verified: no, type: ndcg_at_1000
value: 18.682000000000002
verified: no, type: ndcg_at_20
value: 8.291
verified: no, type: ndcg_at_3
value: 3.5709999999999997
verified: no, type: ndcg_at_5
value: 4.749
verified: no, type: precision_at_1
value: 1.538
verified: no, type: precision_at_10
value: 1.329
verified: no, type: precision_at_100
value: 0.541
verified: no, type: precision_at_1000
value: 0.09
verified: no, type: precision_at_20
value: 1.0290000000000001
verified: no, type: precision_at_3
value: 1.7049999999999998
verified: no, type: precision_at_5
value: 1.5970000000000002
verified: no, type: recall_at_1
value: 1.538
verified: no, type: recall_at_10
value: 13.285
verified: no, type: recall_at_100
value: 54.14099999999999
verified: no, type: recall_at_1000
value: 89.642
verified: no, type: recall_at_20
value: 20.586
verified: no, type: recall_at_3
value: 5.114
verified: no, type: recall_at_5
value: 7.986
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB TempReasonL2Pure (default)
revision: 27668949b97bfb178901e0cf047cbee805305dc1
split: test
type: RAR-b/TempReason-l2-pure
metrics: type: main_score
value: 0.211
verified: no, type: map_at_1
value: 0.055999999999999994
verified: no, type: map_at_10
value: 0.14100000000000001
verified: no, type: map_at_100
value: 0.259
verified: no, type: map_at_1000
value: 0.337
verified: no, type: map_at_20
value: 0.179
verified: no, type: map_at_3
value: 0.10200000000000001
verified: no, type: map_at_5
value: 0.11
verified: no, type: mrr_at_1
value: 0.055586436909394105
verified: no, type: mrr_at_10
value: 0.14145865869045413
verified: no, type: mrr_at_100
value: 0.2592058422890182
verified: no, type: mrr_at_1000
value: 0.33682005085387395
verified: no, type: mrr_at_20
value: 0.17880657618592516
verified: no, type: mrr_at_3
value: 0.10190846766722254
verified: no, type: mrr_at_5
value: 0.11024643320363164
verified: no, type: ndcg_at_1
value: 0.055999999999999994
verified: no, type: ndcg_at_10
value: 0.211
verified: no, type: ndcg_at_100
value: 1.088
verified: no, type: ndcg_at_1000
value: 3.7859999999999996
verified: no, type: ndcg_at_20
value: 0.356
verified: no, type: ndcg_at_3
value: 0.11800000000000001
verified: no, type: ndcg_at_5
value: 0.134
verified: no, type: precision_at_1
value: 0.055999999999999994
verified: no, type: precision_at_10
value: 0.044000000000000004
verified: no, type: precision_at_100
value: 0.053
verified: no, type: precision_at_1000
value: 0.027999999999999997
verified: no, type: precision_at_20
value: 0.052
verified: no, type: precision_at_3
value: 0.055999999999999994
verified: no, type: precision_at_5
value: 0.041
verified: no, type: recall_at_1
value: 0.055999999999999994
verified: no, type: recall_at_10
value: 0.445
verified: no, type: recall_at_100
value: 5.299
verified: no, type: recall_at_1000
value: 27.979
verified: no, type: recall_at_20
value: 1.038
verified: no, type: recall_at_3
value: 0.167
verified: no, type: recall_at_5
value: 0.20400000000000001
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB TempReasonL3Context (default)
revision: 3c42539652de3d787cecfb897d3b20905e5c7250
split: test
type: RAR-b/TempReason-l3-context
metrics: type: main_score
value: 8.985999999999999
verified: no, type: map_at_1
value: 2.915
verified: no, type: map_at_10
value: 6.546
verified: no, type: map_at_100
value: 7.591
verified: no, type: map_at_1000
value: 7.71
verified: no, type: map_at_20
value: 7.015000000000001
verified: no, type: map_at_3
value: 5.065
verified: no, type: map_at_5
value: 5.779999999999999
verified: no, type: mrr_at_1
value: 2.914595571622232
verified: no, type: mrr_at_10
value: 6.546229351810003
verified: no, type: mrr_at_100
value: 7.590639752125733
verified: no, type: mrr_at_1000
value: 7.7100662080438696
verified: no, type: mrr_at_20
value: 7.014767909905029
verified: no, type: mrr_at_3
value: 5.064768790480501
verified: no, type: mrr_at_5
value: 5.7798614249133955
verified: no, type: ndcg_at_1
value: 2.915
verified: no, type: ndcg_at_10
value: 8.985999999999999
verified: no, type: ndcg_at_100
value: 15.088
verified: no, type: ndcg_at_1000
value: 18.618000000000002
verified: no, type: ndcg_at_20
value: 10.708
verified: no, type: ndcg_at_3
value: 5.825
verified: no, type: ndcg_at_5
value: 7.116
verified: no, type: precision_at_1
value: 2.915
verified: no, type: precision_at_10
value: 1.699
verified: no, type: precision_at_100
value: 0.479
verified: no, type: precision_at_1000
value: 0.076
verified: no, type: precision_at_20
value: 1.192
verified: no, type: precision_at_3
value: 2.681
verified: no, type: precision_at_5
value: 2.237
verified: no, type: recall_at_1
value: 2.915
verified: no, type: recall_at_10
value: 16.991
verified: no, type: recall_at_100
value: 47.876000000000005
verified: no, type: recall_at_1000
value: 76.48
verified: no, type: recall_at_20
value: 23.836
verified: no, type: recall_at_3
value: 8.043
verified: no, type: recall_at_5
value: 11.184
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB TempReasonL3Fact (default)
revision: 4b70e90197901da24f3cfcd51d27111292878680
split: test
type: RAR-b/TempReason-l3-fact
metrics: type: main_score
value: 6.9239999999999995
verified: no, type: map_at_1
value: 0.9490000000000001
verified: no, type: map_at_10
value: 4.482
verified: no, type: map_at_100
value: 5.673
verified: no, type: map_at_1000
value: 5.831
verified: no, type: map_at_20
value: 4.97
verified: no, type: map_at_3
value: 2.862
verified: no, type: map_at_5
value: 3.673
verified: no, type: mrr_at_1
value: 0.9489380930863082
verified: no, type: mrr_at_10
value: 4.4841269841269815
verified: no, type: mrr_at_100
value: 5.672705016400986
verified: no, type: mrr_at_1000
value: 5.831192204277269
verified: no, type: mrr_at_20
value: 4.970528777573662
verified: no, type: mrr_at_3
value: 2.8618767886729892
verified: no, type: mrr_at_5
value: 3.6729929206205796
verified: no, type: ndcg_at_1
value: 0.9490000000000001
verified: no, type: ndcg_at_10
value: 6.9239999999999995
verified: no, type: ndcg_at_100
value: 14.408000000000001
verified: no, type: ndcg_at_1000
value: 18.734
verified: no, type: ndcg_at_20
value: 8.698
verified: no, type: ndcg_at_3
value: 3.512
verified: no, type: ndcg_at_5
value: 4.978
verified: no, type: precision_at_1
value: 0.9490000000000001
verified: no, type: precision_at_10
value: 1.496
verified: no, type: precision_at_100
value: 0.541
verified: no, type: precision_at_1000
value: 0.08800000000000001
verified: no, type: precision_at_20
value: 1.098
verified: no, type: precision_at_3
value: 1.7999999999999998
verified: no, type: precision_at_5
value: 1.794
verified: no, type: recall_at_1
value: 0.9490000000000001
verified: no, type: recall_at_10
value: 14.957
verified: no, type: recall_at_100
value: 54.089
verified: no, type: recall_at_1000
value: 88.47699999999999
verified: no, type: recall_at_20
value: 21.961
verified: no, type: recall_at_3
value: 5.4
verified: no, type: recall_at_5
value: 8.97
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB TempReasonL3Pure (default)
revision: 68fba138e7e63daccecfbdad0a9d2714e56e34ff
split: test
type: RAR-b/TempReason-l3-pure
metrics: type: main_score
value: 3.9510000000000005
verified: no, type: map_at_1
value: 0.045
verified: no, type: map_at_10
value: 2.464
verified: no, type: map_at_100
value: 3.159
verified: no, type: map_at_1000
value: 3.2649999999999997
verified: no, type: map_at_20
value: 2.7439999999999998
verified: no, type: map_at_3
value: 1.5779999999999998
verified: no, type: map_at_5
value: 2.075
verified: no, type: mrr_at_1
value: 0.045187528242205156
verified: no, type: mrr_at_10
value: 2.4634465173326463
verified: no, type: mrr_at_100
value: 3.1587507355194098
verified: no, type: mrr_at_1000
value: 3.2645570477304884
verified: no, type: mrr_at_20
value: 2.7446874866280555
verified: no, type: mrr_at_3
value: 1.5777978611236638
verified: no, type: mrr_at_5
value: 2.07486067178792
verified: no, type: ndcg_at_1
value: 0.045
verified: no, type: ndcg_at_10
value: 3.9510000000000005
verified: no, type: ndcg_at_100
value: 8.116
verified: no, type: ndcg_at_1000
value: 11.599
verified: no, type: ndcg_at_20
value: 4.977
verified: no, type: ndcg_at_3
value: 2.11
verified: no, type: ndcg_at_5
value: 3.005
verified: no, type: precision_at_1
value: 0.045
verified: no, type: precision_at_10
value: 0.877
verified: no, type: precision_at_100
value: 0.3
verified: no, type: precision_at_1000
value: 0.059000000000000004
verified: no, type: precision_at_20
value: 0.642
verified: no, type: precision_at_3
value: 1.22
verified: no, type: precision_at_5
value: 1.166
verified: no, type: recall_at_1
value: 0.045
verified: no, type: recall_at_10
value: 8.766
verified: no, type: recall_at_100
value: 30.005
verified: no, type: recall_at_1000
value: 58.925000000000004
verified: no, type: recall_at_20
value: 12.833
verified: no, type: recall_at_3
value: 3.66
verified: no, type: recall_at_5
value: 5.829
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB TopiOCQAHardNegatives (default)
revision: b4cc09fb8bb3a9e0ce0f94dc69c96397a2a47c18
split: validation
type: mteb/TopiOCQA_validation_top_250_only_w_correct-v2
metrics: type: main_score
value: 10.59
verified: no, type: map_at_1
value: 4.3
verified: no, type: map_at_10
value: 8.134
verified: no, type: map_at_100
value: 8.967
verified: no, type: map_at_1000
value: 9.154
verified: no, type: map_at_20
value: 8.498999999999999
verified: no, type: map_at_3
value: 6.550000000000001
verified: no, type: map_at_5
value: 7.385
verified: no, type: mrr_at_1
value: 4.3
verified: no, type: mrr_at_10
value: 8.133968253968261
verified: no, type: mrr_at_100
value: 8.966515392145464
verified: no, type: mrr_at_1000
value: 9.153606984319149
verified: no, type: mrr_at_20
value: 8.49921878517081
verified: no, type: mrr_at_3
value: 6.550000000000002
verified: no, type: mrr_at_5
value: 7.385000000000004
verified: no, type: ndcg_at_1
value: 4.3
verified: no, type: ndcg_at_10
value: 10.59
verified: no, type: ndcg_at_100
value: 15.728
verified: no, type: ndcg_at_1000
value: 21.025
verified: no, type: ndcg_at_20
value: 11.944
verified: no, type: ndcg_at_3
value: 7.282
verified: no, type: ndcg_at_5
value: 8.797
verified: no, type: precision_at_1
value: 4.3
verified: no, type: precision_at_10
value: 1.8599999999999999
verified: no, type: precision_at_100
value: 0.45199999999999996
verified: no, type: precision_at_1000
value: 0.087
verified: no, type: precision_at_20
value: 1.2
verified: no, type: precision_at_3
value: 3.1329999999999996
verified: no, type: precision_at_5
value: 2.62
verified: no, type: recall_at_1
value: 4.3
verified: no, type: recall_at_10
value: 18.6
verified: no, type: recall_at_100
value: 45.2
verified: no, type: recall_at_1000
value: 87.4
verified: no, type: recall_at_20
value: 24
verified: no, type: recall_at_3
value: 9.4
verified: no, type: recall_at_5
value: 13.100000000000001
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB Touche2020 (default)
revision: a34f9a33db75fa0cbb21bb5cfc3dae8dc8bec93f
split: test
type: mteb/touche2020
metrics: type: main_score
value: 22.398
verified: no, type: map_at_1
value: 2.067
verified: no, type: map_at_10
value: 8.579
verified: no, type: map_at_100
value: 15.012
verified: no, type: map_at_1000
value: 16.706
verified: no, type: map_at_20
value: 10.653
verified: no, type: map_at_3
value: 3.909
verified: no, type: map_at_5
value: 6.077
verified: no, type: mrr_at_1
value: 28.57142857142857
verified: no, type: mrr_at_10
value: 43.01830255911888
verified: no, type: mrr_at_100
value: 43.96547082263703
verified: no, type: mrr_at_1000
value: 43.96547082263703
verified: no, type: mrr_at_20
value: 43.71604198403339
verified: no, type: mrr_at_3
value: 37.41496598639456
verified: no, type: mrr_at_5
value: 41.496598639455776
verified: no, type: ndcg_at_1
value: 24.490000000000002
verified: no, type: ndcg_at_10
value: 22.398
verified: no, type: ndcg_at_100
value: 36.604
verified: no, type: ndcg_at_1000
value: 48.111
verified: no, type: ndcg_at_20
value: 23.369999999999997
verified: no, type: ndcg_at_3
value: 21.378
verified: no, type: ndcg_at_5
value: 23.685000000000002
verified: no, type: precision_at_1
value: 28.571
verified: no, type: precision_at_10
value: 21.224
verified: no, type: precision_at_100
value: 8.408
verified: no, type: precision_at_1000
value: 1.59
verified: no, type: precision_at_20
value: 16.735
verified: no, type: precision_at_3
value: 23.128999999999998
verified: no, type: precision_at_5
value: 26.122
verified: no, type: recall_at_1
value: 2.067
verified: no, type: recall_at_10
value: 15.182
verified: no, type: recall_at_100
value: 50.768
verified: no, type: recall_at_1000
value: 86.29299999999999
verified: no, type: recall_at_20
value: 22.32
verified: no, type: recall_at_3
value: 4.865
verified: no, type: recall_at_5
value: 9.24
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB Touche2020Retrieval.v3 (default)
revision: 431886eaecc48f067a3975b70d0949ea2862463c
split: test
type: mteb/webis-touche2020-v3
metrics: type: main_score
value: 52.575
verified: no, type: map_at_1
value: 2.026
verified: no, type: map_at_10
value: 15.136
verified: no, type: map_at_100
value: 31.539
verified: no, type: map_at_1000
value: 34.672
verified: no, type: map_at_20
value: 21.477
verified: no, type: map_at_3
value: 5.931
verified: no, type: map_at_5
value: 9.476999999999999
verified: no, type: mrr_at_1
value: 63.26530612244898
verified: no, type: mrr_at_10
value: 77.57045675413023
verified: no, type: mrr_at_100
value: 77.75598551108757
verified: no, type: mrr_at_1000
value: 77.75598551108757
verified: no, type: mrr_at_20
value: 77.75598551108757
verified: no, type: mrr_at_3
value: 75.85034013605441
verified: no, type: mrr_at_5
value: 77.27891156462586
verified: no, type: ndcg_at_1
value: 54.081999999999994
verified: no, type: ndcg_at_10
value: 52.575
verified: no, type: ndcg_at_100
value: 55.051
verified: no, type: ndcg_at_1000
value: 67.027
verified: no, type: ndcg_at_20
value: 46.561
verified: no, type: ndcg_at_3
value: 58.48799999999999
verified: no, type: ndcg_at_5
value: 57.115
verified: no, type: precision_at_1
value: 63.26500000000001
verified: no, type: precision_at_10
value: 56.531
verified: no, type: precision_at_100
value: 18.898
verified: no, type: precision_at_1000
value: 3.084
verified: no, type: precision_at_20
value: 44.082
verified: no, type: precision_at_3
value: 68.027
verified: no, type: precision_at_5
value: 65.714
verified: no, type: recall_at_1
value: 2.026
verified: no, type: recall_at_10
value: 19.494
verified: no, type: recall_at_100
value: 59.349
verified: no, type: recall_at_1000
value: 89.84
verified: no, type: recall_at_20
value: 29.953000000000003
verified: no, type: recall_at_3
value: 6.819999999999999
verified: no, type: recall_at_5
value: 11.386000000000001
verified: no
task: type: Retrieval, dataset: config: default
name: MTEB WinoGrande (default)
revision: f74c094f321077cf909ddfb8bccc1b5912a4ac28
split: test
type: RAR-b/winogrande
metrics: type: main_score
value: 61.800999999999995
verified: no, type: map_at_1
value: 29.044999999999998
verified: no, type: map_at_10
value: 51.514
verified: no, type: map_at_100
value: 51.896
verified: no, type: map_at_1000
value: 51.897000000000006
verified: no, type: map_at_20
value: 51.842
verified: no, type: map_at_3
value: 46.803
verified: no, type: map_at_5
value: 49.957
verified: no, type: mrr_at_1
value: 29.36069455406472
verified: no, type: mrr_at_10
value: 51.617619423460056
verified: no, type: mrr_at_100
value: 52.01415572431666
verified: no, type: mrr_at_1000
value: 52.014274589675495
verified: no, type: mrr_at_20
value: 51.95996098874236
verified: no, type: mrr_at_3
value: 46.86924493554325
verified: no, type: mrr_at_5
value: 50.04209418574064
verified: no, type: ndcg_at_1
value: 29.044999999999998
verified: no, type: ndcg_at_10
value: 61.800999999999995
verified: no, type: ndcg_at_100
value: 63.315
verified: no, type: ndcg_at_1000
value: 63.324000000000005
verified: no, type: ndcg_at_20
value: 62.986
verified: no, type: ndcg_at_3
value: 52.525
verified: no, type: ndcg_at_5
value: 58.160999999999994
verified: no, type: precision_at_1
value: 29.044999999999998
verified: no, type: precision_at_10
value: 9.361
verified: no, type: precision_at_100
value: 0.9990000000000001
verified: no, type: precision_at_1000
value: 0.1
verified: no, type: precision_at_20
value: 4.913
verified: no, type: precision_at_3
value: 23.02
verified: no, type: precision_at_5
value: 16.527
verified: no, type: recall_at_1
value: 29.044999999999998
verified: no, type: recall_at_10
value: 93.607
verified: no, type: recall_at_100
value: 99.921
verified: no, type: recall_at_1000
value: 100
verified: no, type: recall_at_20
value: 98.264
verified: no, type: recall_at_3
value: 69.06099999999999
verified: no, type: recall_at_5
value: 82.636
verified: no
task: type: Retrieval
Likes: 52 | All-time downloads: 0
Created: 2024-10-24 07:17:18