Model: sparse-encoder/example-splade-distilbert-base-uncased-nq
Author: sparse-encoder
Pipeline: feature-extraction
Library: sentence-transformers
Tags: sentence-transformers, safetensors, distilbert, sparse-encoder, sparse, splade, generated_from_trainer, dataset_size:99000, loss:SpladeLoss, loss:SparseMultipleNegativesRankingLoss, loss:FlopsLoss, feature-extraction, en, dataset:sentence-transformers/natural-questions, arxiv:1908.10084, arxiv:2205.04733, arxiv:1705.00652, arxiv:2004.05665, base_model:distilbert/distilbert-base-uncased, base_model:finetune:distilbert/distilbert-base-uncased, license:apache-2.0, model-index, co2_eq_emissions, text-embeddings-inference, endpoints_compatible, region:us
Base models (finetune): id: distilbert/distilbert-base-uncased
Card metadata: language: en
license: apache-2.0
tags: sentence-transformers, sparse-encoder, sparse, splade, generated_from_trainer, dataset_size:99000, loss:SpladeLoss, loss:SparseMultipleNegativesRankingLoss, loss:FlopsLoss
base_model: distilbert/distilbert-base-uncased
widget: Rollin' (Limp Bizkit song) The music video was filmed atop the South Tower of the former World Trade Center in New York City. The introduction features Ben Stiller and Stephen Dorff mistaking Fred Durst for the valet and giving him the keys to their Bentley Azure. Also making a cameo is break dancer Mr. Wiggles. The rest of the video has several cuts to Durst and his bandmates hanging out of the Bentley as they drive about Manhattan. The song Ben Stiller is playing at the beginning is "My Generation" from the same album. The video also features scenes of Fred Durst with five girls dancing in a room. The video was filmed around the same time as the film Zoolander, which explains Stiller and Dorff's appearance. Fred Durst has a small cameo in that film., Maze Runner: The Death Cure On April 22, 2017, the studio delayed the release date once again, to February 9, 2018, in order to allow more time for post-production; months later, on August 25, the studio moved the release forward two weeks.[17] The film will premiere on January 26, 2018 in 3D, IMAX and IMAX 3D.[18][19], who played the dj in the movie the warriors, Lionel Messi Born and raised in central Argentina, Messi was diagnosed with a growth hormone deficiency as a child. At age 13, he relocated to Spain to join Barcelona, who agreed to pay for his medical treatment. After a fast progression through Barcelona's youth academy, Messi made his competitive debut aged 17 in October 2004. Despite being injury-prone during his early career, he established himself as an integral player for the club within the next three years, finishing 2007 as a finalist for both the Ballon d'Or and FIFA World Player of the Year award, a feat he repeated the following year. His first uninterrupted campaign came in the 2008â€“09 season, during which he helped Barcelona achieve the first treble in Spanish football. At 22 years old, Messi won the Ballon d'Or and FIFA World Player of the Year award by record voting margins., Send In the Clowns "Send In the Clowns" is a song written by Stephen Sondheim for the 1973 musical A Little Night Music, an adaptation of Ingmar Bergman's film Smiles of a Summer Night. It is a ballad from Act Two, in which the character Desirée reflects on the ironies and disappointments of her life. Among other things, she looks back on an affair years earlier with the lawyer Fredrik, who was deeply in love with her but whose marriage proposals she had rejected. Meeting him after so long, she realizes she is in love with him and finally ready to marry him, but now it is he who rejects her: he is in an unconsummated marriage with a much younger woman. Desirée proposes marriage to rescue him from this situation, but he declines, citing his dedication to his bride. Reacting to his rejection, Desirée sings this song. The song is later reprised as a coda after Fredrik's young wife runs away with his son, and Fredrik is finally free to accept Desirée's offer.[1]
datasets: sentence-transformers/natural-questions
pipeline_tag: feature-extraction
library_name: sentence-transformers
metrics: dot_accuracy@1, dot_accuracy@3, dot_accuracy@5, dot_accuracy@10, dot_precision@1, dot_precision@3, dot_precision@5, dot_precision@10, dot_recall@1, dot_recall@3, dot_recall@5, dot_recall@10, dot_ndcg@10, dot_mrr@10, dot_map@100, query_active_dims, query_sparsity_ratio, corpus_active_dims, corpus_sparsity_ratio
co2_eq_emissions: emissions: 2.229070129979357
energy_consumed: 0.0397771218255029
source: codecarbon
training_type: fine-tuning
on_cloud: no
cpu_model: AMD Ryzen 9 6900HX with Radeon Graphics
ram_total_size: 30.6114501953125
hours_used: 0.322
hardware_used: 1 x NVIDIA GeForce RTX 3070 Ti Laptop GPU
model-index: name: splade-distilbert-base-uncased trained on Natural Questions
results: task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoMSMARCO
type: NanoMSMARCO
metrics: type: dot_accuracy@1
value: 0.28
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.5
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.66
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.74
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.28
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.16666666666666663
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.132
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.07400000000000001
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.28
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.5
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.66
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.74
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.49577037509991184
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.4185238095238094
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.4294303031277172
name: Dot Map@100
verified: no, type: query_active_dims
value: 52.560001373291016
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9982779633912164
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 106.13404846191406
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9965227033463759
name: Corpus Sparsity Ratio
verified: no, type: dot_accuracy@1
value: 0.28
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.5
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.66
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.74
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.28
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.16666666666666663
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.132
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.07400000000000001
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.28
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.5
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.66
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.74
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.49577037509991184
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.4185238095238094
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.4294303031277172
name: Dot Map@100
verified: no, type: query_active_dims
value: 52.560001373291016
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9982779633912164
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 106.13404846191406
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9965227033463759
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoNFCorpus
type: NanoNFCorpus
metrics: type: dot_accuracy@1
value: 0.38
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.46
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.52
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.62
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.38
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.31999999999999995
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.292
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.236
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.0242331024704017
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.053060546044216006
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.07273890139350063
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.09593681264940912
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.2784960942139155
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.4393888888888889
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.11744499575471842
name: Dot Map@100
verified: no, type: query_active_dims
value: 62.5
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9979522967040168
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 126.24652862548828
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9958637530756345
name: Corpus Sparsity Ratio
verified: no, type: dot_accuracy@1
value: 0.38
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.46
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.52
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.62
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.38
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.31999999999999995
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.292
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.236
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.0242331024704017
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.053060546044216006
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.07273890139350063
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.09593681264940912
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.2784960942139155
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.4393888888888889
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.11744499575471842
name: Dot Map@100
verified: no, type: query_active_dims
value: 62.5
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9979522967040168
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 126.24652862548828
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9958637530756345
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoNQ
type: NanoNQ
metrics: type: dot_accuracy@1
value: 0.36
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.58
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.66
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.76
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.36
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.2
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.14
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.08
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.34
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.56
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.64
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.72
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.5341909779287488
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.4836666666666667
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.47986132889672267
name: Dot Map@100
verified: no, type: query_active_dims
value: 45.63999938964844
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9985046851651384
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 104.37854766845703
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9965802192625498
name: Corpus Sparsity Ratio
verified: no, type: dot_accuracy@1
value: 0.36
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.58
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.66
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.76
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.36
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.2
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.14
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.08
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.34
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.56
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.64
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.72
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.5341909779287488
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.4836666666666667
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.47986132889672267
name: Dot Map@100
verified: no, type: query_active_dims
value: 45.63999938964844
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9985046851651384
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 104.37854766845703
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9965802192625498
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-nano-beir
name: Sparse Nano BEIR
dataset: name: NanoBEIR mean
type: NanoBEIR_mean
metrics: type: dot_accuracy@1
value: 0.34
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.5133333333333333
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.6133333333333334
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.7066666666666667
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.34
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.22888888888888884
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.18800000000000003
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.13
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.21474436749013393
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.3710201820147387
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.45757963379783356
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.5186456042164697
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.436152482414192
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.4471931216931217
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.3422455425930528
name: Dot Map@100
verified: no, type: query_active_dims
value: 53.56666692097982
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9982449817534571
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 110.01350571216182
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9963955997080087
name: Corpus Sparsity Ratio
verified: no, type: dot_accuracy@1
value: 0.44241758241758244
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.6319937205651491
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.6982103610675039
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.7922762951334378
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.44241758241758244
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.28906331763474624
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.22349764521193094
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.1596828885400314
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.24762543099163964
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.4029567497606036
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.47356029516066417
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.5593700517107145
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.4973635297458972
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.5535014203483591
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.41852441580546024
name: Dot Map@100
verified: no, type: query_active_dims
value: 70.98613267025705
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9976742633945921
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 109.8632523295962
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.996400522497556
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoClimateFEVER
type: NanoClimateFEVER
metrics: type: dot_accuracy@1
value: 0.26
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.42
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.48
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.62
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.26
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.15333333333333332
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.10800000000000001
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.07800000000000001
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.12499999999999999
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.20166666666666663
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.24
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.32166666666666666
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.26602915512735714
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.3617857142857142
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.2080211358638896
name: Dot Map@100
verified: no, type: query_active_dims
value: 89.9000015258789
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.997054583529065
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 107.88761901855469
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9964652506710387
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoDBPedia
type: NanoDBPedia
metrics: type: dot_accuracy@1
value: 0.62
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.82
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.86
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.92
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.62
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.5266666666666667
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.4640000000000001
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.43199999999999994
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.07037508003753436
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.1332476350020503
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.17834335811098734
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.3023813591870427
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.5284701506717093
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.7312222222222222
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.39806509167251636
name: Dot Map@100
verified: no, type: query_active_dims
value: 48.779998779296875
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9984018085715453
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 112.2790756225586
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9963213722684438
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoFEVER
type: NanoFEVER
metrics: type: dot_accuracy@1
value: 0.54
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.72
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.82
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.92
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.54
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.24
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.16799999999999998
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.09599999999999997
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.5266666666666666
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.6866666666666665
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.7666666666666666
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.8766666666666667
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.696250000763901
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.6531666666666667
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.6383785103785103
name: Dot Map@100
verified: no, type: query_active_dims
value: 82.72000122070312
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9972898236937061
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 121.61109161376953
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9960156250699899
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoFiQA2018
type: NanoFiQA2018
metrics: type: dot_accuracy@1
value: 0.22
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.42
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.44
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.54
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.22
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.16666666666666663
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.11200000000000002
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.07200000000000001
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.12335714285714286
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.29043650793650794
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.3084365079365079
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.38043650793650796
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.2842623648908474
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.3184126984126985
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.24328509002216755
name: Dot Map@100
verified: no, type: query_active_dims
value: 52.91999816894531
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9982661687252163
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 104.23889923095703
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9965847945996016
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoHotpotQA
type: NanoHotpotQA
metrics: type: dot_accuracy@1
value: 0.74
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.9
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.9
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.98
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.74
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.41999999999999993
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.284
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.16399999999999998
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.37
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.63
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.71
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.82
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.7250698177423742
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.8267222222222221
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.63152024851727
name: Dot Map@100
verified: no, type: query_active_dims
value: 69.81999969482422
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9977124697039897
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 134.8498992919922
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9955818786681085
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoQuoraRetrieval
type: NanoQuoraRetrieval
metrics: type: dot_accuracy@1
value: 0.8
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.92
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.94
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.98
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.8
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.35999999999999993
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.23599999999999993
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.12999999999999998
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.7240000000000001
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.8613333333333333
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.9059999999999999
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.9633333333333333
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.8826618022083887
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.8673809523809524
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.8507124011593389
name: Dot Map@100
verified: no, type: query_active_dims
value: 49.619998931884766
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9983742874342479
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 54.11692428588867
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.998226953532341
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoSCIDOCS
type: NanoSCIDOCS
metrics: type: dot_accuracy@1
value: 0.44
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.62
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.66
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.76
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.44
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.2733333333333334
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.22
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.16399999999999998
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.09166666666666666
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.16866666666666666
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.22566666666666665
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.3356666666666666
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.326903742587538
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.5351904761904761
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.24963439583895705
name: Dot Map@100
verified: no, type: query_active_dims
value: 86.16000366210938
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9971771180243068
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 115.15058898925781
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9962272921502766
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoArguAna
type: NanoArguAna
metrics: type: dot_accuracy@1
value: 0.1
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.52
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.66
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.78
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.1
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.17333333333333337
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.132
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.07800000000000001
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.1
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.52
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.66
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.78
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.44166045098306866
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.3330793650793652
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.33989533146591966
name: Dot Map@100
verified: no, type: query_active_dims
value: 119.26000213623047
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9960926544087468
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 117.85887145996094
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9961385600072092
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoSciFact
type: NanoSciFact
metrics: type: dot_accuracy@1
value: 0.44
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.54
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.64
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.7
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.44
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.2
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.14400000000000002
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.07800000000000001
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.405
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.525
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.63
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.68
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.5538495558550187
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.5216904761904761
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.5176733402786808
name: Dot Map@100
verified: no, type: query_active_dims
value: 111.37999725341797
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9963508290002812
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 109.96676635742188
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9963971310413007
name: Corpus Sparsity Ratio
verified: no, task: type: sparse-information-retrieval
name: Sparse Information Retrieval
dataset: name: NanoTouche2020
type: NanoTouche2020
metrics: type: dot_accuracy@1
value: 0.5714285714285714
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.7959183673469388
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.8367346938775511
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.9795918367346939
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.5714285714285714
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.5578231292517006
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.4734693877551021
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.3938775510204081
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.03883194419290252
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.10835972457173955
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.15843173631430588
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.25572265913299697
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.4521113986238841
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.7052883057985098
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.33689523249457515
name: Dot Map@100
verified: no, type: query_active_dims
value: 51.163265228271484
name: Query Active Dims
verified: no, type: query_sparsity_ratio
value: 0.9983237250105409
name: Query Sparsity Ratio
verified: no, type: corpus_active_dims
value: 122.40800476074219
name: Corpus Active Dims
verified: no, type: corpus_sparsity_ratio
value: 0.9959895156031472
name: Corpus Sparsity Ratio
verified: no
Likes: 0 | All-time downloads: 66
Created: 2025-05-26 15:14:56