Model: chrisekwugum/modernbert-embed-base-legal-matryoshka-2
Author: chrisekwugum
Pipeline: sentence-similarity
Library: sentence-transformers
Tags: sentence-transformers, safetensors, modernbert, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:5822, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss, en, arxiv:1908.10084, arxiv:2205.13147, arxiv:1705.00652, base_model:nomic-ai/modernbert-embed-base, base_model:finetune:nomic-ai/modernbert-embed-base, license:apache-2.0, model-index, text-embeddings-inference, endpoints_compatible, region:us
Base models (finetune): id: nomic-ai/modernbert-embed-base
Card metadata: language: en
license: apache-2.0
tags: sentence-transformers, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:5822, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss
base_model: nomic-ai/modernbert-embed-base
widget: source_sentence: VCH qualifies as a service-disabled veteran-owned small business and is an actual offeror on the 
SDVOSB Pool Solicitation under the Polaris Program.  VCH Compl. ¶¶ 2, 5.  Both SHS and VCH 
also claim to be prospective offerors on the SB Pool Solicitation.  SHS Compl. ¶ 5; VCH Compl. 
¶ 5.  Both SHS and VCH state they have prepared, but not yet formally submitted, proposals in
sentences: What type of request must be submitted according to the information security procedures?, On which solicitation is VCH an actual offeror?, According to which U.S. Code section is the term 'infrastructure security information' defined?, source_sentence: Count Nine in No. 11-444: May 13, 2010 FOIA Request to the CIA 
First, the CIA refused to process the plaintiff’s FOIA request which sought “a 
representative sample of [CIA] analytical reports and memoranda presenting psychological 
analyses or profiles of foreign government officials, terrorist leaders, international criminals,
sentences: Under what section were 'Regional Boards' considered 'agencies'?, What is the count number associated with the May 13, 2010 FOIA Request to the CIA?, What type of contracts does FAR 37.102(a) most prefer?, source_sentence: records referencing FOIA and Privacy Act requests submitted by [ten listed parties] that contain 
remarks, comments, notes, explanations, etc. made by CIA personnel or contractors about the 
processing of these requests (and appeals, if appropriate), the invocations of exemptions, or 
related matters.”  See Decl. of Martha M. Lutz (Sept. 26, 2012) (“Third Lutz Decl.”) Ex. A at 1,
sentences: What is mentioned as possibly contradicting the defendant's statement?, On what date is the document 'Third Lutz Decl.' declared?, What does the plaintiff argue regarding the phrase 'on notice'?, source_sentence: “[a]gencies shall evaluate all proposals in accordance with 15.305(a), and, if discussions are to be 
conducted, establish the competitive range.  Based on the ratings of each proposal against all 
evaluation criteria, the contracting officer shall establish a competitive range comprised of all of 
the most highly rated proposals . . . .”  FAR 15.306(c)(1) (emphasis added).  This last provision
sentences: Who establishes the competitive range based on proposal ratings?, What type of basis are the services to be acquired on?, What is the source of the statement quoted about the agencies and advisory committees?, source_sentence: for a specific procurement through separate joint ventures with different protégés.”  Id.  The SBA 
underscored this purpose by highlighting that in acquiring a second protégé, the mentor “has 
already assured SBA that the two protégés would not be competitors.  If the two mentor-protégé 
relationships were approved in the same [North American Industry Classification System] code,
sentences: Where can the details of the CIA's framing of the plaintiff's injury be found?, What is the context of the mentor-protégé relationships mentioned?, What requirement does the FOIA have regarding the release of segregable portions of a record?
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics: cosine_accuracy@1, cosine_accuracy@3, cosine_accuracy@5, cosine_accuracy@10, cosine_precision@1, cosine_precision@3, cosine_precision@5, cosine_precision@10, cosine_recall@1, cosine_recall@3, cosine_recall@5, cosine_recall@10, cosine_ndcg@10, cosine_mrr@10, cosine_map@100
model-index: name: ModernBERT Embed base Legal Matryoshka
results: task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 768
type: dim_768
metrics: type: cosine_accuracy@1
value: 0.5564142194744977
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.6058732612055642
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.6955177743431221
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7758887171561051
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5564142194744977
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5265327150953116
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.40216383307573417
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.23879443585780524
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.19770736733642452
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.5216383307573416
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.6432251416795467
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.755280783101494
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6620393079072384
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6046944383111306
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6446423018095604
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 512
type: dim_512
metrics: type: cosine_accuracy@1
value: 0.5440494590417311
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.5873261205564142
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.6846986089644513
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7604327666151468
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5440494590417311
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5105615662029882
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.3935085007727976
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.23431221020092735
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.1947449768160742
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.5066975785677487
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.6317619783616693
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.7434312210200927
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6493066767347394
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.591142268344741
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6320199198507571
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 256
type: dim_256
metrics: type: cosine_accuracy@1
value: 0.5131375579598145
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.5548686244204019
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.6383307573415765
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7078825347758887
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5131375579598145
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.4848016486347243
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.3712519319938176
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.2185471406491499
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.18019062339000513
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.47797527047913446
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.5926069036579084
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.693070582174137
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6070012758911372
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.5553402762444491
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.5963300240538415
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 128
type: dim_128
metrics: type: cosine_accuracy@1
value: 0.45904173106646057
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.5115919629057187
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.5873261205564142
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.6553323029366306
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.45904173106646057
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.43379701184956204
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.3372488408037094
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.2017001545595054
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.16679546625450797
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.4330242143225141
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.5422462648119527
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.6388459556929419
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.5563637742997848
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.50374622801207
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.546814426794716
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 64
type: dim_64
metrics: type: cosine_accuracy@1
value: 0.36476043276661513
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.40494590417310666
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.47449768160741884
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.5409582689335394
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.36476043276661513
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.3482740855229263
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.2741885625965997
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.16599690880989182
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.1281555899021123
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.34119010819165374
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.4383049974240082
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.5255023183925811
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.44955240085023923
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.40338436250337323
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.4452507749409145
name: Cosine Map@100
verified: no
Likes: 1 | All-time downloads: 65
Created: 2025-02-18 17:14:03