Model: manu-reyes-23p/modernbert-embed-base-legal-matryoshka-2
Author: manu-reyes-23p
Pipeline: sentence-similarity
Library: sentence-transformers
Tags: sentence-transformers, safetensors, modernbert, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:90, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss, en, arxiv:1908.10084, arxiv:2205.13147, arxiv:1705.00652, base_model:nomic-ai/modernbert-embed-base, base_model:finetune:nomic-ai/modernbert-embed-base, license:apache-2.0, model-index, text-embeddings-inference, endpoints_compatible, region:us
Base models (finetune): id: nomic-ai/modernbert-embed-base
Card metadata: language: en
license: apache-2.0
tags: sentence-transformers, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:90, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss
base_model: nomic-ai/modernbert-embed-base
widget: source_sentence: Importantly here, though a mentor may have more than one protégé, it cannot bid on the same 
Solicitation multiple times using different protégé relationships.  See 13 C.F.R. § 125.9(b)(3)(i). 
Specifically, the law dictates that “[a] mentor that has more than one protégé cannot submit 
competing offers in response to a solicitation for a specific procurement through separate joint
sentences: What program are the three solicitations under?, Which organizations jointly issue the FAR?, What regulation is referenced regarding a mentor with multiple protégés?, source_sentence: Plaintiffs SH Synergy, LLC (SHS) and VCH Partners, LLC (VCH) (collectively, Plaintiffs) 
filed this pre-award bid protest to contest the General Service Administration’s (GSA’s) $60 to 
$100 billion small business set-aside government-wide acquisition contract (GWAC) for 
information technology (IT) services known as the “Polaris Program.”  Plaintiff SH Synergy,
sentences: What type of service providers are SHS and VCH?, Which organizations does GSA work with to issue government-wide regulations?, What is the estimated value range of the contract in question?, source_sentence: these pools by awarding multiple-award indefinite-delivery, indefinite-quantity (IDIQ) contracts 
to a pre-determined number of awardees who meet the small business qualifications outlined 
within each Solicitation (i.e., SB, WOSB, SDVOSB, etc.).  AR at 1112–14, 2152–54, 2643–45.  
These IDIQ contracts will be for a term of five years, with a five-year option to extend the
sentences: What type of contracts are being awarded?, After the redactions were incorporated, what is the document number of the publicly reissued Memorandum and Order?, How long is the initial term of the IDIQ contracts?, source_sentence: Administrative Record (ECF Nos. 33, 34) and GRANTS in part and DENIES in part 
Defendant’s Cross-Motion for Judgment on the Administrative Record (ECF No. 37).  As 
described more fully below, Defendant is ENJOINED from evaluating proposals and awarding 
IDIQ contracts under the current versions of the SB, WOSB, and SDVOSB Pool Solicitations.
sentences: What is the primary difference between the sealed and public versions of the Memorandum and Order?, What is the outcome of Defendant’s Cross-Motion for Judgment on the Administrative Record?, What does 13 C.F.R. § 125.9(b)(3)(i) mention about ventures?, source_sentence: Importantly here, though a mentor may have more than one protégé, it cannot bid on the same 
Solicitation multiple times using different protégé relationships.  See 13 C.F.R. § 125.9(b)(3)(i). 
Specifically, the law dictates that “[a] mentor that has more than one protégé cannot submit 
competing offers in response to a solicitation for a specific procurement through separate joint
sentences: What is the relationship or classification mentioned for SHS and VCH?, At what level are specific IT services contracted for and performed?, According to the law, can a mentor submit competing offers for the same procurement?
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics: cosine_accuracy@1, cosine_accuracy@3, cosine_accuracy@5, cosine_accuracy@10, cosine_precision@1, cosine_precision@3, cosine_precision@5, cosine_precision@10, cosine_recall@1, cosine_recall@3, cosine_recall@5, cosine_recall@10, cosine_ndcg@10, cosine_mrr@10, cosine_map@100
model-index: name: ModernBERT Embed base Legal Matryoshka
results: task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 768
type: dim_768
metrics: type: cosine_accuracy@1
value: 0.6
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.6
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.7
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.8
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.6
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5666666666666667
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.4
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.26999999999999996
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.19999999999999998
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.55
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.625
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.8
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.7026992799246075
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6342857142857143
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6878232959850606
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 512
type: dim_512
metrics: type: cosine_accuracy@1
value: 0.6
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.6
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.7
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.8
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.6
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5666666666666667
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.4
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.26999999999999996
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.19999999999999998
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.55
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.625
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.8
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.7026992799246075
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6342857142857143
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6925410047468871
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 256
type: dim_256
metrics: type: cosine_accuracy@1
value: 0.6
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.7
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.8
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.9
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.6
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.6
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.4600000000000001
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.29
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.19999999999999998
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.575
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.7
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.8666666666666666
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.7473665980737673
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6644444444444445
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.7155726946531544
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 128
type: dim_128
metrics: type: cosine_accuracy@1
value: 0.5
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.6
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.8
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.9
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.42000000000000004
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.29
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.175
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.5
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.65
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.8666666666666666
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.7061995998078071
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.5894444444444444
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6572075446340152
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 64
type: dim_64
metrics: type: cosine_accuracy@1
value: 0.6
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.6
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.7
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.8
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.6
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5666666666666667
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.4
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.26999999999999996
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.19999999999999998
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.55
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.625
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.8
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.7053203837407914
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6366666666666667
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6806241117976338
name: Cosine Map@100
verified: no
Likes: 0 | All-time downloads: 33
Created: 2025-05-12 00:37:42