Model: TharushiDinushika/modernbert-embed-base-legal-matryoshka-2
Author: TharushiDinushika
Pipeline: sentence-similarity
Library: sentence-transformers
Tags: sentence-transformers, safetensors, modernbert, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:5822, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss, en, arxiv:1908.10084, arxiv:2205.13147, arxiv:1705.00652, base_model:nomic-ai/modernbert-embed-base, base_model:finetune:nomic-ai/modernbert-embed-base, license:apache-2.0, model-index, text-embeddings-inference, endpoints_compatible, region:us
Base models (finetune): id: nomic-ai/modernbert-embed-base
Card metadata: language: en
license: apache-2.0
tags: sentence-transformers, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:5822, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss
base_model: nomic-ai/modernbert-embed-base
widget: source_sentence: ARE!!’”  Id. at 350, 19 A.3d at 419.  The State did not attempt to authenticate the page 
through the testimony of a witness with knowledge, i.e., the girlfriend, but instead 
attempted to authenticate the printout through the testimony of an investigator.  See id. at 
348, 19 A.3d at 418.  We determined that the printout was not sufficiently authenticated
sentences: What must the CIA determine about NSC's purported assignment?, Who did the State not use to authenticate the page?, What do the Polaris Solicitations allegedly not require according to the Defendant?, source_sentence: L. No. 92-463, § 3(2), 86 Stat. 770, 770 (1972).  But now, the exclusion is for groups “composed 
wholly of full-time, or permanent part-time, officers or employees of the Federal Government.”  
5 U.S.C. app. 2 § 3(2) (2018) (emphasis added); see Federal Advisory Committee Act 
Amendments of 1997, Pub. L. 105-153, § 2(a), 111 Stat. 2689, 2689.  The Government here
sentences: At what type of meeting was the summary of Document 3 provided?, Which Public Law and section refer to the Federal Advisory Committee Act Amendments of 1997?, In what year was the case Cleveland Telecoms. Corp. v. United States decided?, source_sentence: but the CIA is now claiming FOIA Exemption 5 in this litigation, see First Lutz Decl. ¶ 68. 
16 
 
and any unclassified ‘TOCs,’ that were not available on the CIA website.”  Second Lutz Decl. 
Ex. B at 1, No. 11-443, ECF No. 27-1.  On December 5, 2011, the CIA provided a final response 
to the plaintiff’s May 12, 2010 FOIA request, releasing 43 responsive documents in full and 131
sentences: What must the circumstantial evidence be sufficient for?, What exemption is the CIA claiming in the litigation?, Which government agency determined the fee category for NSC?, source_sentence: be okay to impose a heightened requirement on the protégés?” Defendant’s Counsel: “[I]f that 
were the case here, then, right, we’d be violating 125.8(e).”).  Indeed, such a change would be 
inconsistent with the express goal of the Mentor-Protégé Program “to improve the protégé firms' 
ability to successfully compete for federal contracts.”  13 C.F.R. § 125.9(a).   
52
sentences: According to the document, what would be inconsistent with the goal of the Mentor-Protégé Program?, What is the 'business record' theory related to?, What evaluation factor is a contracting officer not required to consider according to the Class Deviation?, source_sentence: The CIA appears to recognize the breadth of its proposed interpretation in this regard, 
contending in multiple places that “it is not clear that there is any practical difference between 
the organization and functions of CIA personnel and those of the Agency” since “the CIA is 
composed of and acts entirely through its employees.”  See Def.’s First 443 Reply at 9; see also
sentences: What does 5 C.F.R. § 340.403(a) require regarding work schedule changes?, What does the CIA contend about the difference between the organization and functions of its personnel and those of the Agency?, What does the quote argue defies all logic?
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics: cosine_accuracy@1, cosine_accuracy@3, cosine_accuracy@5, cosine_accuracy@10, cosine_precision@1, cosine_precision@3, cosine_precision@5, cosine_precision@10, cosine_recall@1, cosine_recall@3, cosine_recall@5, cosine_recall@10, cosine_ndcg@10, cosine_mrr@10, cosine_map@100
model-index: name: ModernBERT Embed base Legal Matryoshka
results: task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 768
type: dim_768
metrics: type: cosine_accuracy@1
value: 0.5687789799072643
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.6089644513137558
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.6939721792890263
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7635239567233385
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5687789799072643
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5352910870685215
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.41174652241112825
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.24234930448222566
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.20273055126223594
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.5208655332302936
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.6451571354971664
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.7557959814528593
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6688993548145977
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6135803832094405
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6534991576386615
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 512
type: dim_512
metrics: type: cosine_accuracy@1
value: 0.5610510046367851
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.60741885625966
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.6846986089644513
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7511591962905718
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5610510046367851
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5306543019062339
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.4086553323029366
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.23802163833075735
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.1989953632148377
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.5140391550747038
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.6402627511591963
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.7421432251416795
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6583234535678464
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.6052611564976326
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6440533153679155
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 256
type: dim_256
metrics: type: cosine_accuracy@1
value: 0.49768160741885625
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.5641421947449768
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.6506955177743431
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7109737248840804
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.49768160741885625
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.482225656877898
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.3839258114374034
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.22488408037094282
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.175296239052035
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.46561051004636783
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.5995620814013396
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.6996393611540443
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6086164269166475
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.5505354382865968
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.5948366665406214
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 128
type: dim_128
metrics: type: cosine_accuracy@1
value: 0.4435857805255023
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.4853168469860896
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.5842349304482226
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.6676970633693973
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.4435857805255023
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.42091705306543015
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.3366306027820711
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.21143740340030914
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.1573930963420917
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.4082946934569809
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.5242143225141679
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.6562339000515198
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.556054617237536
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.49328279482838977
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.5378589065174245
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 64
type: dim_64
metrics: type: cosine_accuracy@1
value: 0.33384853168469864
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.3755795981452859
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.46986089644513135
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.5595054095826894
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.33384853168469864
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.3204533745492014
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.2633693972179289
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.17635239567233385
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.12094281298299846
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.3134981968057702
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.41396187532199896
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.5399278722308088
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.4453081579488404
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.3835173327445349
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.4344880984762206
name: Cosine Map@100
verified: no
Likes: 0 | All-time downloads: 6
Created: 2025-05-15 10:19:56