Model: AdamLucek/ModernBERT-embed-base-legal-MRL
Author: AdamLucek
Pipeline: sentence-similarity
Library: sentence-transformers
Tags: sentence-transformers, safetensors, modernbert, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:5822, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss, en, dataset:AdamLucek/legal-rag-positives-synthetic, arxiv:1908.10084, arxiv:2205.13147, arxiv:1705.00652, base_model:nomic-ai/modernbert-embed-base, base_model:finetune:nomic-ai/modernbert-embed-base, license:apache-2.0, model-index, text-embeddings-inference, endpoints_compatible, region:us
Base models (finetune): id: nomic-ai/modernbert-embed-base
Card metadata: language: en
license: apache-2.0
tags: sentence-transformers, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:5822, loss:MatryoshkaLoss, loss:MultipleNegativesRankingLoss
base_model: nomic-ai/modernbert-embed-base
widget: source_sentence: this information about the two documents withheld in part under the deliberative-process 
128 
 
privilege in No. 11-444, see First Lutz Decl. Ex. DD at 17, 141, but the descriptions of the 
decisionmaking authority are generic, stating that the withheld information is a “recommendation 
from the [FOIA] analyst to his/her supervisor,” id. at 17, and a “recommendation from the
sentences: What did the plaintiff assert about the CIA's inaccurate representations?, What type of document is mentioned as an exhibit in conjunction with the withheld documents?, ¿Qué ámbito jurisdiccional es mencionado en el contexto de derechos sobre la propia imagen?, source_sentence: Artificial Intelligence, Corp. y que prestaba servicios mediante 
contrato para el Departamento de Producción de tal corporación. 
Adujo que, no se encontraba en la obligación de solicitar 
autorización a la parte apelada para utilizar su imagen, ya que se le 
había pagado por la producción de múltiples videos publicitarios 
para el uso de las empresas.  
Luego 
de 
varias 
incidencias
sentences: Who has the burden to provide a sufficient record on appeal?, ¿Para qué departamento prestaba servicios Artificial Intelligence, Corp. según el contrato?, What section numbers are referenced for further information?, source_sentence: submission by protégé firms.  SHS MJAR at 28–30; VCH MJAR at 28–30 (same).  This, Plaintiffs 
contend, violates Section 125.8(e) because it purportedly subjects protégés to heightened 
evaluation criteria as compared to offerors generally and makes it harder for mentor-protégé JVs 
to compete against more experienced firms with larger portfolios of past work.  SHS MJAR at 28–
sentences: On what date were the plaintiff's petition, complaint, and trial court's order filed?, What section do Plaintiffs contend is violated?, What is the amount of pages the party seeks to withhold?, source_sentence: Beginning with the CIA’s submissions, the CIA states in its declaration submitted in No. 
11-445 that “[s]ome of the records for which information has been withheld pursuant to 
Exemption (b)(5) contain confidential communications between CIA staff and attorneys within 
the CIA’s Office of General Counsel about the processing of certain FOIA requests.”  Third Lutz
sentences: What is the subject of the confidential communications mentioned in the document?, Which rule number is associated with the responsibilities regarding nonlawyer assistants?, ¿Qué número de referencia tiene el documento?, source_sentence: contracting/contracting-assistance-programs/sba-mentor-protege-program (last visited Apr. 19, 
2023). 
5 
 
protégé must demonstrate that the added mentor-protégé relationship will not adversely affect the 
development of either protégé firm (e.g., the second firm may not be a competitor of the first 
firm).”  13 C.F.R. § 125.9(b)(3).
sentences: What discretion do district courts have regarding a defendant’s invocation of FOIA exemptions?, What must the protégé demonstrate about the mentor-protégé relationship?, Which exemptions are mentioned in relation to the plaintiff's accusations?
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics: cosine_accuracy@1, cosine_accuracy@3, cosine_accuracy@5, cosine_accuracy@10, cosine_precision@1, cosine_precision@3, cosine_precision@5, cosine_precision@10, cosine_recall@1, cosine_recall@3, cosine_recall@5, cosine_recall@10, cosine_ndcg@10, cosine_mrr@10, cosine_map@100
model-index: name: ModernBERT Embed base Legal Matryoshka
results: task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 768
type: dim_768
metrics: type: cosine_accuracy@1
value: 0.5285935085007728
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.5718701700154559
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.6646058732612056
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7310664605873262
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5285935085007728
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.5141679546625451
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.3941267387944359
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.2329211746522411
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.17877382792375063
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.4894384337970118
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.6120556414219475
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.7184441009788768
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6300476733345887
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.5741100561811532
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6186392686743281
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 512
type: dim_512
metrics: type: cosine_accuracy@1
value: 0.5162287480680062
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.5486862442040186
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.6414219474497682
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.7171561051004637
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.5162287480680062
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.4981968057702215
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.38083462132921175
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.22720247295208656
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.17400824317362185
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.47346728490468826
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.5910613086038125
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.702344152498712
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.6137901932050573
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.5592913569343243
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.6021884440021203
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 256
type: dim_256
metrics: type: cosine_accuracy@1
value: 0.482225656877898
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.5285935085007728
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.598145285935085
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.678516228748068
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.482225656877898
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.46986089644513135
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.35857805255023184
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.21468315301391033
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.16267387944358577
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.4492529623905203
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.5569294178258629
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.6642194744976816
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.5781404945062661
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.5249122936139936
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.5698418441661705
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 128
type: dim_128
metrics: type: cosine_accuracy@1
value: 0.41576506955177744
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.4435857805255023
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.5363214837712519
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.6105100463678517
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.41576506955177744
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.3992787223080887
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.31282843894899537
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.19242658423493045
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.14258114374034003
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.3835651725914477
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.48776403915507466
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.5963420917053066
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.5108672198469205
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.4573213365717227
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.5029873598412773
name: Cosine Map@100
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: dim 64
type: dim_64
metrics: type: cosine_accuracy@1
value: 0.312210200927357
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.3508500772797527
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.43585780525502316
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.47913446676970634
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.312210200927357
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.3091190108191654
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.250386398763524
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.14976816074188565
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.10497166409067489
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.2954662545079856
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.3930963420917053
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.46805770221535287
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.39563928784117025
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.3508985304580356
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.3939277813526489
name: Cosine Map@100
verified: no
datasets: AdamLucek/legal-rag-positives-synthetic
Likes: 7 | All-time downloads: 3656
Created: 2025-01-20 15:27:57