Instructions to use Skate-16/Clause-Guard with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Skate-16/Clause-Guard with sentence-transformers:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("Skate-16/Clause-Guard")

sentences = [
    "['If Pretzel Time exercises its right of first refusal,  Franchisee  (and its Owners)  agrees that,  for a period of twelve (12) months  commencing on the date of the closing,  neither  Franchisee (nor its Owners) shall have any direct or indirect interest  (through a member of the immediate  families of Franchisee or its Owners of  otherwise)  as a  disclosed  or  beneficial  owner,  investor, partner, director, officer, employee, consultant, representative, or agent or in any other capacity in any Competitive Business located or operating within three (3) miles of the Unit,  and/or  three (3) miles of any other  Pretzel Time Unit.', \"Franchisee  also  acknowledges  that Pretzel Time has granted the Franchise to  Franchisee  in  consideration  of and reliance  upon  Franchisee's agreement to deal  exclusively  with Pretzel Time.  Franchisee  therefore agrees that  during the term of the  Franchise  Agreement,  or the period of time which Franchisee operates a Unit under this Agreement,  whichever is shorter,  neither Franchisee  nor  any  Affiliate,  immediate  family  member,  or  in  the  event Franchisee is a corporation\\n\\nany Owner thereof and member of his immediate  family or in the event  Franchise is a partnership any partner  (general or limited) thereof and any member of his immediate family, shall:\\n\\n         (1) Have  any  direct  or  indirect  interest  as an  owner,  investor,          partner, director, officer, employee, consultant, representative, agent          or in  any  other  capacity  in any  Competitive  Business  located  or          operating  at the Site or within  three (3) miles of any  Pretzel  Time          Unit  in  operation  or  under  development  on the  effective  date of          termination or expiration of this Agreement, except a Pretzel Time Unit          operated by Franchisee under Franchise Agreements with Pretzel Time; or\\n\\n         (2) Recruit or hire any employee who, within the immediately  preceding          six (6) month period,  was employed by Pretzel Time or any Pretzel Time          Unit operated by Pretzel Time, its Affiliates or another  franchisee or          licensee  of  Pretzel  Time,   without   obtaining  the  prior  written          permission of Pretzel Time or such franchisee.\", 'Except as  otherwise  provided  in this  Agreement  and  provided  that Franchise  is in full  compliance  with  this  Agreement,  Pretzel  Time and its Affiliates  will  not  during  the  term  of this  Agreement  operate  or  grant franchises  for the operation of Pretzel Time Units within the  Territory  other than the Franchise granted to Franchisee pursuant to this Agreement.', \"Franchisee agrees that he will at all times faithfully,  honestly,  and diligently  perform his obligations  hereunder,  that he will continuously exert his best efforts and shall  continually  train and  supervise  his  personnel to Pretzel Time's  reasonable  standards,  in  furtherance  of the mutual  business interests of both Pretzel Time and Franchisee and that he will not engage in any other business or activity that may conflict with his obligations  hereunder.\", \"Neither  Franchisee  nor any of its Owners shall divert or attempt to divert any business or any customers of any Pretzel Time Unit to any  Competitive  Business or employ or seek to employ any  person who is  employed  by Pretzel  Time,  its Affiliates  or a franchisee  of Pretzel Time nor induce or attempt to induce any such person to leave said  employment  without the prior written consent of such person's employer.\", 'Franchisee  therefore agrees that  during the term of the  Franchise  Agreement,  or the period of time which Franchisee operates a Unit under this Agreement,  whichever is shorter,  neither Franchisee  nor  any  Affiliate,  immediate  family  member,  or  in  the  event Franchisee is a corporation\\n\\nany Owner thereof and member of his immediate  family or in the event  Franchise is a partnership any partner  (general or limited) thereof and any member of his immediate family, shall:\\n\\n         (1) Have  any  direct  or  indirect  interest  as an  owner,  investor,          partner, director, officer, employee, consultant, representative, agent          or in  any  other  capacity  in any  Competitive  Business  located  or          operating  at the Site or within  three (3) miles of any  Pretzel  Time          Unit  in  operation  or  under  development  on the  effective  date of          termination or expiration of this Agreement, except a Pretzel Time Unit          operated by Franchisee under Franchise Agreements with Pretzel Time; or\\n\\n         (2) Recruit or hire any employee who, within the immediately  preceding          six (6) month period,  was employed by Pretzel Time or any Pretzel Time          Unit operated by Pretzel Time, its Affiliates or another  franchisee or          licensee  of  Pretzel  Time,   without   obtaining  the  prior  written          permission of Pretzel Time or such franchisee.', 'Franchisee (and its Owners) have executed a noncompetition covenant          in favor of Pretzel Time and the transferee agreeing that, for a period          of twelve (12) months commencing on the effective date of the Transfer,          Franchisee,  its  Owners  and  members  of the  immediate  families  of          Franchisee  and each of its Owners will not hold any direct or indirect          interest  as  a  disclosed  or  beneficial  owner,  investor,  partner,          director,  officer manager,  employee,  consultant,  representative  or          agent, or in any other capacity,  in a Competitive  Business located or          operating  within  three (3) miles of the Unit,  and  within  three (3)          miles of any other Pretzel Time Unit;', 'The Franchise  Agreement contains a covenant not to compete which extends beyond\\n\\n\\n\\n\\n\\nthe termination of the franchise.', 'Pretzel  Time  will not,  as long as this  Agreement  is in effect  and Franchisee  is not in default,  enfranchise  or operate any other  Pretzel  Time Franchise  within the following  enclosed  mall or building  except as otherwise provided herein (hereinafter  referred to as \"Territory\"):  none.', \"Upon  termination of this  Agreement,  in accordance with its terms and conditions or by Franchisee  without cause, or upon expiration of this Agreement (unless the Franchise is renewed as provided for in this Agreement),  Franchisee and its Owners agree that for a period of TWELVE (12) months  commencing  on the effective  date of  termination  or expiration  or the date on which  Franchisee complies  with this Section,  whichever is later,  neither  Franchisee,  nor its Owners,  nor any person or entity  affiliated  with  Franchisee or  Franchisee's shareholders or partners shall have any direct or indirect  interest  (through a member of the immediate  families of Franchisee or its Owners or otherwise) as a disclosed or beneficial owner, investor,  partner, director,  officer, employee, consultant,  representative,  agent or in any other capacity in any  Competitive Business  located or operating:  (1) at the Site;  (2) within three (3) miles of the Unit;  and/or (3) within  three (3) miles of any other  Pretzel Time Unit in operation  or  under  development  on  the  effective  date  of  termination  or expiration of this  agreement for a period of one year after the  termination or expiration.\"]",
    "Consultant also expressly agrees that he will not, without the prior written consent of the Company, either directly or indirectly on his own behalf, or in the service or on behalf of others, solicit, divert, or attempt to solicit or divert any customer, client, supplier or vendor of the Company for a period of five (5) years for any reason, and without limitation for the purpose of harming the Company or of obtaining and disseminating its trade secrets, or other proprietary and confidential information 4.4 Non-Circumvention.",
    "Upon the expiration of the initial term of this  Agreement,  Franchisee shall  have the one time  right to obtain a  successor  franchise  to  operate a Pretzel  Time Unit at the Site (a  \"Successor  Franchise\")  for a single term of five (5) years  immediately  following the expiration of the initial term of the Franchise upon giving Pretzel Time six (6) months notice prior to the expiration of the then current term if:\n\n         (1) Franchisee and its Owners have complied with this Agreement and any          amendment  during the initial  term of this  Agreement  in all material          respects; and\n\n         (2) Franchisee  maintains  possession of the Site and agrees to remodel          and/or expand the Unit, add or replace equipment, furnishings, fixtures          and signs and  otherwise  modify  the Unit to bring it into  compliance          with   specifications  and  standards  then  applicable  under  new  or          Successor Franchises for Pretzel Time Units; or if Franchisee is unable          to maintain  possession  of the Site, or if, in the judgment of Pretzel          Time,  the Unit should be  relocated,  Franchisee  secures a substitute          site approved by Pretzel Time and agrees to develop  expeditiously such          substitute  site in compliance with  specifications  and standards then          applicable  under new or successor  franchises  for Pretzel Time units;          and\n\n         (3) Pretzel  Time has not given notice of its election not to renew six          (6) months  prior to the  expiration  of the  initial  twenty (20) year          term; and\n\n         (4)  Franchisee  is not in default of any material term or condition of          the lease  agreement,  or any other agreement  between Pretzel Time and          Franchisee; and\n\n         (5) Franchisee executes Pretzel Time's then current Franchise Agreement          and  other  ancillary  agreements  required  and being  offered  to new          Franchisees on the date of renewal, which agreements shall supersede in          all respects this  Agreement and the terms of which may differ from the          terms of this Agreement,  including,  without limitation,  Royalty Fees          and  Advertising  Fund  Fees,  other  fees  and  charges,   performance          criteria,  and a provision which allows Pretzel Time and its Affiliates          to reserve  the right,  both within and  outside of the  Territory,  to          offer and sell at wholesale or retail, through channels of distribution          distinct  from  those  of a  Franchise,  Products  and  services  which          comprise,  or may in the  future  comprise a part of the  Pretzel  Time          System, which Products may be resold at retail to the general public by          such entities; and\n\n         (6) Franchisee is in full  compliance  with Pretzel  Time's  Operations Manual; and\n\n         (7) On renewal,  Franchisee  agrees to pay the current renewal fee, the          Royalty and  Advertising  Fund fees specified in Pretzel Time's current\n\n\n\n\n\n         Franchise  Agreement then being offered new  Franchisees on the date of          renewal; and\n\n         (8) Franchisee shall execute general releases,  in form satisfactory to          Pretzel  Time,  of any and all  claims  against  Pretzel  Time  and its          Affiliates and their officers, directors, employees, agents, successors          and assigns arising under this Agreement; and\n\n         (10)   Franchisee   has  complied  with  Pretzel  Time's  then  current          qualification and training requirements.",
    "Newsletter: NFLA to feature Company in Weekly Newsletter \"Partner Spotlight\" a minimum of four (4) times per year."
]
embeddings = model.encode(sentences)

similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]

Notebooks
Google Colab
Kaggle

SentenceTransformer based on nlpaueb/legal-bert-base-uncased

This is a sentence-transformers model finetuned from nlpaueb/legal-bert-base-uncased. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

Model Type: Sentence Transformer
Base model: nlpaueb/legal-bert-base-uncased
Maximum Sequence Length: 512 tokens
Output Dimensionality: 768 dimensions
Similarity Function: Cosine Similarity

Model Sources

Documentation: Sentence Transformers Documentation
Repository: Sentence Transformers on GitHub
Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    '["THE LIABILITY OF DELTATHREE FOR DAMAGES OR ALLEGED DAMAGES HEREUNDER, WHETHER IN CONTRACT, TORT OR ANY OTHER LEGAL THEORY, IS LIMITED TO, AND WILL NOT EXCEED, PRIMECALL\'S DIRECT DAMAGES.", "THE LIABILITY OF PRIMECALL FOR DAMAGES OR ALLEGED DAMAGES HEREUNDER, WHETHER IN CONTRACT, TORT OR ANY OTHER LEGAL THEORY, IS LIMITED TO, AND WILL NOT EXCEED, DELTATHREE\'S DIRECT DAMAGES.", \'IN NO EVENT SHALL PRIMECALL BE LIABLE TO DELTATHREE FOR ANY SPECIAL, INCIDENTIAL OR CONSEQUENTIAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOSS OF PROFITS, REVENUES OR DATA WHETHER BASED ON BREACH OF CONTRACT, TORT OR OTHERWISE, WHETHER OR NOT DELTATHREE HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.\', \'IN NO EVENT SHALL DELTATHREE BE LIABLE TO PRIMECALL FOR ANY SPECIAL, INCIDENTIAL OR CONSEQUENTIAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOSS OF PROFITS, REVENUES OR DATA WHETHER BASED ON BREACH OF CONTRACT, TORT OR OTHERWISE, WHETHER OR NOT PRIMECALL HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.\']',
    'ARTICLE XIII  EXCLUSION OF DAMAGES; LIMITATION OF LIABILITY       (a) IN NO EVENT SHALL LICENSOR BE LIABLE TO LICENSEE OR TO ANY THIRD PARTY FOR ANY SPECIAL, INDIRECT,  INCIDENTAL OR CONSEQUENTIAL DAMAGES (INCLUDING WITHOUT LIMITATION LOSS OF USE, DATA, BUSINESS OR PROFITS)  ARISING OUT OF OR IN CONNECTION WITH THIS AGREEMENT OR THE USE, OPERATION OR PERFORMANCE OF ANY OF THE  LICENSED TECHNOLOGY, WHETHER SUCH LIABILITY ARISES FROM ANY CLAIM BASED UPON CONTRACT, WARRANTY, TORT  (INCLUDING NEGLIGENCE), PRODUCT LIABILITY BREACH OR FAILURE OF EXPRESS OR IMPLIED WARRANTY OR CONDITION,  MISREPRESENTATION OR OTHERWISE, AND WHETHER OR NOT LICENSORHAS BEEN ADVISED OF THE POSSIBILITY OF SUCH LOSS  OR DAMAGE (INCLUDING, BUT NOT LIMITED TO, CLAIMS FOR LOSS OF DATA, GOODWILL, USE OF MONEY OR USE OF THE LICENSED TECHNOLOGY, INTERRUPTION IN USE OR AVAILABILITY OF DATA, STOPPAGE OF OTHER WORK OR IMPAIRMENT OR OTHER ASSETS), ARISING OUT OF BREACH OR FAILURE OF EXPRESS OR IMPLIED WARRANTY OR CONDITION, BREACH OF CONTRACT,  MISREPRESENTATION, NEGLIGENCE, STRICT LIABILITY IN TORT, OR OTHERWISE     UNDER NO CIRCUMSTANCE SHALL LICENSOR BE LIABLE FOR ANY ACTIONS, CLAIMS OR THE LIKE BY LICENSEE OR ANY THIRD  PARTY THAT THE USE OF THE LICENSED TECHNOLOGY HAS RESULTED, RESULTS OR MAY RESULT IN ANY INFRINGEMENT,',
    'For purposes of this Agreement, any merger, consolidation, or change of corporate structure following which there is a Change of Control of Kitov shall be considered as an assignment by Kitov, allowing Dexcel to terminate the Agreement as heretofore provided.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Dataset

Unnamed Dataset

Size: 18,430 training samples
Columns: sentence_0, sentence_1, and label

Approximate statistics based on the first 1000 samples:

	sentence_0	sentence_1	label
type	string	string	float
details	min: 15 tokens mean: 166.27 tokens max: 512 tokens	min: 11 tokens mean: 131.56 tokens max: 512 tokens	min: 0.87 mean: 0.96 max: 1.0

Samples:

sentence_0	sentence_1	label
['Each party hereby grants to the other a non-exclusive, limited license to use its trademarks, service marks or trade names only as specifically described in this Agreement.', "Subject to the terms and conditions of this Agreement, Application Provider hereby grants to Excite@Home a royalty-free, non-exclusive, worldwide license to use, reproduce, distribute, transmit and publicly display the e-centives Content in accordance with this Agreement and to sub-license the Application Content to Excite@Home's wholly-owned subsidiaries or to joint ventures in which Excite@Home participates for the sole purpose of using, reproducing, distributing, transmitting and publicly displaying the e-centives Content in accordance with this Agreement, provided that no such sublicensing shall be to Application Provider Named Competitors."]	Subject to the terms and conditions of this Agreement, Application Provider hereby grants to Excite@Home a royalty-free, non-exclusive, worldwide license to use, reproduce, distribute, transmit and publicly display the e-centives Content in accordance with this Agreement and to sub-license the Application Content to Excite@Home's wholly-owned subsidiaries or to joint ventures in which Excite@Home participates for the sole purpose of using, reproducing, distributing, transmitting and publicly displaying the e-centives Content in accordance with this Agreement, provided that no such sublicensing shall be to Application Provider Named Competitors.	`0.9886096715927124`
`['For clarity, ENERGOUS shall not intentionally supply Products, Product Die or comparable products or product die to customers directly or through distribution channels.']`	`Distributor shall (a) procure the Products solely from STAAR (or its affiliates) and not (b) procure, manufacture, market or sell in the Territory any implantable medical devices that compete directly or indirectly with the Products, during the term of this Agreement.`	`0.9340255260467529`
`['Except as may otherwise be provided in this Agreement, Consultant may not sell, assign or delegate any rights or obligations under this Agreement.']`	`Except as may otherwise be provided in this Agreement, Consultant may not sell, assign or delegate any rights or obligations under this Agreement.`	`0.9797248244285583`

Loss: CosineSimilarityLoss with these parameters:

{
    "loss_fct": "torch.nn.modules.loss.MSELoss"
}

Training Hyperparameters

Non-Default Hyperparameters

per_device_train_batch_size: 16
per_device_eval_batch_size: 16
multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand

overwrite_output_dir: False
do_predict: False
eval_strategy: no
prediction_loss_only: True
per_device_train_batch_size: 16
per_device_eval_batch_size: 16
per_gpu_train_batch_size: None
per_gpu_eval_batch_size: None
gradient_accumulation_steps: 1
eval_accumulation_steps: None
torch_empty_cache_steps: None
learning_rate: 5e-05
weight_decay: 0.0
adam_beta1: 0.9
adam_beta2: 0.999
adam_epsilon: 1e-08
max_grad_norm: 1
num_train_epochs: 3
max_steps: -1
lr_scheduler_type: linear
lr_scheduler_kwargs: {}
warmup_ratio: 0.0
warmup_steps: 0
log_level: passive
log_level_replica: warning
log_on_each_node: True
logging_nan_inf_filter: True
save_safetensors: True
save_on_each_node: False
save_only_model: False
restore_callback_states_from_checkpoint: False
no_cuda: False
use_cpu: False
use_mps_device: False
seed: 42
data_seed: None
jit_mode_eval: False
use_ipex: False
bf16: False
fp16: False
fp16_opt_level: O1
half_precision_backend: auto
bf16_full_eval: False
fp16_full_eval: False
tf32: None
local_rank: 0
ddp_backend: None
tpu_num_cores: None
tpu_metrics_debug: False
debug: []
dataloader_drop_last: False
dataloader_num_workers: 0
dataloader_prefetch_factor: None
past_index: -1
disable_tqdm: False
remove_unused_columns: True
label_names: None
load_best_model_at_end: False
ignore_data_skip: False
fsdp: []
fsdp_min_num_params: 0
fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
tp_size: 0
fsdp_transformer_layer_cls_to_wrap: None
accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
deepspeed: None
label_smoothing_factor: 0.0
optim: adamw_torch
optim_args: None
adafactor: False
group_by_length: False
length_column_name: length
ddp_find_unused_parameters: None
ddp_bucket_cap_mb: None
ddp_broadcast_buffers: False
dataloader_pin_memory: True
dataloader_persistent_workers: False
skip_memory_metrics: True
use_legacy_prediction_loop: False
push_to_hub: False
resume_from_checkpoint: None
hub_model_id: None
hub_strategy: every_save
hub_private_repo: None
hub_always_push: False
gradient_checkpointing: False
gradient_checkpointing_kwargs: None
include_inputs_for_metrics: False
include_for_metrics: []
eval_do_concat_batches: True
fp16_backend: auto
push_to_hub_model_id: None
push_to_hub_organization: None
mp_parameters:
auto_find_batch_size: False
full_determinism: False
torchdynamo: None
ray_scope: last
ddp_timeout: 1800
torch_compile: False
torch_compile_backend: None
torch_compile_mode: None
include_tokens_per_second: False
include_num_input_tokens_seen: False
neftune_noise_alpha: None
optim_target_modules: None
batch_eval_metrics: False
eval_on_start: False
use_liger_kernel: False
eval_use_gather_object: False
average_tokens_across_devices: False
prompts: None
batch_sampler: batch_sampler
multi_dataset_batch_sampler: round_robin

Training Logs

Epoch	Step	Training Loss
0.4340	500	0.0
0.8681	1000	0.0
1.3021	1500	0.0
1.7361	2000	0.0
2.1701	2500	0.0
2.6042	3000	0.0

Framework Versions

Python: 3.11.12
Sentence Transformers: 3.4.1
Transformers: 4.51.1
PyTorch: 2.6.0+cu124
Accelerate: 1.5.2
Datasets: 3.5.0
Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

Downloads last month: 15

Safetensors

Model size

0.1B params

Tensor type

F32

Model tree for Skate-16/Clause-Guard

Base model

nlpaueb/legal-bert-base-uncased

Finetuned

(110)

this model

Paper for Skate-16/Clause-Guard

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Paper • 1908.10084 • Published Aug 27, 2019 • 18