metadata
language:
- en
license: apache-2.0
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:7315
- loss:MultipleNegativesRankingLoss
base_model: BAAI/bge-base-en-v1.5
widget:
- source_sentence: >-
Subject to the Terns and conditions of Section 1.3.3, below, Landlord
hereby
grants to the Tenant originally named in this Lease (the "Original
Tenant") and any "Permitted Transferee," as that term is set forth in
Section 14,Z of this Lease (but only to the extent such Permitted
Transferee has, in Landiord's reasonable determination, financia) strength
egual to or greater than Original Tenant), an ongoing right of first
refusal with respect to the remaining icasable space located within the
Building (the "First Refusal Space").
1.3.1
Procedure for Lease.
1.3.1.1 Procedure for Offer. Landlord shall notify Tenant (the "First
Refusal Notice") from
time-to-time when and if Landlord receives a "bona-fide third-party offer"
for all or a portion of the First Refusal Space.
Pursuant to such First Refusal Notice, Landlord shall offer to lease to
Tenant the applicable First Refusal Space. The First Refusal Notice shall
describe the First Refusal Space, and the lease term, rent, square footage
and other fundamental cconomic terms and conditions, upon which Landlord
proposes to lease such First Refusal Space pursuant to the bona-fide
third-party offer. For purposes of this Section 1.3, a "bona-fide
third-party offer" shall mean a counter-offer received by Landlord to
lease First Refusal Space from a qualified third party which Landlord
would otherwise be willing to accept.
For purposes of example only, the following would each constitute a
bona-fide third-party offer:
Landlord receives a request for proposal from a qualified third party.
Landlord responds to the request for proposal with a lease proposal and
subsequently receives a written bona-fide counter proposal from the
qualified third party.
(11)
Landlord receives a written offer to lease from a qualified third party.
Landiord responds to the offer with a written counter offer and
subsequently receives a bona-fide counter to Landlord's counter offer from
the qualified third party.
sentences:
- Right of First Refusal
- Late Payment Trigger Period (days)
- Right of First Refusal
- source_sentence: >2
Rental Year. The last Rental Year of the term shall terminate upon the expiration
or earlier termination ofthis lease as the case may be.
-4.
(60) "Warehouse/ Office Centre" means the Landsandthe Building.
(m) "Structure, Structural and Structural Repairs" refer to the foundation system
(being piles, pile caps and grade beams), steel structure (being columns,joists,
beams and bracings), the floor slab, exterior walls and the roof deck but not
insulation ofthe roof or the roof membraneorsurface of the roofof the Building.
(n) "Term" means the term of the Lease as set forth in Article 2.02 hereof and any
renewalthereof.
.
ARTICLE TWO
.
DEMISE AND TERM
.
2.01 Demise. The Landlord HEREBY LEASESto the Tenant the Premises
comprising approximately 530 square feet, known as Unit 255-5759 Highway 9, Lockport, MB.
.
2.02 Term. The Tenant shall have and hold the Premises for the term of FIVE (5)
years which shall commence on the IST day of January, 2021 (herein called the
"Commencement Date"), and shall terminate on the 31ST day of December, 2025.
.
ARTICLE THREE
.
RENT, TAXES AND OTHER CHARGES
.
3.00 The Tenant shall pay to the Landlord or as the Landlord mayin writing direct,
without any set-off, compensation or deduction save as herein expressly provided, the Basic Rent
and Additional Rent.
.
3.01 Basic Rent. The Tenant shall punctually pay to the Landlord monthly in
advance from the Rent CommencementDate rental as follows:
(a) during the first THREE (3) years of the Term of the Lease, the annual rental of
.
FIVE THOUSAND NINE HUNDRED SIXTY TWO. 50/100 Dollars
($5,962.50) payable in monthly instalments of FOUR HUNDRED AND
p
.
NINTYSIX. 88/100 Dollars ( $496.88) on the first of each month;
(b) during the remaining TWO(2) years of the Term of the Lease, the annualrental
of SIX THOUSAND AND NINTYFIVE. xx/100 Dollars ($ 6,095.00) payable
in monthly instalments of FIVE HUNDRED AND SEVEN. 92/100 Dollars
($507.92)onthefirst of each month;
.
The foregoing paymentsshall be payable in lawful money of Canada and are hereinafter referred
to as "Basic Rent".
.
3.02 Additional Rent
19.07 Representations and Entire Agreement. The Tenant acknowledgesand agreesthat
the Landlord has made no representations, covenants, warranties, guarantees, promises or
agreements (verbal or otherwise) with the Tenant other than those contained in this Lease; that
no agreement collateral hereto will be binding upon the Landlord unless made in writing and
signed by the Landlord; and, that this Lease constitutes the entire agreement between the
.
Landlord and Tenant.
-20-
19.08 Notice. Any notice, or request or demand herein provided
or permitted to be
given hereunder, shall be sufficiently given if personally served or
mailed by registered mail as
follows:
(a) to the Landlord:
.
SHIV INVESTMENTSLTD.
.
4665 MAIN STREET
.
WESTST. PAUL
.
MB-R4A 344
(b) to the Tenant:
.
HUB INTERNATIONAL
.
UNIT 255-5759 HIGHWAY44
.
LOCKPORT
sentences:
- Lessee Legal Name
- Right of First Refusal Details
- Lease Property Address
- source_sentence: >2
THIS LEASE AGREEMENT (this "Lease") is made and entered into on this 10th day of November
2015, by and between Bank of the West, a California banking corporation
hereinafter referred to as
"Landlord"; and HUB International Mountain States Limited, a Wyoming
corporation, hereinafter referred to
as "Tenant."
1. Premises: Landlord hereby leases to Tenant space in the building
(the "Building") located at the real
property commonly known as 1027 4th Avenue, Worthington, MN 56187 (the "Property") consisting
of approximately 1,237 square feet in Suite 101, as more fully depicted on Exhibit A attached hereto
(the "Premises").
2. Term: The term of this Lease shall be for a period of three (3)
years, commencing on February 1,
Postal Service, Return Receipt Requested, or recognized overnight courier, with delivery charges
thereon fully prepaid, addressed to each party at the addresses below, or to such other addresses as
the parties may hereinafter designate by written notice. Any such notice shall be deemed to have
been completed, if mailed as provided herein, on the date of actual delivery as shown by the
addressee's certification of receipt.
.
14
.
Worthington
.
The notices shall be addressed as follows:
.
Landlord Tenant
.
Bank of the West c/o HUB International Limited
.
Corporate Real Estate 300 North LaSalle Street, Floor 17
.
520 Main Avenue Chicago, IL 60654
.
Fargo, ND 58124 Attn: Legal Department
.
With a copy to: With a copy to:
.
Bank of the West HUB International Mountain States Ltd
.
Corporate Real Estate 101 S. Main Street
.
300 South Grand Avenue Sheridan, WY 82801
sentences:
- Lessee Legal Name
- Lease Property Address
- Assignment - Consent Required
- source_sentence: >2-
18. DEFAULT AND REENTRY.
(a) Tenant shall observe and perform all the conditions and agreements herein contained to be
observed and performed by Tenant. Each of the following events constitutes
an event of default by Tenant:
(i) Tenant shall fail to pay any installment of rent, or any other charges due under this
.
Lease within five (5) business days following Tenant’s receipt of written notice from
.
Landlord advising Tenant of such failure. Any rent or other charges due hereunder that are
paid more than five (5) business days after the applicable due date shall accrue interest from
the due date at the rate of eight percent (8%) per annum until payment is received by
.
Landlord.
(ii) Tenant shall fail to comply with any term, provision, covenant or condition of this
With the exception of janitorial services, telecommunication and internet
costs, which shall be paid by Tenant, Tenant shall have no obligation to
pay for any of the foregoing utilities and services serving the Property.
Landlord represents and warrants that the Building is connected to sewer,
water, electric, gas, internet and telephone utility services and will
continue to be connected to such services during the Term. In the event of
an interruption in any utility service, Landlord shall diligently pursue
the resumption of service. If any such interruption continues for a period
in excess of five (5) consecutive business days from Tenant’s notice of
same to Landlord (which notice may be telephonic), then Gross Rent and
other regularly scheduled charges hereunder shall be equitably adjusted
during the period of such interruption from and after such five (5)
business day period.
sentences:
- Right of First Offer (ROFO)
- Parking Facility Allotted
- Late Payment Trigger Period (days)
- source_sentence: >-
SECTION THREE RENT A. Base Rent. Tenant shall pay the following Base Rent,
without reduction or set-off, during the Term: (i) Initial Term. For the
one (1) year period commencing on the Commencement Date the Base Rent
shall be Eleven Thousand Seven Hundred and Four Dollars and Fifty Cents
($11,704.50) per month, payable in advance on the first (1") day of each
month (the "due date"), provided however, that Rent for the first (1")
month shall be due and payable immediately upon Tenant's execution of this
Lease. During each subsequent one (I) year period during the Initial Term,
the monthly Base Rent shall be increased by three percent (3%). Rent
received after the tenth (IOlh) day of the month it is due shall result in
an 2 additional late charge equal to five percent (5%) of the monthly Base
Rent that is late, and such late charge shall be due and payable as
Additional Rent with the Base Rent payment for the following calendar
month, or if the Initial Term has expired, within fifteen (15) days of
Landlord's written demand for payment. (ii) Extension Term. For the one
(1) year period commencing on the first (1 ") day of the First Extension
Term, the Base Rent shall be Twenty-One Thousand One Hundred Thirty-Nine
Dollars and Sixty-Three Cents ($21,139.63) per month, payable in advance
on the first (1 ") day of each month (the "due date"). During each
subsequent one (1) year period during the First Extension Term and the
Second Extension Term, the monthly Base Rent shall be increased by three
percent (3%). Rent received after the tenth (1oth) day of the month it is
due shall result in an additional late charge equal to five percent (5%)
of the monthly Base Rent that is late, and such late charge shall be due
and payable as Additional Rent with the Base Rent payment for the
following calendar month, or if the applicable Extension Term has expired,
within fifteen (15) days of Landlord's written demand for payment. (iii)
Holdover Tenancy.
Any holdover tenancy shall be month to month, and can be terminated by
either party upon thirty (30) days advanced written notice. The monthly
Base Rent during the period of any holdover tenancy shall be an amount
equal to two (2) times the monthly Base Rent provided in (i) or (ii) above
for the most recently completed month of the Initial Term or any
applicable Extension Term, payable in advance on the first (1 ") day of
each month. Rent received after the tenth (10th) day of the month it is
due shall result in an additional late charge equal to five percent (5%)
of the monthly Base Rent that is late, and such late charge shall be due
and payable as Additional Rent with the Base Rent payment for the
following calendar month, or at Landlord's option, which Landlord may
exercise at any time, within fifteen (15) days of Landlord's written
demand for payment. Tenant shall be responsible for paying all items of
Additional Rent, as specified below (and described elsewhere in this
Lease), during the period of any holdover tenancy. (iv) Rent Exhibit. The
Base Rent during the Initial Term and Extension Terms is set forth on
Exhibit A attached hereto and incorporated herein by this reference. B.
Additional Rent. The following items shall be paid by Tenant as Additional
Rent during the entire Term, and during the period of any holdover
tenancy. In the event this Lease is terminated in a manner permitted by
this Lease, or in the event of a holdover tenancy, annual items of
Additional Rent shall be pro-rated, and Tenant shall only be responsible
for its proportionate share of such Additional Rent for periods prior to
the termination of the Lease andlor any holdover tenancy. (i) Late Rent.
The late charges specified in A. above for rental payments that are late
shall be an item of Additional Rent due with the rental payment for the
calendar month immediately following the month in which the late payment
was incurred.
sentences:
- Late Payment Trigger Period (days)
- Parking Details - Additional Information
- Late Payment Trigger Period Details
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
- cosine_accuracy@1
- cosine_accuracy@3
- cosine_accuracy@5
- cosine_accuracy@10
- cosine_precision@1
- cosine_precision@3
- cosine_precision@5
- cosine_precision@10
- cosine_recall@1
- cosine_recall@3
- cosine_recall@5
- cosine_recall@10
- cosine_ndcg@10
- cosine_mrr@10
- cosine_map@100
model-index:
- name: BGE base En v1.5 Phase 5
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: dim 768
type: dim_768
metrics:
- type: cosine_accuracy@1
value: 0.005591054313099041
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.015175718849840255
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.027955271565495207
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.05830670926517572
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.005591054313099041
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.005058572949946752
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.005591054313099041
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.005830670926517572
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.005591054313099041
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.015175718849840255
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.027955271565495207
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.05830670926517572
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.026120990687120055
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.01660010649627263
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.029745651990891568
name: Cosine Map@100
BGE base En v1.5 Phase 5
This is a sentence-transformers model finetuned from BAAI/bge-base-en-v1.5. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
Model Details
Model Description
- Model Type: Sentence Transformer
- Base model: BAAI/bge-base-en-v1.5
- Maximum Sequence Length: 512 tokens
- Output Dimensionality: 768 dimensions
- Similarity Function: Cosine Similarity
- Language: en
- License: apache-2.0
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
Full Model Architecture
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("RishuD7/bge-base-en-v1.5-65-keys-phase-5-exp_v1")
# Run inference
sentences = [
'SECTION THREE RENT A. Base Rent. Tenant shall pay the following Base Rent, without reduction or set-off, during the Term: (i) Initial Term. For the one (1) year period commencing on the Commencement Date the Base Rent shall be Eleven Thousand Seven Hundred and Four Dollars and Fifty Cents ($11,704.50) per month, payable in advance on the first (1") day of each month (the "due date"), provided however, that Rent for the first (1") month shall be due and payable immediately upon Tenant\'s execution of this Lease. During each subsequent one (I) year period during the Initial Term, the monthly Base Rent shall be increased by three percent (3%). Rent received after the tenth (IOlh) day of the month it is due shall result in an 2 additional late charge equal to five percent (5%) of the monthly Base Rent that is late, and such late charge shall be due and payable as Additional Rent with the Base Rent payment for the following calendar month, or if the Initial Term has expired, within fifteen (15) days of Landlord\'s written demand for payment. (ii) Extension Term. For the one (1) year period commencing on the first (1 ") day of the First Extension Term, the Base Rent shall be Twenty-One Thousand One Hundred Thirty-Nine Dollars and Sixty-Three Cents ($21,139.63) per month, payable in advance on the first (1 ") day of each month (the "due date"). During each subsequent one (1) year period during the First Extension Term and the Second Extension Term, the monthly Base Rent shall be increased by three percent (3%). Rent received after the tenth (1oth) day of the month it is due shall result in an additional late charge equal to five percent (5%) of the monthly Base Rent that is late, and such late charge shall be due and payable as Additional Rent with the Base Rent payment for the following calendar month, or if the applicable Extension Term has expired, within fifteen (15) days of Landlord\'s written demand for payment. (iii) Holdover Tenancy.\nAny holdover tenancy shall be month to month, and can be terminated by either party upon thirty (30) days advanced written notice. The monthly Base Rent during the period of any holdover tenancy shall be an amount equal to two (2) times the monthly Base Rent provided in (i) or (ii) above for the most recently completed month of the Initial Term or any applicable Extension Term, payable in advance on the first (1 ") day of each month. Rent received after the tenth (10th) day of the month it is due shall result in an additional late charge equal to five percent (5%) of the monthly Base Rent that is late, and such late charge shall be due and payable as Additional Rent with the Base Rent payment for the following calendar month, or at Landlord\'s option, which Landlord may exercise at any time, within fifteen (15) days of Landlord\'s written demand for payment. Tenant shall be responsible for paying all items of Additional Rent, as specified below (and described elsewhere in this Lease), during the period of any holdover tenancy. (iv) Rent Exhibit. The Base Rent during the Initial Term and Extension Terms is set forth on Exhibit A attached hereto and incorporated herein by this reference. B. Additional Rent. The following items shall be paid by Tenant as Additional Rent during the entire Term, and during the period of any holdover tenancy. In the event this Lease is terminated in a manner permitted by this Lease, or in the event of a holdover tenancy, annual items of Additional Rent shall be pro-rated, and Tenant shall only be responsible for its proportionate share of such Additional Rent for periods prior to the termination of the Lease andlor any holdover tenancy. (i) Late Rent. The late charges specified in A. above for rental payments that are late shall be an item of Additional Rent due with the rental payment for the calendar month immediately following the month in which the late payment was incurred.',
'Late Payment Trigger Period (days)',
'Late Payment Trigger Period Details',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
Evaluation
Metrics
Information Retrieval
- Dataset:
dim_768 - Evaluated with
InformationRetrievalEvaluator
| Metric | Value |
|---|---|
| cosine_accuracy@1 | 0.0056 |
| cosine_accuracy@3 | 0.0152 |
| cosine_accuracy@5 | 0.028 |
| cosine_accuracy@10 | 0.0583 |
| cosine_precision@1 | 0.0056 |
| cosine_precision@3 | 0.0051 |
| cosine_precision@5 | 0.0056 |
| cosine_precision@10 | 0.0058 |
| cosine_recall@1 | 0.0056 |
| cosine_recall@3 | 0.0152 |
| cosine_recall@5 | 0.028 |
| cosine_recall@10 | 0.0583 |
| cosine_ndcg@10 | 0.0261 |
| cosine_mrr@10 | 0.0166 |
| cosine_map@100 | 0.0297 |
Training Details
Training Dataset
Unnamed Dataset
- Size: 7,315 training samples
- Columns:
positiveandanchor - Approximate statistics based on the first 1000 samples:
positive anchor type string string details - min: 63 tokens
- mean: 345.31 tokens
- max: 512 tokens
- min: 4 tokens
- mean: 6.58 tokens
- max: 10 tokens
- Samples:
positive anchor · 12/14/2005 11.28 IFAX Chwkfaxlslimanstander.com "* Kelly Ramsden lg]001/013
.
THIS LEASE, dated for reference the 1st day of December, 2004, is
.
BETWEEN:
.
OXFORD DEVELOPMENTS LTD. a company duly incorporated under the
laws of the Province of British Columbia under nwnber 640355 and having it>
registered and records office at 201-45793 Luckakuck Way, Chilliwack, B.C.
.
V2R5P9
(hereinafter called the "Landlord")
.
OF THE FIRST PART
.
AND:
.
HUB INTERNATIONAL BARTON LIMITED having an office
at 45710 Airport Road, Chilliwack, B.C. V2P 6Z9
(hcrcinatlcr called the "Tenant")
.
...Lessee Legal NameTenant shall pay to Landlord, as a fee (the "Termination Fee"), an amount equal to the Unamortized Portion (as hereinafter defined) of the following amounts, plus interest thereon at the rate of 7.5% per annum, compounded monthly (collectively, in the aggregate "Transaction Costs"): (1) brokerage commissions incurred by Landlord, and (2) Landlord's reasonable attorney's fees, in each case in connection with entering into this Lease. Tenant shall pay fifty percent (50%) of the Termination Fee to Landlord within thirty (30) days following Tenant's delivery of Tenant's termination notice, and the remaining fifty percent (50%) of the Termination Fee shall be paid by Tenant on or before July 1, 2024Early Termination Costs for LesseeAny expenses related to subsequent revisions will be the expense of Tenant Landlord(s):__________ 16 of 20 PA Tenant(s):__________ C. Termination Option Tenant shall have the right to cancel the lease (the “Termination Option”) effective on February 28, 2019 (the “Termination Date”). Tenant shall provide Landlord notice of its intent to exercise this Termination Option no later than May 31, 2018, and shall pay Landlord by the Termination Date a termination fee equal to the unamortized portion of the leasing commission and Tenant Improvement Expenses (as defined in Exhibit B) incurred by Landlord as a result of this lease transaction, plus a “remarketing fee” of $5,000.00. IN WITNESS WHEREOF, the parties have executed this Lease as of the date hereof..
LANDLORD:
S and S Crossroads, LLC
By:
...Early Termination Notice - Loss:
MultipleNegativesRankingLosswith these parameters:{ "scale": 20.0, "similarity_fct": "cos_sim" }
Training Hyperparameters
Non-Default Hyperparameters
eval_strategy: epochper_device_train_batch_size: 32per_device_eval_batch_size: 16gradient_accumulation_steps: 16learning_rate: 2e-05num_train_epochs: 30lr_scheduler_type: cosinewarmup_ratio: 0.1tf32: Falseload_best_model_at_end: Trueoptim: adamw_torch_fusedbatch_sampler: no_duplicates
All Hyperparameters
Click to expand
overwrite_output_dir: Falsedo_predict: Falseeval_strategy: epochprediction_loss_only: Trueper_device_train_batch_size: 32per_device_eval_batch_size: 16per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 16eval_accumulation_steps: Nonelearning_rate: 2e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1.0num_train_epochs: 30max_steps: -1lr_scheduler_type: cosinelr_scheduler_kwargs: {}warmup_ratio: 0.1warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falseuse_ipex: Falsebf16: Falsefp16: Falsefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Falselocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Trueignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torch_fusedoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Falsehub_always_push: Falsegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseeval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters:auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Nonedispatch_batches: Nonesplit_batches: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: Falseneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseprompts: Nonebatch_sampler: no_duplicatesmulti_dataset_batch_sampler: proportional
Training Logs
| Epoch | Step | Training Loss | dim_768_cosine_ndcg@10 |
|---|---|---|---|
| 0.6987 | 10 | 2.5547 | - |
| 1.3974 | 20 | 1.0737 | - |
| 2.0961 | 30 | 0.0724 | - |
| 2.7948 | 40 | 0.0 | - |
| 3.4934 | 50 | 0.0 | - |
| 3.7729 | 54 | - | 0.0239 |
| 1.3537 | 60 | 0.9932 | - |
| 2.0524 | 70 | 1.193 | - |
| 2.7511 | 80 | 0.0518 | - |
| 3.4498 | 90 | 0.0009 | - |
| 4.1485 | 100 | 0.0 | - |
| 4.7773 | 109 | - | 0.0228 |
| 2.0087 | 110 | 0.0154 | - |
| 2.7074 | 120 | 1.0959 | - |
| 3.4061 | 130 | 0.2585 | - |
| 4.1048 | 140 | 0.0006 | - |
| 4.8035 | 150 | 0.0 | - |
| 5.5022 | 160 | 0.0 | - |
| 5.7817 | 164 | - | 0.0274 |
| 3.3624 | 170 | 0.5192 | - |
| 4.0611 | 180 | 0.5537 | - |
| 4.7598 | 190 | 0.0037 | - |
| 5.4585 | 200 | 0.0 | - |
| 6.1572 | 210 | 0.0 | - |
| 6.786 | 219 | - | 0.0283 |
| 4.0175 | 220 | 0.0219 | - |
| 4.7162 | 230 | 0.756 | - |
| 5.4148 | 240 | 0.156 | - |
| 6.1135 | 250 | 0.0002 | - |
| 6.8122 | 260 | 0.0 | - |
| 7.5109 | 270 | 0.0 | - |
| 7.7904 | 274 | - | 0.0264 |
| 5.3712 | 280 | 0.4501 | - |
| 6.0699 | 290 | 0.4103 | - |
| 6.7686 | 300 | 0.0009 | - |
| 7.4672 | 310 | 0.0 | - |
| 8.1659 | 320 | 0.0 | - |
| 8.7948 | 329 | - | 0.0280 |
| 6.0262 | 330 | 0.0287 | - |
| 6.7249 | 340 | 0.6199 | - |
| 7.4236 | 350 | 0.1078 | - |
| 8.1223 | 360 | 0.0001 | - |
| 8.8210 | 370 | 0.0 | - |
| 9.5197 | 380 | 0.0 | - |
| 9.7991 | 384 | - | 0.0263 |
| 7.3799 | 390 | 0.3923 | - |
| 8.0786 | 400 | 0.3161 | - |
| 8.7773 | 410 | 0.0006 | - |
| 9.4760 | 420 | 0.0 | 0.0261 |
- The bold row denotes the saved checkpoint.
Framework Versions
- Python: 3.10.12
- Sentence Transformers: 3.3.1
- Transformers: 4.41.2
- PyTorch: 2.1.2+cu121
- Accelerate: 1.1.1
- Datasets: 2.19.1
- Tokenizers: 0.19.1
Citation
BibTeX
Sentence Transformers
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
MultipleNegativesRankingLoss
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}