Anakeen/datasets_apn_sts_0.8_v2

SentenceTransformer based on sentence-transformers/paraphrase-multilingual-mpnet-base-v2

This is a sentence-transformers model finetuned from sentence-transformers/paraphrase-multilingual-mpnet-base-v2 on the apnc and apnd datasets. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/paraphrase-multilingual-mpnet-base-v2
• Maximum Sequence Length: 128 tokens
• Output Dimensionality: 768 tokens
• Similarity Function: Cosine Similarity
• Training Datasets:
  • apnc
  • apnd

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 128, 'do_lower_case': False}) with Transformer model: XLMRobertaModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("Anakeen/datasets_apn_sts_0.8_v2")
# Run inference
sentences = [
    'The liability of the Reinsured to indemnify Capricorn (Isle of Man) Limited who in turn offer a discretionary deed of indemnity to Capricorn Mutual Limited ABN 24 104 601 194 for the protections set out below.',
    'Sacramento Municipal Utility District (hereinafter called the “Insured”)',
    'The length of the loss defined here above will be limited to: - 168 consecutive hours in case of social disorder; for the risks of strikes; riots; popular movements; urban violence for all the damages occurring in France. - 168 consecutive hours for all other guarantees covered by the Ceding Company in their original policies and defined in the “Interest to the Treaty” article. The Ceding Company may decide at its option the time and date of commencement of any period of consecutive hours and if any event is of longer duration than the said periods; the Ceding Company may divide it into two or more events provided that no two periods overlap and no period commences before the date and time of the occurrence of the first individual loss suffered by it as a result of the event. No individual claim arising from any insured risk occurring outside the above periods will be included in the event.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Datasets

apnc

• Dataset: apnc
• Size: 635 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 4 tokens mean: 94.86 tokens max: 128 tokens	min: 4 tokens mean: 100.19 tokens max: 128 tokens	min: 9 tokens mean: 105.75 tokens max: 128 tokens

• Samples:

  anchor	positive	negative
  1. This Contract does not cover any loss or liability accruing to the Reassured; directly or indirectly and whether as Insurer or Reinsurer; from any Pool of Insurers or Reinsurers formed for the purpose of covering Atomic or Nuclear Energy risks. 2. Without in any way restricting the operation of paragraph (1) of this Clause; this Contract does not cover any loss or liability accruing to the Reassured; directly or indirectly and whether as Insurer or Reinsurer; from any insurance against Physical Damage (including business interruption or consequential loss arising out of such Physical Damage) to: I. Nuclear reactor power plants including all auxiliary property on the site; or II. Any other nuclear reactor installation; including laboratories handling radioactive materials in connection with reactor installations; and “critical facilities” as such; or III. Installations for fabricating complete fuel elements or for processing substantial quantities of “special nuclear material;” and for reprocessing; salvaging; chemically separating; storing or disposing of “spent” nuclear fuel or waste materials; or IV. Installations other than those listed in paragraph (2) III above using substantial quantities of radioactive isotopes or other products of nuclear fission. 3. Without in any way restricting the operations of paragraphs (1) and (2) hereof; this Contract does not cover any loss or liability by radioactive contamination accruing to the Reassured; directly or indirectly; and whether as Insurer or Reinsurer; from any insurance on property which is on the same site as a nuclear reactor power plant or other nuclear installation and which normally would be insured therewith except that this paragraph (3) shall not operate (a) where the Reassured does not have knowledge of such nuclear reactor power plant or nuclear installation; or (b) where said insurance contains a provision excluding coverage for damage to property caused by or resulting from radioactive contamination; however caused. However on and after 1st January 1960 this sub-paragraph (b) shall only apply provided the said radioactive contamination exclusion provision has been approved by the Governmental Authority having jurisdiction thereof. 4. Without in any way restricting the operations of paragraphs (1); (2) and (3) hereof; this Contract does not cover any loss or liability by radioactive contamination accruing to the Reassured; directly or indirectly; and whether as Insurer or Reinsurer; when such radioactive contamination is a named hazard specifically insured against. 5. It is understood and agreed that this Clause shall not extend to risks using radioactive isotopes in any form where the nuclear exposure is not considered by the Reassured to be the primary hazard. 6. The term “special nuclear material” shall have the meaning given it in the Atomic Energy Act of 1954 or by any law amendatory thereof. 7. The Reassured to be sole judge of what constitutes: (a) substantial quantities; and (b) the extent of installation; plant or site. Note. Without in any way restricting the operation of paragraph (1) hereof; it is understood and agreed that (a) all policies issued by the Reassured on or before 31st December 1957 shall be free from the application of the other provisions of this Clause until expiry date or 31st December 1960 whichever first occurs whereupon all the provisions of this Clause shall apply; (b) with respect to any risk located in Canada policies issued by the Reassured on or before 31st December 1958 shall be free from the application of the other provisions of this Clause until expiry date or 31st December 1960 whichever first occurs whereupon all the provisions of this Clause shall apply.	NUCLEAR INCIDENT EXCLUSION CLAUSE - PHYSICAL DAMAGE - REINSURANCE - U.S.A. 1. This Reinsurance does not cover any loss or liability accruing to the Reassured; directly or indirectly; and whether as Insurer or Reinsurer; from any Pool of Insurers or Reinsurers formed for the purpose of covering Atomic or Nuclear Energy risks. 2. Without in any way restricting the operation of paragraph (1) of this clause; this Reinsurance does not cover any loss or liability accruing to the Reassured; directly or indirectly and whether as Insurer or Reinsurer; from any insurance against Physical Damage (including business interruption or consequential loss arising out of such Physical Damage) to: I. Nuclear reactor power plants including all auxiliary property on the site; or II. Any other nuclear reactor installation; including laboratories handling radioactive materials in connection with reactor installations; and “critical facilities” as such; or III. Installations for fabricating complete fuel elements or for processing substantial quantities of “special nuclear material”; and for reprocessing; salvaging; chemically separating; storing or disposing of “spent” nuclear fuel or waste materials; or IV. Installations other than those listed in paragraph (2) III above using substantial quantities of radioactive isotopes or other products of nuclear fission. 3. Without in any way restricting the operations of paragraphs (1) and (2) hereof; this Reinsurance does not cover any loss or liability by radioactive contamination accruing to the Reassured; directly or indirectly; and whether as Insurer or Reinsurer; from any insurance on property which is on the same site as a nuclear reactor power plant or other nuclear installation and which normally would be insured therewith except that this paragraph (3) shall not operate (a) where Reassured does not have knowledge of such nuclear reactor power plant or nuclear installation; or (b) where said insurance contains a provision excluding coverage for damage to property caused by or resulting from radioactive contamination; however caused. However on and after 1st January 1960 this sub-paragraph (b) shall only apply provided the said radioactive contamination exclusion provision has been approved by the Governmental Authority having jurisdiction thereof. 4. Without in any way restricting the operations of paragraphs (1); (2) and (3) hereof; this Reinsurance does not cover any loss or liability by radioactive contamination accruing to the Reassured; directly or indirectly; and whether as Insurer or Reinsurer; when such radioactive contamination is a named hazard specifically insured against. 5. It is understood and agreed that this clause shall not extend to risks using radioactive isotopes in any form where the nuclear exposure is not considered by the Reassured to be the primary hazard. 6. The term “special nuclear material” shall have the meaning given it in the Atomic Energy Act of 1954 or by any law amendatory thereof. 7. Reassured to be sole judge of what constitutes: (a) substantial quantities; and (b) the extent of installation; plant or site. Note: Without in any way restricting the operation of paragraph (1) hereof; it is understood and agreed that (a) all policies issued by the Reassured on or before 31st December 1957 shall be free from the application of the other provisions of this Clause until expiry date or 31st December 1960 whichever first occurs whereupon all the provisions of this Clause shall apply. (b) with respect to any risk located in Canada policies issued by the Reassured on or before 31st December 1958 shall be free from the application of the other provisions of this Clause until expiry date or 31st December 1960 whichever first occurs whereupon all the provisions of this Clause shall apply. 12/12/57 NMA 1119	USD 40;000;000. Payable in two equal instalments on 1st March 2022 and 1st August 2022
  Downgrading clause ~ ABR1001 (Amended) Reinsurer with an S&P Rating Unless otherwise agreed by the Reinsured; the Reinsurer shall at all times during the Period of this Contract maintain an Insurer Financial Strength (IFS) rating from Standard & Poor's Rating Group of 55 Water Street; New York; NY 10041; USA ("S&P") equal to or greater than a rating of A minus as applied by S&P to that Reinsurer.	The Reinsured may terminate a Reinsurer’s percentage share in this Reinsurance at any time by giving written notice to the Reinsurer in the event of any of the following circumstances: [list of circumstances]... After the date of cancellation; under either paragraph A. or B. above; the liability of the Reinsurer hereunder shall cease outright other than in respect of losses which have occurred prior thereto.	The Reinsurer may not disclose this information to other parties except to evaluate the Contract or program placement or claim; actual or precautionary against the Contract or program. The Reinsurer agrees that “Confidential Information” is defined as statistics on premiums; losses; expenses; limits and exposures; as well as business plans; coverage forms and underwriting standards or guidelines and any other information supplied during the formation of this Contract. The Reinsurer also agrees information on the type and amount of insurance or reinsurance covered is also confidential and shall not be disclosed to any third party without the express written consent of the Association. This Confidential Information shall not include: i) Information already in public domain; ii) Information that comes into the public domain (other than via breach of this Contract); iii) Information lawfully known to Reinsurer before being disclosed by the Association or their agent; iv) Information independently developed by Reinsurer.
  Dispute Resolution ~ ABR1004 Where any dispute or difference between the parties arising out of or in connection with this Contract; including formation and validity and whether arising during or after the period of this Contract; has not been settled through negotiation; both parties agree to try in good faith to settle such dispute by non- binding mediation; before resorting to arbitration in the manner set out below.	ARTICLE 21 DISPUTE RESOLUTION Where any dispute between the parties arising out of or in connection with this Contract; including its formation and validity; and whether arising during or after the period of this Contract has not been settled by negotiation through senior executives within one month of a notice of a dispute by either party; both parties agree to try in good faith to settle such dispute by non-binding mediation through an accredited mediation body as the parties may agree; within two months of the notice by either party; before resorting to arbitration as stated in the Arbitration Article. Notwithstanding the foregoing; in respect of any dispute to which an APRA regulated insurer is a party; the following shall apply: Either party may request that any dispute be determined by the Courts of New South Wales; Australia provided that such is requested within four weeks of either party's written notice of a demand for arbitration. For the avoidance of doubt; where a party has requested litigation in accordance with the provisions of this paragraph; Part 2 Section 8; Subsection (1) of the Commercial Arbitration Act 2010 NSW shall not apply.	e) War and Civil War Exclusion Loss or damages directly or indirectly occasioned by happening through or in consequence of war; invasion; acts of foreign enemies; hostilities (whether war be declared or not); civil war; rebellion; revolution; insurrection; military or usurped power or confiscation or nationalisation or requisition or destruction of or damage to property by or under the order of any government or public or local authority.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apnd

• Dataset: apnd
• Size: 1,846 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 3 tokens mean: 62.84 tokens max: 128 tokens	min: 3 tokens mean: 63.97 tokens max: 128 tokens	min: 5 tokens mean: 70.55 tokens max: 128 tokens

• Samples:

  anchor	positive	negative
  “North American CAT Perils” means certain Named Storms and Earthquake; each as defined below; in respect of that portion of losses which occur in the United States and Canada and their possessions and territories; excluding the Territory of Guam; the Territory of American Samoa; the Commonwealth of the Northern Mariana Islands; Wake Island; Johnston Atoll; Palmyra Atoll; and the State of Hawaiiterritory of Guam.	“North American CAT Perils” means certain Named Storms and Earthquake; each as defined below; in respect of that portion of losses which occur in the United States and Canada and their possessions and territories; excluding the Territory of Guam; the Territory of American Samoa; the Commonwealth of the Northern Mariana Islands; Wake Island; Johnston Atoll; Palmyra Atoll; and the State of Hawaii. For the purposes of this Paragraph A.; “Named Storm” means any windstorm or windstorm system that has been named by a Reporting Agency at any time in its lifecycle and ensuing losses therefrom; and “Earthquake” means earthquake shake and ensuing losses therefrom.	As used in this Agreement; "Privileges" shall mean Attorney-Client Privilege; Work Product Privilege; Self-Evaluative Analysis Privilege or Self-Critical Analysis Privilege; as defined in this Article.
  For the purposes of this Paragraph A.; “Named Storm” means any windstorm or windstorm system that has been named by a Reporting Agency at any time in its lifecycle and ensuing losses therefrom.	“Named Storm” as used herein shall mean any storm or storm system declared by the U.S. National Hurricane Center to be a tropical storm or hurricane; including any precursor(s) and successor(s) thereof.	“Policy” shall mean the Association’s binders; policies; and contracts; whether written or oral; providing insurance or reinsurance on the business covered under this Contract.
  For the purposes of this Paragraph A.; “Earthquake” means earthquake shake and ensuing losses therefrom.	All insurances and reinsurances written or accepted by the Reinsured in respect of Earthquake and/or Volcanic Eruption; including but not limited to Earthquake Shock; Fire following Earthquake; Explosion; Tsunami following Earthquake and/or Volcanic Eruption (hereinafter collectively called Earthquake).	The amount of any settlement; award or judgment paid by the Company or for which the Company has become liable to pay (including interest accrued prior to final judgment); after deduction of all recoveries; salvages and subrogation; and amounts recoverable under all reinsurance inuring to the benefit of this Contract; whether collectible or not. For purposes of this definition; the phrase 'liable to pay' shall include the existence of a judgment which the Company does not intend to appeal or where a release has been obtained by the Company for a specific claim or the Company has accepted a proof of loss; and/or the Company has made a commitment to pay; and/or the Company has scheduled the payment of the loss.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

Evaluation Datasets

aac

• Dataset: aac
• Size: 100 evaluation samples
• Columns: anchor and anchor2
• Approximate statistics based on the first 1000 samples:

  	anchor	anchor2
  type	string	string
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	min: 20 tokens mean: 104.63 tokens max: 128 tokens

• Samples:

  anchor	anchor2
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.

• Loss: ContrastiveTensionLossInBatchNegatives

aad

• Dataset: aad
• Size: 100 evaluation samples
• Columns: anchor and anchor2
• Approximate statistics based on the first 1000 samples:

  	anchor	anchor2
  type	string	string
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	min: 5 tokens mean: 70.36 tokens max: 128 tokens

• Samples:

  anchor	anchor2
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	“Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	“Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.

• Loss: ContrastiveTensionLossInBatchNegatives

apc

• Dataset: apc
• Size: 100 evaluation samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	min: 20 tokens mean: 105.0 tokens max: 128 tokens

• Samples:

  anchor	positive
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	Communicable Disease Exclusion Attaching to and forming part of AXA GLOBAL RE SA AND AXA XL US GROUP PROPERTY CATASTROPHE EXCESS OF LOSS 1. This Reinsurance Agreement excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with any Communicable Disease or the fear or threat (whether actual or perceived) of any Communicable Disease. For the purposes of this exclusion; loss; damage; liability; claim; cost or expense caused by; contributed to by; resulting from; arising out of; or in connection with any Communicable Disease shall include; but not be limited to; any loss of market; loss of income; profit or revenue; or any other business interruption; and any public or government authority's denial of access to or destruction of property in an effort to prevent the spread of any Communicable Disease.
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apd

• Dataset: apd
• Size: 100 evaluation samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	min: 5 tokens mean: 74.99 tokens max: 128 tokens

• Samples:

  anchor	positive
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	“Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	“Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apnc

• Dataset: apnc
• Size: 100 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	min: 20 tokens mean: 104.02 tokens max: 128 tokens	min: 20 tokens mean: 104.06 tokens max: 128 tokens

• Samples:

  anchor	positive	negative
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	étant toujours entendu que ces assurances ou réassurances excluent les risques d'irradiation et de contamination par des Matières Nucléaires.
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	Reinsurance business shall be excluded from this Reinsurance Agreement. However; the following are not excluded: -shares assumed on direct written business through inward treaties -business written on behalf of an AXA Company -facultative reinsurance; group intra-company reinsurance (if applicable); local agency reinsurance accepted in the normal course of business and/or Policies written by another carrier at the REINSURED's request and reinsured up to one hundred percent (100%) by the REINSURED -captive insurance and/or reinsurance and/or retrocession companies if their sole purpose is to form part of a single client insurance programme structure -fronting if their sole purpose is to form part of a single client international program solution
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	In any action; suit or proceeding to enforce the Subscribing Reinsurer's obligations under the attached Contract; service of process may be made upon Lloyd's America; Inc.; Attention: Legal Department; 280 Park Avenue; East Tower; 25th Floor; New York; NY 10017-1274. However; if such action; suit or proceeding is brought in the State of California; service of process may be made upon FLWA Service Corp.; c/o Foley & Lardner LLP; 555 California Street; Suite 1700; San Francisco; CA 94104-1520.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apnd

• Dataset: apnd
• Size: 100 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	min: 5 tokens mean: 68.49 tokens max: 128 tokens	min: 5 tokens mean: 71.32 tokens max: 128 tokens

• Samples:

  anchor	positive	negative
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	“Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	For purposes of the application of this Article; the term “Corporate Officer” shall mean each Company senior officer with the title of Executive Vice President or higher.
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	“Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	"Work Product Privilege" means communications; written materials and tangible things prepared by or for in-house or outside counsel; or prepared by or for the Company; in anticipation of or in connection with litigation; arbitration; or other dispute resolution proceedings.
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	Custom Wholesale Property; except for Large Property U.S.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apInc

• Dataset: apInc
• Size: 100 evaluation samples
• Columns: anchor, label, and posIneg
• Approximate statistics based on the first 1000 samples:

  	anchor	label	posIneg
  type	string	int	string
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	0: ~70.00% 1: ~30.00%	min: 20 tokens mean: 100.86 tokens max: 128 tokens

• Samples:

  anchor	label	posIneg
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	1	A. As a condition precedent to any right of action hereunder; any dispute that arises out of or in connection with this Contract; including its formation or validity; shall be submitted for decision to a panel of three arbitrators. A request for arbitration by either the Company or the Reinsurer shall not relieve the Reinsurer of its liability to promptly pay its share of undisputed loss settlements in accordance with the provisions of the Notice of Loss and Loss Settlements Article.
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	0	Excluding: (a) All Business derived directly or indirectly from any Pool; Association or Syndicate which maintains its own reinsurance facilities. Captive Insurers or Risk Retention Groups shall not be considered Pools; Associations or Syndicates. (b) Any Pool or Scheme (whether voluntary or mandatory) formed after March 1; 1968 for the purpose of insuring Property whether on a country- wide basis or in respect of designated areas. This exclusion shall not apply to so- called Automobile Insurance Plans or other Pools formed to provide coverage for Automobile Physical Damage; however; any coverage provided by the Ontario; Alberta; New Brunswick and Nova Scotia Risk Sharing Pools shall be excluded hereunder.
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	0	13.1 TAXES As applicable 13.2 GOODS AND SERVICES TAX (GST) a. Payments Any amount shown as payable under this Agreement does not include GST and; where applicable; will be calculated with reference to the GST -exclusive premiums payable to the Reinsured by its insureds. In addition to any amount shown as payable; wherever the supplier (whether the Reinsurer or the Reinsured) is liable for GST on that amount; the supplier shall be paid an amount equal to that GST. b. Claims The Ultimate Net Loss will be calculated after accounting for any adjustment under the GST legislation to which the Reinsured is entitled on settlement of claims to its insureds or on recoveries from any third parties; and any input tax credit to which they are entitled on acquiring goods or services for the purpose of settlement of a claim. This Agreement does not cover any liability that the Reinsured has for GST on any claim payment under this Agreement arising from the Reinsured’s failure to disclose correctly to the Reinsurer its entitlement to an input tax credit for the premium.

• Loss: ContrastiveLoss with these parameters:

  {
      "distance_metric": "SiameseDistanceMetric.COSINE_DISTANCE",
      "margin": 0.5,
      "size_average": true
  }
  

apInd

• Dataset: apInd
• Size: 100 evaluation samples
• Columns: anchor, label, and posIneg
• Approximate statistics based on the first 1000 samples:

  	anchor	label	posIneg
  type	string	int	string
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	0: ~71.00% 1: ~29.00%	min: 5 tokens mean: 63.96 tokens max: 128 tokens

• Samples:

  anchor	label	posIneg
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	0	The Reinsurer agrees to fund its share of the Company's ceded outstanding loss and Loss Adjustment Expense reserves (including all case reserves plus any reasonable amount estimated to be unreported from known Loss Occurrences) by: 1. Clean; irrevocable and unconditional letters of credit issued or confirmed; if confirmation is required by the insurance regulatory authorities involved; by a bank or banks meeting the NAIC Securities Valuation Office credit standards for issuers of letters of credit and acceptable to said insurance regulatory authorities; and/or 2. Escrow accounts for the benefit of the Company; and/or 3. Cash advances.
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	1	Custom Wholesale Property; except for Large Property U.S.
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	0	"Qualified Person" shall have the meaning ascribed to it in paragraph 25.05 of the Commutation Article of this Contract.

• Loss: ContrastiveLoss with these parameters:

  {
      "distance_metric": "SiameseDistanceMetric.COSINE_DISTANCE",
      "margin": 0.5,
      "size_average": true
  }
  

sscc

• Dataset: sscc
• Size: 100 evaluation samples
• Columns: sentence and label
• Approximate statistics based on the first 1000 samples:

  	sentence	label
  type	string	int
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	1: ~1.00% 4: ~2.00% 5: ~3.00% 11: ~1.00% 12: ~1.00% 18: ~1.00% 19: ~6.00% 20: ~8.00% 21: ~3.00% 30: ~1.00% 32: ~1.00% 34: ~1.00% 45: ~1.00% 46: ~2.00% 47: ~2.00% 50: ~1.00% 51: ~1.00% 53: ~4.00% 65: ~1.00% 68: ~2.00% 69: ~1.00% 74: ~1.00% 79: ~5.00% 88: ~1.00% 89: ~1.00% 93: ~1.00% 107: ~3.00% 115: ~1.00% 126: ~1.00% 143: ~1.00% 150: ~1.00% 161: ~1.00% 175: ~1.00% 202: ~1.00% 220: ~1.00% 222: ~1.00% 227: ~1.00% 229: ~1.00% 231: ~1.00% 232: ~1.00% 235: ~1.00% 236: ~1.00% 251: ~2.00% 275: ~1.00% 276: ~1.00% 296: ~1.00% 305: ~1.00% 309: ~1.00% 314: ~1.00% 334: ~1.00% 342: ~1.00% 368: ~1.00% 376: ~1.00% 381: ~1.00% 400: ~1.00% 402: ~1.00% 404: ~1.00% 419: ~1.00% 473: ~1.00% 496: ~1.00% 547: ~1.00% 548: ~1.00% 553: ~1.00% 585: ~1.00% 594: ~2.00% 605: ~1.00% 606: ~1.00% 662: ~1.00% 798: ~1.00%

• Samples:

  sentence	label
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	32
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	79
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	88

• Loss: BatchAllTripletLoss

sscd

• Dataset: sscd
• Size: 100 evaluation samples
• Columns: sentence and label
• Approximate statistics based on the first 1000 samples:

  	sentence	label
  type	string	int
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	1: ~1.00% 3: ~8.00% 4: ~1.00% 5: ~1.00% 7: ~1.00% 8: ~2.00% 19: ~4.00% 25: ~1.00% 26: ~2.00% 29: ~2.00% 32: ~2.00% 33: ~2.00% 34: ~1.00% 38: ~1.00% 39: ~1.00% 54: ~3.00% 55: ~1.00% 68: ~1.00% 78: ~2.00% 80: ~1.00% 82: ~1.00% 84: ~1.00% 93: ~1.00% 98: ~1.00% 120: ~1.00% 134: ~1.00% 135: ~1.00% 143: ~1.00% 144: ~2.00% 149: ~1.00% 154: ~1.00% 161: ~1.00% 173: ~1.00% 180: ~1.00% 181: ~1.00% 183: ~2.00% 206: ~1.00% 236: ~1.00% 238: ~1.00% 239: ~1.00% 243: ~1.00% 244: ~1.00% 256: ~1.00% 264: ~1.00% 326: ~1.00% 361: ~1.00% 367: ~1.00% 374: ~1.00% 377: ~1.00% 429: ~1.00% 433: ~1.00% 443: ~1.00% 448: ~1.00% 473: ~1.00% 488: ~1.00% 521: ~1.00% 535: ~1.00% 556: ~1.00% 557: ~1.00% 580: ~1.00% 589: ~1.00% 679: ~1.00% 693: ~1.00% 797: ~1.00% 857: ~1.00% 859: ~1.00% 871: ~1.00% 873: ~1.00% 960: ~1.00% 979: ~1.00% 1028: ~1.00% 1155: ~1.00% 1209: ~1.00% 1213: ~1.00% 1256: ~1.00% 1297: ~1.00% 1331: ~1.00% 1481: ~1.00% 1528: ~1.00% 1541: ~1.00%

• Samples:

  sentence	label
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	4
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	25
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	7

• Loss: BatchAllTripletLoss

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• learning_rate: 3e-05
• num_train_epochs: 10
• warmup_ratio: 0.1

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• learning_rate: 3e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 10
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional

Training Logs

Epoch	Step	Training Loss	aac loss	apd loss	apnd loss	sscc loss	aad loss	apnc loss	apInc loss	sscd loss	apc loss	apInd loss
3.2051	500	0.4527	0.0658	0.6576	0.6257	2.8657	0.0365	0.9957	0.1135	2.6729	0.6947	0.1273
6.4103	1000	0.0272	0.0730	0.7095	0.6865	2.9180	0.0427	1.0989	0.1221	2.7622	0.8614	0.1355
9.6154	1500	0.0079	0.0730	0.6981	0.6789	3.0012	0.0462	1.2101	0.1233	2.7675	0.9296	0.1381

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 3.0.1
• Transformers: 4.41.2
• PyTorch: 2.3.0+cu121
• Accelerate: 0.32.1
• Datasets: 2.20.0
• Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

ContrastiveTensionLossInBatchNegatives

@inproceedings{carlsson2021semantic,
    title={Semantic Re-tuning with Contrastive Tension},
    author={Fredrik Carlsson and Amaru Cuba Gyllensten and Evangelia Gogoulou and Erik Ylip{"a}{"a} Hellqvist and Magnus Sahlgren},
    booktitle={International Conference on Learning Representations},
    year={2021},
    url={https://openreview.net/forum?id=Ov_sMNau-PF}
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply}, 
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}

ContrastiveLoss

@inproceedings{hadsell2006dimensionality,
    author={Hadsell, R. and Chopra, S. and LeCun, Y.},
    booktitle={2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06)}, 
    title={Dimensionality Reduction by Learning an Invariant Mapping}, 
    year={2006},
    volume={2},
    number={},
    pages={1735-1742},
    doi={10.1109/CVPR.2006.100}
}

BatchAllTripletLoss

@misc{hermans2017defense,
    title={In Defense of the Triplet Loss for Person Re-Identification}, 
    author={Alexander Hermans and Lucas Beyer and Bastian Leibe},
    year={2017},
    eprint={1703.07737},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}