Anakeen/datasets_ap_sts_0.9_v2

SentenceTransformer based on sentence-transformers/paraphrase-multilingual-mpnet-base-v2

This is a sentence-transformers model finetuned from sentence-transformers/paraphrase-multilingual-mpnet-base-v2 on the apc and apd datasets. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/paraphrase-multilingual-mpnet-base-v2
• Maximum Sequence Length: 128 tokens
• Output Dimensionality: 768 tokens
• Similarity Function: Cosine Similarity
• Training Datasets:
  • apc
  • apd

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 128, 'do_lower_case': False}) with Transformer model: XLMRobertaModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("Anakeen/datasets_ap_sts_0.9_v2")
# Run inference
sentences = [
    'The liability of the Reinsured to indemnify Capricorn (Isle of Man) Limited who in turn offer a discretionary deed of indemnity to Capricorn Mutual Limited ABN 24 104 601 194 for the protections set out below.',
    'Sacramento Municipal Utility District (hereinafter called the “Insured”)',
    'The length of the loss defined here above will be limited to: - 168 consecutive hours in case of social disorder; for the risks of strikes; riots; popular movements; urban violence for all the damages occurring in France. - 168 consecutive hours for all other guarantees covered by the Ceding Company in their original policies and defined in the “Interest to the Treaty” article. The Ceding Company may decide at its option the time and date of commencement of any period of consecutive hours and if any event is of longer duration than the said periods; the Ceding Company may divide it into two or more events provided that no two periods overlap and no period commences before the date and time of the occurrence of the first individual loss suffered by it as a result of the event. No individual claim arising from any insured risk occurring outside the above periods will be included in the event.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Datasets

apc

• Dataset: apc
• Size: 1,988 training samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 5 tokens mean: 102.56 tokens max: 128 tokens	min: 8 tokens mean: 103.78 tokens max: 128 tokens

• Samples:

  anchor	positive
  1. This Contract does not cover any loss or liability accruing to the Reassured; directly or indirectly and whether as Insurer or Reinsurer; from any Pool of Insurers or Reinsurers formed for the purpose of covering Atomic or Nuclear Energy risks. 2. Without in any way restricting the operation of paragraph (1) of this Clause; this Contract does not cover any loss or liability accruing to the Reassured; directly or indirectly and whether as Insurer or Reinsurer; from any insurance against Physical Damage (including business interruption or consequential loss arising out of such Physical Damage) to: I. Nuclear reactor power plants including all auxiliary property on the site; or II. Any other nuclear reactor installation; including laboratories handling radioactive materials in connection with reactor installations; and “critical facilities” as such; or III. Installations for fabricating complete fuel elements or for processing substantial quantities of “special nuclear material;” and for reprocessing; salvaging; chemically separating; storing or disposing of “spent” nuclear fuel or waste materials; or IV. Installations other than those listed in paragraph (2) III above using substantial quantities of radioactive isotopes or other products of nuclear fission. 3. Without in any way restricting the operations of paragraphs (1) and (2) hereof; this Contract does not cover any loss or liability by radioactive contamination accruing to the Reassured; directly or indirectly; and whether as Insurer or Reinsurer; from any insurance on property which is on the same site as a nuclear reactor power plant or other nuclear installation and which normally would be insured therewith except that this paragraph (3) shall not operate (a) where the Reassured does not have knowledge of such nuclear reactor power plant or nuclear installation; or (b) where said insurance contains a provision excluding coverage for damage to property caused by or resulting from radioactive contamination; however caused. However on and after 1st January 1960 this sub-paragraph (b) shall only apply provided the said radioactive contamination exclusion provision has been approved by the Governmental Authority having jurisdiction thereof. 4. Without in any way restricting the operations of paragraphs (1); (2) and (3) hereof; this Contract does not cover any loss or liability by radioactive contamination accruing to the Reassured; directly or indirectly; and whether as Insurer or Reinsurer; when such radioactive contamination is a named hazard specifically insured against. 5. It is understood and agreed that this Clause shall not extend to risks using radioactive isotopes in any form where the nuclear exposure is not considered by the Reassured to be the primary hazard. 6. The term “special nuclear material” shall have the meaning given it in the Atomic Energy Act of 1954 or by any law amendatory thereof. 7. The Reassured to be sole judge of what constitutes: (a) substantial quantities; and (b) the extent of installation; plant or site. Note. Without in any way restricting the operation of paragraph (1) hereof; it is understood and agreed that (a) all policies issued by the Reassured on or before 31st December 1957 shall be free from the application of the other provisions of this Clause until expiry date or 31st December 1960 whichever first occurs whereupon all the provisions of this Clause shall apply; (b) with respect to any risk located in Canada policies issued by the Reassured on or before 31st December 1958 shall be free from the application of the other provisions of this Clause until expiry date or 31st December 1960 whichever first occurs whereupon all the provisions of this Clause shall apply.	1) This Agreement does not cover any loss or liability accruing to the Reinsured; directly or indirectly; and whether as Insurer or Reinsurer; from any Pool of Insurers or Reinsurers formed for the purpose of covering Atomic or Nuclear Energy ri sks. 2) Without in any way restricting the operation of paragraph (1) of this Clause; this Agreement does not cover any loss or liabili ty accruing to the Reinsured; directly or indirectly and whether as Insurer or Reinsurer; from any Insurance against Phys ical Damage (including business interruption or consequential loss arising out of such Physical Damage) to: I. Nuclear reactor power plants including all auxiliary property on the site; or II. Any other nuclear reactor installation; including laboratories handling radioactive materials in connection with reactor installations; and “critical facilities” as such; or III. Installations for fabricating complete fuel elements or for processing substantial quantities of “special nuclear material;” and for reproce ssing; salvaging; chemically separating; storing or disposing of “spent” nuclear fuel or waste materials; or IV. Installations other than those listed in paragraph 2) III above using substantial quantities of radioactive isotopes or other products of nucle ar fission. 3) Without in any way restricting the operations of paragraphs 1) and 2) hereof; this Agreement does not cover any loss or liabi lity by radioactive contamination accruing to the Reinsured; directly or indirectly; and whether as Insurer or Reinsurer; from any insurance on property which is on the same site as a nuclear reactor power plant or other nuclear installation and which norm ally would be insured therewith except that this paragraph 3) shall not operate a) where the Reinsured does not have knowledge of such nuclear reactor power plant or nuclear installation; or b) where said insurance contains a provision excluding coverage for damage to property caused by or resulting from radioactive contamination; however caused. However; on and a fter 1st; January 1960; this sub -paragraph b) shall only apply provided the said radioactive contamination exclusion provision has been approved by the Government Authority having jurisdiction thereof. 4) Without in any way restricting the operations of pa ragraphs 1); 2) and 3) hereof; this Agreement does not cover any loss or liability by radioactive contamination accruing to the Reinsured; directly or indirectly; and whether as Insurer or Reinsurer; when such radioactive contamination is a named hazard sp ecifically insured against. 5) It is understood and agreed that this Clause shall not extend to risks using radioactive isotopes in any form where the nucle ar exposure is not considered by the Reinsured to be the primary hazard. 6) The term “special nuclea r material” shall have the meaning given it in the Atomic Energy Act of 1954; or by any law amendatory thereof. 7) Reinsured to be sole judge of what constitutes: a) substantial quantities; and b) the extent of installation; plant or site. NOTE: Without i n any way restricting the operations of paragraph 1) hereof; it is understood and agreed that: a) all policies issued by the Reinsured on or before 31st; December 1957; shall be free from the application of the other provisions of this Clause until expiry date or 31st; December 1960; whichever first occurs whereupon all the provisions of this Clause shall apply; b) with respect to any risk located in Canada policies issued by the Reinsured on or before 31st; December 1958; shall be free from the application of the other provisions of this Clause until expiry date or 31st; December 1960; whichever first occurs whereupon all the provisions of this Clause shall apply.
  Downgrading clause ~ ABR1001 (Amended) Reinsurer with an S&P Rating Unless otherwise agreed by the Reinsured; the Reinsurer shall at all times during the Period of this Contract maintain an Insurer Financial Strength (IFS) rating from Standard & Poor's Rating Group of 55 Water Street; New York; NY 10041; USA ("S&P") equal to or greater than a rating of A minus as applied by S&P to that Reinsurer.	Downgrading clause ~ ABR1001 (Amended) Reinsurer with an S&P Rating Unless otherwise agreed by the Reinsured; the Reinsurer shall at all times during the Period of this Contract maintain an Insurer Financial Strength (IFS) rating from Standard & Poor's Rating Group of 55 Water Street; New York; NY 10041; USA ("S&P") equal to or greater than a rating of A minus as applied by S&P to that Reinsurer.
  Dispute Resolution ~ ABR1004 Where any dispute or difference between the parties arising out of or in connection with this Contract; including formation and validity and whether arising during or after the period of this Contract; has not been settled through negotiation; both parties agree to try in good faith to settle such dispute by non- binding mediation; before resorting to arbitration in the manner set out below.	Where any dispute or difference between the parties arising out of or in connection with this Contract; including formation and validity and whether arising during or after the period of this Contract; has not been settled through negotiation; both parties agree to try in good faith to settle such dispute by non- binding mediation; before resorting to arbitration in the manner set out below.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apd

• Dataset: apd
• Size: 3,494 training samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 3 tokens mean: 66.58 tokens max: 128 tokens	min: 3 tokens mean: 69.16 tokens max: 128 tokens

• Samples:

  anchor	positive
  “North American CAT Perils” means certain Named Storms and Earthquake; each as defined below; in respect of that portion of losses which occur in the United States and Canada and their possessions and territories; excluding the Territory of Guam; the Territory of American Samoa; the Commonwealth of the Northern Mariana Islands; Wake Island; Johnston Atoll; Palmyra Atoll; and the State of Hawaiiterritory of Guam.	“North American CAT Perils” means certain Named Storms and Earthquake; each as defined below; in respect of that portion of losses which occur in the United States and Canada and their possessions and territories; excluding the Territory of Guam; the Territory of American Samoa; the Commonwealth of the Northern Mariana Islands; Wake Island; Johnston Atoll; Palmyra Atoll; and the State of Hawaiiterritory of Guam.
  For the purposes of this Paragraph A.; “Named Storm” means any windstorm or windstorm system that has been named by a Reporting Agency at any time in its lifecycle and ensuing losses therefrom.	As regards a Named Storm; all losses sustained by the Company occurring during any period (a) from and after 12:00 a.m. Eastern Standard Time on the date a watch; warning; advisory; or other bulletin (whether for wind; flood or otherwise) for such Named Storm is first issued by the National Hurricane Center ('NHC') or its successor or any division or agency of the National Weather Service ('NWS'); (b) continuing for a time period thereafter during which such Named Storm continues; regardless of its category rating or lack thereof and regardless of whether the watch; warning; or advisory or other bulletin remains in effect for such Named Storm and (c) ending at 11:59 p.m. Eastern Standard Time on the fourth calendar day following the issuance of the last watch; warning or advisory or other bulletin for such Named Storm or related to such Named Storm by the NHC or its successor or any division or agency of the NWS. 'Named Storm' shall mean any storm or storm system that has been declared by the NHC of the National Weather Service NWS or its successor to be a named storm at any time; which may include; by way of example and not limitation; hurricane; wind; gusts; typhoon; hail; rain; tornados; cyclones; ensuing flood; storm surge; water damage; fire following; sprinkler leakage; riots; vandalism; and collapse; and all losses and perils (including; by way of example and not limitation; those mentioned previously in this sentence) in each case arising out of; caused by; occurring during; occasioned by or resulting from such storm or storm system; including by way of example and not limitation the merging of one or more separate storm(s) or storm system(s) into a combined storm surge event. Notwithstanding the foregoing; the duration of a Named Storm will be subject to a minimum period of 168 consecutive hours.
  For the purposes of this Paragraph A.; “Earthquake” means earthquake shake and ensuing losses therefrom.	For the purpose of this Section 2; “Earthquake” shall mean earthquake; seaquake; earthquake shock; seismic and/or volcanic disturbance and tsunami following earthquake/seaquake.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

Evaluation Datasets

aac

• Dataset: aac
• Size: 100 evaluation samples
• Columns: anchor and anchor2
• Approximate statistics based on the first 1000 samples:

  	anchor	anchor2
  type	string	string
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	min: 20 tokens mean: 104.63 tokens max: 128 tokens

• Samples:

  anchor	anchor2
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.

• Loss: ContrastiveTensionLossInBatchNegatives

aad

• Dataset: aad
• Size: 100 evaluation samples
• Columns: anchor and anchor2
• Approximate statistics based on the first 1000 samples:

  	anchor	anchor2
  type	string	string
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	min: 5 tokens mean: 70.36 tokens max: 128 tokens

• Samples:

  anchor	anchor2
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	“Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	“Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.

• Loss: ContrastiveTensionLossInBatchNegatives

apc

• Dataset: apc
• Size: 100 evaluation samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	min: 20 tokens mean: 105.0 tokens max: 128 tokens

• Samples:

  anchor	positive
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	Communicable Disease Exclusion Attaching to and forming part of AXA GLOBAL RE SA AND AXA XL US GROUP PROPERTY CATASTROPHE EXCESS OF LOSS 1. This Reinsurance Agreement excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with any Communicable Disease or the fear or threat (whether actual or perceived) of any Communicable Disease. For the purposes of this exclusion; loss; damage; liability; claim; cost or expense caused by; contributed to by; resulting from; arising out of; or in connection with any Communicable Disease shall include; but not be limited to; any loss of market; loss of income; profit or revenue; or any other business interruption; and any public or government authority's denial of access to or destruction of property in an effort to prevent the spread of any Communicable Disease.
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apd

• Dataset: apd
• Size: 100 evaluation samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	min: 5 tokens mean: 74.99 tokens max: 128 tokens

• Samples:

  anchor	positive
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	“Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	“Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apnc

• Dataset: apnc
• Size: 100 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	min: 20 tokens mean: 104.02 tokens max: 128 tokens	min: 20 tokens mean: 104.06 tokens max: 128 tokens

• Samples:

  anchor	positive	negative
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	étant toujours entendu que ces assurances ou réassurances excluent les risques d'irradiation et de contamination par des Matières Nucléaires.
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	Reinsurance business shall be excluded from this Reinsurance Agreement. However; the following are not excluded: -shares assumed on direct written business through inward treaties -business written on behalf of an AXA Company -facultative reinsurance; group intra-company reinsurance (if applicable); local agency reinsurance accepted in the normal course of business and/or Policies written by another carrier at the REINSURED's request and reinsured up to one hundred percent (100%) by the REINSURED -captive insurance and/or reinsurance and/or retrocession companies if their sole purpose is to form part of a single client insurance programme structure -fronting if their sole purpose is to form part of a single client international program solution
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	In any action; suit or proceeding to enforce the Subscribing Reinsurer's obligations under the attached Contract; service of process may be made upon Lloyd's America; Inc.; Attention: Legal Department; 280 Park Avenue; East Tower; 25th Floor; New York; NY 10017-1274. However; if such action; suit or proceeding is brought in the State of California; service of process may be made upon FLWA Service Corp.; c/o Foley & Lardner LLP; 555 California Street; Suite 1700; San Francisco; CA 94104-1520.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apnd

• Dataset: apnd
• Size: 100 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	min: 5 tokens mean: 68.49 tokens max: 128 tokens	min: 5 tokens mean: 71.32 tokens max: 128 tokens

• Samples:

  anchor	positive	negative
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	“Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	For purposes of the application of this Article; the term “Corporate Officer” shall mean each Company senior officer with the title of Executive Vice President or higher.
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	“Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	"Work Product Privilege" means communications; written materials and tangible things prepared by or for in-house or outside counsel; or prepared by or for the Company; in anticipation of or in connection with litigation; arbitration; or other dispute resolution proceedings.
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	Custom Wholesale Property; except for Large Property U.S.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

apInc

• Dataset: apInc
• Size: 100 evaluation samples
• Columns: anchor, label, and posIneg
• Approximate statistics based on the first 1000 samples:

  	anchor	label	posIneg
  type	string	int	string
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	0: ~70.00% 1: ~30.00%	min: 20 tokens mean: 100.86 tokens max: 128 tokens

• Samples:

  anchor	label	posIneg
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	1	A. As a condition precedent to any right of action hereunder; any dispute that arises out of or in connection with this Contract; including its formation or validity; shall be submitted for decision to a panel of three arbitrators. A request for arbitration by either the Company or the Reinsurer shall not relieve the Reinsurer of its liability to promptly pay its share of undisputed loss settlements in accordance with the provisions of the Notice of Loss and Loss Settlements Article.
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	0	Excluding: (a) All Business derived directly or indirectly from any Pool; Association or Syndicate which maintains its own reinsurance facilities. Captive Insurers or Risk Retention Groups shall not be considered Pools; Associations or Syndicates. (b) Any Pool or Scheme (whether voluntary or mandatory) formed after March 1; 1968 for the purpose of insuring Property whether on a country- wide basis or in respect of designated areas. This exclusion shall not apply to so- called Automobile Insurance Plans or other Pools formed to provide coverage for Automobile Physical Damage; however; any coverage provided by the Ontario; Alberta; New Brunswick and Nova Scotia Risk Sharing Pools shall be excluded hereunder.
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	0	13.1 TAXES As applicable 13.2 GOODS AND SERVICES TAX (GST) a. Payments Any amount shown as payable under this Agreement does not include GST and; where applicable; will be calculated with reference to the GST -exclusive premiums payable to the Reinsured by its insureds. In addition to any amount shown as payable; wherever the supplier (whether the Reinsurer or the Reinsured) is liable for GST on that amount; the supplier shall be paid an amount equal to that GST. b. Claims The Ultimate Net Loss will be calculated after accounting for any adjustment under the GST legislation to which the Reinsured is entitled on settlement of claims to its insureds or on recoveries from any third parties; and any input tax credit to which they are entitled on acquiring goods or services for the purpose of settlement of a claim. This Agreement does not cover any liability that the Reinsured has for GST on any claim payment under this Agreement arising from the Reinsured’s failure to disclose correctly to the Reinsurer its entitlement to an input tax credit for the premium.

• Loss: ContrastiveLoss with these parameters:

  {
      "distance_metric": "SiameseDistanceMetric.COSINE_DISTANCE",
      "margin": 0.5,
      "size_average": true
  }
  

apInd

• Dataset: apInd
• Size: 100 evaluation samples
• Columns: anchor, label, and posIneg
• Approximate statistics based on the first 1000 samples:

  	anchor	label	posIneg
  type	string	int	string
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	0: ~71.00% 1: ~29.00%	min: 5 tokens mean: 63.96 tokens max: 128 tokens

• Samples:

  anchor	label	posIneg
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	0	The Reinsurer agrees to fund its share of the Company's ceded outstanding loss and Loss Adjustment Expense reserves (including all case reserves plus any reasonable amount estimated to be unreported from known Loss Occurrences) by: 1. Clean; irrevocable and unconditional letters of credit issued or confirmed; if confirmation is required by the insurance regulatory authorities involved; by a bank or banks meeting the NAIC Securities Valuation Office credit standards for issuers of letters of credit and acceptable to said insurance regulatory authorities; and/or 2. Escrow accounts for the benefit of the Company; and/or 3. Cash advances.
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	1	Custom Wholesale Property; except for Large Property U.S.
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	0	"Qualified Person" shall have the meaning ascribed to it in paragraph 25.05 of the Commutation Article of this Contract.

• Loss: ContrastiveLoss with these parameters:

  {
      "distance_metric": "SiameseDistanceMetric.COSINE_DISTANCE",
      "margin": 0.5,
      "size_average": true
  }
  

sscc

• Dataset: sscc
• Size: 100 evaluation samples
• Columns: sentence and label
• Approximate statistics based on the first 1000 samples:

  	sentence	label
  type	string	int
  details	min: 20 tokens mean: 104.63 tokens max: 128 tokens	1: ~1.00% 4: ~2.00% 5: ~3.00% 11: ~1.00% 12: ~1.00% 18: ~1.00% 19: ~6.00% 20: ~8.00% 21: ~3.00% 30: ~1.00% 32: ~1.00% 34: ~1.00% 45: ~1.00% 46: ~2.00% 47: ~2.00% 50: ~1.00% 51: ~1.00% 53: ~4.00% 65: ~1.00% 68: ~2.00% 69: ~1.00% 74: ~1.00% 79: ~5.00% 88: ~1.00% 89: ~1.00% 93: ~1.00% 107: ~3.00% 115: ~1.00% 126: ~1.00% 143: ~1.00% 150: ~1.00% 161: ~1.00% 175: ~1.00% 202: ~1.00% 220: ~1.00% 222: ~1.00% 227: ~1.00% 229: ~1.00% 231: ~1.00% 232: ~1.00% 235: ~1.00% 236: ~1.00% 251: ~2.00% 275: ~1.00% 276: ~1.00% 296: ~1.00% 305: ~1.00% 309: ~1.00% 314: ~1.00% 334: ~1.00% 342: ~1.00% 368: ~1.00% 376: ~1.00% 381: ~1.00% 400: ~1.00% 402: ~1.00% 404: ~1.00% 419: ~1.00% 473: ~1.00% 496: ~1.00% 547: ~1.00% 548: ~1.00% 553: ~1.00% 585: ~1.00% 594: ~2.00% 605: ~1.00% 606: ~1.00% 662: ~1.00% 798: ~1.00%

• Samples:

  sentence	label
  Article 26 - Federal Excise Tax (BRMA 17D) A.The Reinsurer has agreed to allow for the purpose of paying the Federal Excise Tax the applicable percentage of the premium payable hereon (as imposed under Section 4371 of the Internal Revenue Code) to the extent such premium is subject to the Federal Excise Tax.	32
  Notwithstanding any provision to the contrary within this Reinsurance Contract; this Reinsurance Contract excludes any loss; damage; liability; claim; cost or expense of whatsoever nature; directly or indirectly caused by; contributed to by; resulting from; arising out of; or in connection with a Communicable Disease or the fear or threat (whether actual or perceived) of a Communicable Disease regardless of any other cause or event contributing concurrently or in any other sequence thereto.	79
  CYBER LOSS LIMITED EXCLUSION CLAUSE (PROPERTY TREATY REINSURANCE) Based on LMA 5410 - Amended to clarify consistency of coverage in the write-back 1. Notwithstanding any provision to the contrary within this reinsurance agreement or any endorsement thereto; this reinsurance agreement excludes all loss; damage; liability; cost or expense of whatsoever nature directly or indirectly caused by; contributed to by; resulting from; arising out of or in connection with: 1.1 any loss of; alteration of; or damage to or a reduction in the functionality; availability or operation of a Computer System; unless subject to the provisions of paragraph 2; 1.2 any loss of use; reduction in functionality; repair; replacement; restoration or reproduction of any Data; including any amount pertaining to the value of such Data. 2. Subject to the other terms; conditions and exclusions contained in this reinsurance agreement; this reinsurance agreement will cover physical damage to property insured under the original policies and any Time Element Loss directly resulting therefrom where such physical damage is directly occasioned by a peril otherwise covered hereunder.	88

• Loss: BatchAllTripletLoss

sscd

• Dataset: sscd
• Size: 100 evaluation samples
• Columns: sentence and label
• Approximate statistics based on the first 1000 samples:

  	sentence	label
  type	string	int
  details	min: 5 tokens mean: 70.36 tokens max: 128 tokens	1: ~1.00% 3: ~8.00% 4: ~1.00% 5: ~1.00% 7: ~1.00% 8: ~2.00% 19: ~4.00% 25: ~1.00% 26: ~2.00% 29: ~2.00% 32: ~2.00% 33: ~2.00% 34: ~1.00% 38: ~1.00% 39: ~1.00% 54: ~3.00% 55: ~1.00% 68: ~1.00% 78: ~2.00% 80: ~1.00% 82: ~1.00% 84: ~1.00% 93: ~1.00% 98: ~1.00% 120: ~1.00% 134: ~1.00% 135: ~1.00% 143: ~1.00% 144: ~2.00% 149: ~1.00% 154: ~1.00% 161: ~1.00% 173: ~1.00% 180: ~1.00% 181: ~1.00% 183: ~2.00% 206: ~1.00% 236: ~1.00% 238: ~1.00% 239: ~1.00% 243: ~1.00% 244: ~1.00% 256: ~1.00% 264: ~1.00% 326: ~1.00% 361: ~1.00% 367: ~1.00% 374: ~1.00% 377: ~1.00% 429: ~1.00% 433: ~1.00% 443: ~1.00% 448: ~1.00% 473: ~1.00% 488: ~1.00% 521: ~1.00% 535: ~1.00% 556: ~1.00% 557: ~1.00% 580: ~1.00% 589: ~1.00% 679: ~1.00% 693: ~1.00% 797: ~1.00% 857: ~1.00% 859: ~1.00% 871: ~1.00% 873: ~1.00% 960: ~1.00% 979: ~1.00% 1028: ~1.00% 1155: ~1.00% 1209: ~1.00% 1213: ~1.00% 1256: ~1.00% 1297: ~1.00% 1331: ~1.00% 1481: ~1.00% 1528: ~1.00% 1541: ~1.00%

• Samples:

  sentence	label
  “Communicable Disease” means any disease which can be transmitted by means of any substance or agent from any organism to another organism where: a. the substance or agent includes; but is not limited to; a virus; bacterium; parasite or other organism or any variation thereof; whether deemed living or not; and b. the method of transmission; whether direct or indirect; includes but is not limited to; airborne transmission; bodily fluid transmission; transmission from or to any surface or object; solid; liquid or gas or between organisms; and c. the disease; substance or agent can cause or threaten damage to human health or human welfare or can cause or threaten damage to; deterioration of; loss of value of; marketability of or loss of use of property.	4
  “Production; Use or Storage of Nuclear Material” means the production; manufacture; enrichment; conditioning; processing; reprocessing; use; storage; handling and disposal of Nuclear Material.	25
  means information; facts; concepts; code or any other information of any kind that is recorded or transmitted in a form to be used; accessed; processed; transmitted or stored by a Computer System.	7

• Loss: BatchAllTripletLoss

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• learning_rate: 3e-05
• num_train_epochs: 10
• warmup_ratio: 0.1

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• learning_rate: 3e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 10
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional

Training Logs

Epoch	Step	Training Loss	apd loss	apInd loss	aac loss	apc loss	apInc loss	aad loss	sscc loss	apnc loss	sscd loss	apnd loss
1.4535	500	0.5069	0.6269	0.0926	0.1156	0.5573	0.0900	0.0444	2.7486	0.8864	2.6554	0.5555
2.9070	1000	0.154	0.5802	0.1220	0.1127	0.6928	0.1211	0.0331	2.4360	0.9629	2.3819	0.5900
4.3605	1500	0.0493	0.5687	0.1286	0.1174	0.5777	0.1217	0.0597	2.4323	0.8979	2.3929	0.5691
5.8140	2000	0.0177	0.6482	0.1374	0.1018	0.6558	0.1313	0.0349	2.4738	0.8593	2.3731	0.6014
7.2674	2500	0.0083	0.6811	0.1397	0.1126	0.5784	0.1375	0.0471	2.4971	0.9022	2.4082	0.6137
8.7209	3000	0.0047	0.6444	0.1391	0.1082	0.5915	0.1412	0.0424	2.4747	0.8959	2.4054	0.6123

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 3.0.1
• Transformers: 4.41.2
• PyTorch: 2.3.0+cu121
• Accelerate: 0.32.1
• Datasets: 2.20.0
• Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

ContrastiveTensionLossInBatchNegatives

@inproceedings{carlsson2021semantic,
    title={Semantic Re-tuning with Contrastive Tension},
    author={Fredrik Carlsson and Amaru Cuba Gyllensten and Evangelia Gogoulou and Erik Ylip{"a}{"a} Hellqvist and Magnus Sahlgren},
    booktitle={International Conference on Learning Representations},
    year={2021},
    url={https://openreview.net/forum?id=Ov_sMNau-PF}
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply}, 
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}

ContrastiveLoss

@inproceedings{hadsell2006dimensionality,
    author={Hadsell, R. and Chopra, S. and LeCun, Y.},
    booktitle={2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06)}, 
    title={Dimensionality Reduction by Learning an Invariant Mapping}, 
    year={2006},
    volume={2},
    number={},
    pages={1735-1742},
    doi={10.1109/CVPR.2006.100}
}

BatchAllTripletLoss

@misc{hermans2017defense,
    title={In Defense of the Triplet Loss for Person Re-Identification}, 
    author={Alexander Hermans and Lucas Beyer and Bastian Leibe},
    year={2017},
    eprint={1703.07737},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}