metadata

base_model: sentence-transformers/multi-qa-MiniLM-L6-cos-v1
datasets: []
language: []
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - generated_from_trainer
  - dataset_size:211
  - loss:MultipleNegativesRankingLoss
widget:
  - source_sentence: How long is the initial period of extra time in the drop-off procedure?
    sentences:
      - >-
        required in drawn matches, the following drop - off procedure is used to
        determine a winner. 24. 1. 1 each team will reduce their on - field team
        to four ( 4 ) players and within 60 seconds take up a position to
        restart play from the halfway line, defending the same end of the field
        as at the end of play. 24. 1. 2 the drop - off commences with a tap from
        the centre of the halfway line by the team that did not commence the
        match with possession. 24. 1. 3 the drop - off will commence with a two
        ( 2 ) minute period of extra time. 24. 1. 4 should a team be leading at
        the expiration of the two ( 2 ) minute period of extra time then that
        team will be declared the winner and match complete. 24. 1. 5 should
        neither team be leading at the expiration of two ( 2 ) minutes, a signal
        is given and the match will pause at the next touch or dead ball. each
        team will then remove another player from the field of play. 24. 1. 6
        the match will recommence immediately after the players have left the
        field at the same place where it paused ( i. e. the team retains
        possession at the
      - >-
        made but must be included in relevant competition, event or tournament
        conditions 1. 2 line markings should be 4cm in width but must be no less
        than 2. 5cm. line markings are to be laid out as shown in appendix 1 -
        the field of play. sidelines extend seven ( 7 ) metres beyond the try
        lines to join the dead ball lines and define the in - goal areas which
        measure fifty ( 50 ) metres wide by seven ( 7 ) metres in length. 1. 3
        the interchange areas are located no closer than one ( 1 ) metre from
        each sideline. 1. 4 suitably sized markers, cones or corner posts of a
        distinguishing colour and made from safe and pliable material should be
        positioned at the intersections of the sideline and halfway line and the
        sideline and the try line. 1. 4. 1 markers, cones or corner posts placed
        on the junction of the sideline and try line are deemed to be in the
        field of play. 1. 4. 2 all other markers or cones are deemed to be out
        of the field of play. 1. 5 the standard playing surface is grass. other
        surfaces including synthetic grass may be used but shall be subject to
        nta approved standards. 1. 6 the field of play
      - >-
        required in drawn matches, the following drop - off procedure is used to
        determine a winner. 24. 1. 1 each team will reduce their on - field team
        to four ( 4 ) players and within 60 seconds take up a position to
        restart play from the halfway line, defending the same end of the field
        as at the end of play. 24. 1. 2 the drop - off commences with a tap from
        the centre of the halfway line by the team that did not commence the
        match with possession. 24. 1. 3 the drop - off will commence with a two
        ( 2 ) minute period of extra time. 24. 1. 4 should a team be leading at
        the expiration of the two ( 2 ) minute period of extra time then that
        team will be declared the winner and match complete. 24. 1. 5 should
        neither team be leading at the expiration of two ( 2 ) minutes, a signal
        is given and the match will pause at the next touch or dead ball. each
        team will then remove another player from the field of play. 24. 1. 6
        the match will recommence immediately after the players have left the
        field at the same place where it paused ( i. e. the team retains
        possession at the
  - source_sentence: >-
      What happens to the touch count if a player from the defending team
      deliberately makes contact with the ball in flight, propelling it towards
      the defending team's dead ball line and an attacking player drops the
      ball?
    sentences:
      - >-
        ##s as zero ( 0 ) touch. 12. 2 if a player from the defending team
        deliberately makes contact with the ball in flight and the ball is
        retrieved by an attacking player, without touching the ground, play
        continues and the next touch is zero ( 0 ) touch. 12. 3 if a player from
        the defending team deliberately makes contact with the ball in flight,
        propelling it forward and an attacking player, in an attempt to regain
        possession, drops the ball, the attacking team retains possession and
        the fit playing rules - 5th edition 10 copyright © touch football
        australia 2020 touch count restarts as zero ( 0 ) touch. 12. 4 if a
        player from the defending team deliberately makes contact with the ball
        in flight, propelling it towards the defending team ’ s dead ball line
        and an attacking player, in an attempt to regain possession drops the
        ball, a change of possession occurs. 12. 5 if a player from the
        defending team unintentionally makes contact with the ball in flight and
        the ball goes to ground, a change of possession occurs. 12. 6 if a
        player from the defending team unintentionally makes contact with the
        ball in flight and the ball is retrieved by an attacking player, play
        and the touch count continues.
      - >-
        made but must be included in relevant competition, event or tournament
        conditions 1. 2 line markings should be 4cm in width but must be no less
        than 2. 5cm. line markings are to be laid out as shown in appendix 1 -
        the field of play. sidelines extend seven ( 7 ) metres beyond the try
        lines to join the dead ball lines and define the in - goal areas which
        measure fifty ( 50 ) metres wide by seven ( 7 ) metres in length. 1. 3
        the interchange areas are located no closer than one ( 1 ) metre from
        each sideline. 1. 4 suitably sized markers, cones or corner posts of a
        distinguishing colour and made from safe and pliable material should be
        positioned at the intersections of the sideline and halfway line and the
        sideline and the try line. 1. 4. 1 markers, cones or corner posts placed
        on the junction of the sideline and try line are deemed to be in the
        field of play. 1. 4. 2 all other markers or cones are deemed to be out
        of the field of play. 1. 5 the standard playing surface is grass. other
        surfaces including synthetic grass may be used but shall be subject to
        nta approved standards. 1. 6 the field of play
      - >-
        ( 4 ) defending players are in an onside position or unless directed to
        so by the referee. where the number of players on the field from the
        defending team falls below four ( 4 ), all players must be in an onside
        position for a tap to be taken unless directed to do so by the referee.
        ruling = the player will be directed to return to the mark and to take
        the tap again. 7. 7 the tap to commence or recommence play must be
        performed without delay. ruling = a penalty to the non - offending team
        at the centre of the halfway line. 8 match duration 8. 1 a match is 40
        minutes in duration, consisting of two ( 2 ) x 20 minute halves with a
        half time break. 8. 1. 1 there is no time off for injury during a match.
        8. 2 local competition and tournament conditions may vary the duration
        of a match. 8. 3 when time expires, play is to continue until the next
        touch or dead ball and end of play is signaled by the referee. 8. 3. 1
        should a penalty be awarded during this period, the penalty is to be
        taken. 8. 4 if a match is abandoned in any circumstances other than
        those referred to in
  - source_sentence: >-
      What happens if an attacking player fails to perform a rollball on the
      mark?
    sentences:
      - >-
        ball goes to ground, a change of possession occurs. 12. 6 if a player
        from the defending team unintentionally makes contact with the ball in
        flight and the ball is retrieved by an attacking player, play and the
        touch count continues. 12. 7 a player from the attacking team cannot
        pass the ball into a defending player intentionally seeking a rebound or
        a restart of the touch count. ruling = a penalty to the defending team
        at the point of the pass. 13 the rollball 13. 1 the attacking player is
        to position on the mark, face the opponent ’ s try line, make a genuine
        attempt to stand parallel to the sidelines, place the ball on the ground
        between the feet in a controlled manner and : 13. 1. 1 step forward over
        the ball ; or 13. 1. 2 roll the ball back between the feet no more than
        one ( 1 ) metre ; or 13. 1. 3 pass a foot over the ball. ruling = a
        change of possession to the defending team at the point of the
        infringement. 13. 2 a player must perform the rollball on the mark.
        ruling = a penalty to the defending team at the point of the
        infringement. 13. 3 a player must not perform a voluntary rollball
      - >-
        dead ball and end of play is signaled by the referee. 8. 3. 1 should a
        penalty be awarded during this period, the penalty is to be taken. 8. 4
        if a match is abandoned in any circumstances other than those referred
        to in clause 24. 1. 6 the nta or nta competition provider in its sole
        discretion shall determine the result of the match. 9 possession 9. 1
        the team with the ball is entitled to six ( 6 ) touches prior to a
        change of possession. 9. 2 on the change of possession due to an
        intercept, the first touch will be zero ( 0 ) touch. 9. 3 following the
        sixth touch or a loss of possession due to any other means, the ball
        must be returned to the mark without delay. ruling = a deliberate delay
        in the changeover procedure will result in a penalty awarded to the non
        - offending team ten ( 10 ) metres forward of the mark for the change of
        possession. 9. 4 if the ball is dropped or passed and goes to ground
        during play, a change of possession results. ruling = the mark for the
        change of possession is where the ball makes initial contact with the
        ground. 9. 5 if the ball, while still under the control of the half
      - >-
        ( 7 ) metre line. 10. 7 the half may pass or run with the ball but
        cannot get touched while in possession of the ball. ruling = a change of
        possession occurs at the point of the touch, or if in - goal the nearest
        point on the seven ( 7 ) metre line. 10. 8 if a touch is made in the in
        - goal area before the ball is grounded, the player in possession is to
        perform a rollball seven ( 7 ) metres from the team ’ s attacking try
        line, provided it is not the sixth touch and the player is not half. 10.
        9 if a player in possession is touched while on or behind their
        defending try line, the touch counts and once the referee sets the mark
        seven ( 7 ) metres directly forward of the contact point from the
        defending team ’ s try line, a rollball is performed. 10. 10 if a player
        in possession intentionally makes a touch on an offside defender who is
        making every effort to retire and remain out of play, the touch counts.
        fit playing rules - 5th edition copyright © touch football australia
        2020 9 10. 11 if a touch is made on a player in possession while the
        player is juggling the ball in an attempt to maintain control of it,
  - source_sentence: >-
      What is the result of a match if it is abandoned in circumstances other
      than those specified in clause 24.1.6?
    sentences:
      - >-
        touch football australia 2020 11 13. 5. 5 when possession changes after
        the half is touched or when the half places the ball on or over the try
        line ; or 13. 5. 6 in replacement of a penalty tap ; or 13. 5. 7 when so
        directed by the referee. 13. 6 a player is to perform a rollball seven (
        7 ) metres in - field under the following circumstances : 13. 6. 1 when
        a change of possession takes place due to a player in possession making
        contact with the sideline or any ground outside the field of play, prior
        to a touch being made ; or 13. 6. 2 when the ball not in possession of a
        player makes contact with the sideline or any ground outside the field
        of play. 13. 7 a player may not perform a tap in replacement of a
        rollball. ruling = the offending team must return to the mark and
        perform the rollball. 13. 8 an attacking player, other than the player
        performing the rollball, may receive the ball at the rollball and shall
        do so without delay. that player is referred to as the half. 13. 9 the
        half may control the ball with a foot prior to picking up the ball. 13.
        10 a player
      - >-
        a rollball. half time the break in play between the two halves of a
        match. imminent about to occur, it is almost certain to occur.
        infringement the action of a player contrary to the rules of the game.
        in - goal area the area in the field of play bounded by the sidelines,
        the try lines and the dead ball lines. there are two ( 2 ), one ( 1 ) at
        each end of the field of play. see appendix 1. interchange the act of an
        on - field player leaving the field of play to be replaced by an off -
        field player entering the field of play. interchange area a marked
        rectangle for each team on opposite sides of the field of play usually
        measuring 20 metres long by no more than five ( 5 ) metres wide,
        extending ten ( 10 ) metres either side of the halfway line and not less
        than one ( 1 ) metre from the sideline. it is the area in which all off
        - field players must remain until an interchange is initiated. see
        appendix 1. kick strike or propel forcibly with the foot, a blow or
        forceful thrust with the foot to the ball. a tap to commence or
        recommence play or a penalty tap is not defined as a kick. line markings
      - >-
        dead ball and end of play is signaled by the referee. 8. 3. 1 should a
        penalty be awarded during this period, the penalty is to be taken. 8. 4
        if a match is abandoned in any circumstances other than those referred
        to in clause 24. 1. 6 the nta or nta competition provider in its sole
        discretion shall determine the result of the match. 9 possession 9. 1
        the team with the ball is entitled to six ( 6 ) touches prior to a
        change of possession. 9. 2 on the change of possession due to an
        intercept, the first touch will be zero ( 0 ) touch. 9. 3 following the
        sixth touch or a loss of possession due to any other means, the ball
        must be returned to the mark without delay. ruling = a deliberate delay
        in the changeover procedure will result in a penalty awarded to the non
        - offending team ten ( 10 ) metres forward of the mark for the change of
        possession. 9. 4 if the ball is dropped or passed and goes to ground
        during play, a change of possession results. ruling = the mark for the
        change of possession is where the ball makes initial contact with the
        ground. 9. 5 if the ball, while still under the control of the half
  - source_sentence: >-
      What is the ruling if an attacking player intentionally passes the ball to
      a defending player seeking a rebound or restart of the touch count?
    sentences:
      - >-
        ball goes to ground, a change of possession occurs. 12. 6 if a player
        from the defending team unintentionally makes contact with the ball in
        flight and the ball is retrieved by an attacking player, play and the
        touch count continues. 12. 7 a player from the attacking team cannot
        pass the ball into a defending player intentionally seeking a rebound or
        a restart of the touch count. ruling = a penalty to the defending team
        at the point of the pass. 13 the rollball 13. 1 the attacking player is
        to position on the mark, face the opponent ’ s try line, make a genuine
        attempt to stand parallel to the sidelines, place the ball on the ground
        between the feet in a controlled manner and : 13. 1. 1 step forward over
        the ball ; or 13. 1. 2 roll the ball back between the feet no more than
        one ( 1 ) metre ; or 13. 1. 3 pass a foot over the ball. ruling = a
        change of possession to the defending team at the point of the
        infringement. 13. 2 a player must perform the rollball on the mark.
        ruling = a penalty to the defending team at the point of the
        infringement. 13. 3 a player must not perform a voluntary rollball
      - >-
        . see appendix 1. kick strike or propel forcibly with the foot, a blow
        or forceful thrust with the foot to the ball. a tap to commence or
        recommence play or a penalty tap is not defined as a kick. line markings
        markings of the field of play. see appendix 1. link the player beside
        the wing player. mark ( for a tap ) the centre of the halfway line for
        the commencement or recommencement of play, or the position where a
        penalty tap is awarded as a result of an infringement. mark ( for a
        touch ) the position in the field of play where the player in possession
        was at the time the touch was made. fit playing rules - 5th edition 2
        copyright © touch football australia 2020 middle the player inside the
        link player. nta national touch association as defined in the fit
        constitution. obstruction a deliberate attempt by either an attacking or
        defending player to gain an unfair advantage by interfering with the
        opposition to prevent them from gaining a rightful advantage. offside (
        attacker ) an attacking player in a position forward of the ball.
        offside ( defender ) a defending player in a position closer than seven
        ( 7 ) metres from the mark of the rollball ; or ten ( 10 ) metres from
        the mark
      - >-
        or passed and goes to ground during play, a change of possession
        results. ruling = the mark for the change of possession is where the
        ball makes initial contact with the ground. 9. 5 if the ball, while
        still under the control of the half, contacts the ground in the in -
        goal area, possession is lost. ruling = play will restart with a
        rollball at the nearest point on the seven ( 7 ) metre line. fit playing
        rules - 5th edition 8 copyright © touch football australia 2020 9. 6 if
        a player mishandles the ball and even if in an effort to gain control,
        the ball is accidentally knocked forward into any other player, a change
        of possession results. 10 the touch 10. 1 a touch may be made by either
        a defending player or a player in possession. 10. 2 a defending player
        may not claim a touch if contact has not been made. if a player claims a
        touch has been made, but the referee is unsure the touch will count.
        ruling = a penalty to the attacking team at the point of the
        infringement and the offending player sent to the sin bin. 10. 3 players
        of both defending and attacking teams are to use the minimum force
        necessary to make a touch. players must ensure that the

SentenceTransformer based on sentence-transformers/multi-qa-MiniLM-L6-cos-v1

This is a sentence-transformers model finetuned from sentence-transformers/multi-qa-MiniLM-L6-cos-v1. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

Model Type: Sentence Transformer
Base model: sentence-transformers/multi-qa-MiniLM-L6-cos-v1
Maximum Sequence Length: 512 tokens
Output Dimensionality: 384 tokens
Similarity Function: Cosine Similarity

Model Sources

Documentation: Sentence Transformers Documentation
Repository: Sentence Transformers on GitHub
Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("Trelis/multi-qa-MiniLM-L6-cos-v1-ft-pairs-2-cos-epoch-s20")
# Run inference
sentences = [
    'What is the ruling if an attacking player intentionally passes the ball to a defending player seeking a rebound or restart of the touch count?',
    'ball goes to ground, a change of possession occurs. 12. 6 if a player from the defending team unintentionally makes contact with the ball in flight and the ball is retrieved by an attacking player, play and the touch count continues. 12. 7 a player from the attacking team cannot pass the ball into a defending player intentionally seeking a rebound or a restart of the touch count. ruling = a penalty to the defending team at the point of the pass. 13 the rollball 13. 1 the attacking player is to position on the mark, face the opponent ’ s try line, make a genuine attempt to stand parallel to the sidelines, place the ball on the ground between the feet in a controlled manner and : 13. 1. 1 step forward over the ball ; or 13. 1. 2 roll the ball back between the feet no more than one ( 1 ) metre ; or 13. 1. 3 pass a foot over the ball. ruling = a change of possession to the defending team at the point of the infringement. 13. 2 a player must perform the rollball on the mark. ruling = a penalty to the defending team at the point of the infringement. 13. 3 a player must not perform a voluntary rollball',
    '. see appendix 1. kick strike or propel forcibly with the foot, a blow or forceful thrust with the foot to the ball. a tap to commence or recommence play or a penalty tap is not defined as a kick. line markings markings of the field of play. see appendix 1. link the player beside the wing player. mark ( for a tap ) the centre of the halfway line for the commencement or recommencement of play, or the position where a penalty tap is awarded as a result of an infringement. mark ( for a touch ) the position in the field of play where the player in possession was at the time the touch was made. fit playing rules - 5th edition 2 copyright © touch football australia 2020 middle the player inside the link player. nta national touch association as defined in the fit constitution. obstruction a deliberate attempt by either an attacking or defending player to gain an unfair advantage by interfering with the opposition to prevent them from gaining a rightful advantage. offside ( attacker ) an attacking player in a position forward of the ball. offside ( defender ) a defending player in a position closer than seven ( 7 ) metres from the mark of the rollball ; or ten ( 10 ) metres from the mark',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Hyperparameters

Non-Default Hyperparameters

eval_strategy: steps
per_device_train_batch_size: 32
per_device_eval_batch_size: 32
learning_rate: 2e-05
num_train_epochs: 2
lr_scheduler_type: cosine
warmup_ratio: 0.3

All Hyperparameters

Click to expand

overwrite_output_dir: False
do_predict: False
eval_strategy: steps
prediction_loss_only: True
per_device_train_batch_size: 32
per_device_eval_batch_size: 32
per_gpu_train_batch_size: None
per_gpu_eval_batch_size: None
gradient_accumulation_steps: 1
eval_accumulation_steps: None
learning_rate: 2e-05
weight_decay: 0.0
adam_beta1: 0.9
adam_beta2: 0.999
adam_epsilon: 1e-08
max_grad_norm: 1.0
num_train_epochs: 2
max_steps: -1
lr_scheduler_type: cosine
lr_scheduler_kwargs: {}
warmup_ratio: 0.3
warmup_steps: 0
log_level: passive
log_level_replica: warning
log_on_each_node: True
logging_nan_inf_filter: True
save_safetensors: True
save_on_each_node: False
save_only_model: False
restore_callback_states_from_checkpoint: False
no_cuda: False
use_cpu: False
use_mps_device: False
seed: 42
data_seed: None
jit_mode_eval: False
use_ipex: False
bf16: False
fp16: False
fp16_opt_level: O1
half_precision_backend: auto
bf16_full_eval: False
fp16_full_eval: False
tf32: None
local_rank: 0
ddp_backend: None
tpu_num_cores: None
tpu_metrics_debug: False
debug: []
dataloader_drop_last: False
dataloader_num_workers: 0
dataloader_prefetch_factor: None
past_index: -1
disable_tqdm: False
remove_unused_columns: True
label_names: None
load_best_model_at_end: False
ignore_data_skip: False
fsdp: []
fsdp_min_num_params: 0
fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
fsdp_transformer_layer_cls_to_wrap: None
accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
deepspeed: None
label_smoothing_factor: 0.0
optim: adamw_torch
optim_args: None
adafactor: False
group_by_length: False
length_column_name: length
ddp_find_unused_parameters: None
ddp_bucket_cap_mb: None
ddp_broadcast_buffers: False
dataloader_pin_memory: True
dataloader_persistent_workers: False
skip_memory_metrics: True
use_legacy_prediction_loop: False
push_to_hub: False
resume_from_checkpoint: None
hub_model_id: None
hub_strategy: every_save
hub_private_repo: False
hub_always_push: False
gradient_checkpointing: False
gradient_checkpointing_kwargs: None
include_inputs_for_metrics: False
eval_do_concat_batches: True
fp16_backend: auto
push_to_hub_model_id: None
push_to_hub_organization: None
mp_parameters:
auto_find_batch_size: False
full_determinism: False
torchdynamo: None
ray_scope: last
ddp_timeout: 1800
torch_compile: False
torch_compile_backend: None
torch_compile_mode: None
dispatch_batches: None
split_batches: None
include_tokens_per_second: False
include_num_input_tokens_seen: False
neftune_noise_alpha: None
optim_target_modules: None
batch_eval_metrics: False
eval_on_start: False
batch_sampler: batch_sampler
multi_dataset_batch_sampler: proportional

Training Logs

Epoch	Step	Training Loss	loss
0.2857	2	1.9902	1.6592
0.5714	4	2.0653	1.5674
0.8571	6	1.7624	1.4603
1.1429	8	1.9255	1.3945
1.4286	10	1.3696	1.3618
1.7143	12	1.5989	1.3467
2.0	14	1.6238	1.3442

Framework Versions

Python: 3.10.12
Sentence Transformers: 3.0.1
Transformers: 4.42.3
PyTorch: 2.1.1+cu121
Accelerate: 0.31.0
Datasets: 2.17.1
Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply}, 
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}