patentory/patentory_model

SentenceTransformer based on mpi-inno-comp/paecter

This is a sentence-transformers model finetuned from mpi-inno-comp/paecter. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: mpi-inno-comp/paecter
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 1024 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'log information gathering/analyzing device [SEP] permit a log information gathering/analyzing device to make the display part of a chart showing an operation situation when a program is executed, correspond to a source program. a log information gathering means 1, a log information preservation means 2, a log information analysis means 3, a chart generation means 4, a display means 5, a screen position designation means 6 judging a position on the chart and a source position analysis means 7 for analyzing the position of the source program, which corresponds to the position on the chart, are provided. the function name and line number on the source program, which correspond to the position, can be known from position information on the chart that the user designates. a function designation means 8 inputting the function name and the position in the source program and a display position analysis means 9 analyzing the display position on the chart from the inputted function name and the position are provided. thus, the display position on the chart can be learnt from the function name and the line number, which the user designates. [SEP] an apparatus for log data collection and analysis which is used for analyzing behavior of a program, comprising: log data collecting means for collecting log records while the program is in execution, each of the log records including information regarding an operation type and execution time of each part of the program; log data storage means for storing the log records collected by said log data collecting means; log data analyzing means for retrieving the log records from said log data storage means and analyzing the operation type and the execution time of each log record; diagram generating means for generating a history diagram that visualizes the analyzed log records in temporal order, the history diagram being organized into a plurality of segments that represent the respective log records; display means for displaying on a screen the history diagram generated by said diagram generating means; and association analyzing means for performing analysis of part-to-part association between the displayed history diagram and a source program in response to an instruction from a user and for providing said diagram generating means and/or said display means with the part-to-part association clarified through the analysis, wherein the source program is a set of instruction statements from which the program in executable form is translated.',
    'dynamic update of a user interface based on collected user interactions [SEP] while a user is using the electronic device, user interaction information for keystrokes, button pushes, and activation of functional controls may be recorded. the user interaction information is stored and when the electronic device is connected to a network, the user interaction information is sent over the network to a user interface analyzer. the user interface analyzer analyzes the user interaction information to determine patterns of usage regarding a hierarchy of menu items for the user interface. the analysis may show that a user interface may be improved for better usability. the user interface on the electronic device may be dynamically changed to alter the menu hierarchy, or the analysis may be used to improve future generations of products. for example, menu items may be positioned such that the user can more easily access menu items that are used more frequently. [SEP] a method for analyzing use of a user interface, the method comprising: determining user interaction information at an electronic device while a user is using the electronic device, the determining occurring independently of whether the device is connected to a network; storing a log of the determined user interaction information in the electronic device; after a connection between the electronic device and a network is detected, transmitting the stored log over the network to a user interface analyzer; analyzing the user interaction information at the user interface analyzer to determine patterns of usage regarding navigating a hierarchy of menu items in the user interface of the electronic device by identifying multiple keystrokes and ascertaining whether the multiple key strokes are associated with a common keystroke sequence, wherein the hierarchy of menu items comprises first and second branches of menu items; determining, at the user interface analyzer, a possible function that the user was searching for, the determining of the possible function being based on the analysis of the user interaction information revealing that during a navigation of the first branch of menu items, the user did not select any menu item triggering the possible function, and that during a subsequent navigation of the second branch of menu items, the user did select one menu item in the hierarchy of menu items, the selected item triggering the possible function; storing an analysis result for the determination of the possible function at the user interface analyzer; and using the stored analysis result to change the hierarchy of menu items to facilitate selection of the menu item triggering the possible function, wherein the user interface analyzer sends interface adjustment information to the electronic device over the network to allow the electronic device to change the hierarchy of menu items based on the stored analysis result by changing a location of the menu item triggering the possible function from the second branch of the menu items to the first branch of menu items based on the interface adjustment information.',
    'memory recovery scheme and data structure in a heating, ventilation and air conditioning network [SEP] a method for updating a parameter in a device in an hvac network includes, in one embodiment, sending, by an interface to the device, 1) a parameter value change message, and 2) a new value of an installer parameter. the device determines if the new value is within an allowed range. the parameter is updated with the new value in a memory of the device if the parameter update is within the allowed range. the device sends the parameter to the interface. the parameter is relayed by the interface to an active subnet controller of the hvac network. [SEP] a method for updating a parameter in a device in an hvac network, comprising: sending, by an interface to said device: a) a parameter value change message, and b) a new value of an installer parameter; determining by said device if said new value is within an allowed range; updating said parameter with said new value in a memory of said device if said parameter update is within said allowed range; sending, by said device, said updated parameter to said interface; and relaying, by said interface, said updated parameter to an active subnet controller of said hvac network.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Dataset

Unnamed Dataset

• Size: 250 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 250 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 123 tokens mean: 364.62 tokens max: 512 tokens	min: 91 tokens mean: 338.1 tokens max: 512 tokens	min: 111 tokens mean: 343.0 tokens max: 512 tokens

• Samples:

  anchor	positive	negative
  blanking aperture array device for multi-beams and fabrication method of blanking aperture array device for multi-beams [SEP] provide a method of manufacturing a blanking aperture array device, capable of suppressing surface charging due to multibeam irradiation, by a simpler process. a method of manufacturing a blanking aperture array device of multibeam includes a step for forming a plurality of electrodes 24, 26 and a plurality of pads 29 on a metal film 340, by using a substrate 300 having a surface on which an insulating film 310, a metal film 320, an insulating film 330, and a metal film 340 are laminated in order from the lower layer side, a step for removing a part of the metal film 340 by etching, a step for removing the insulating film 330 by etching, with the plurality of electrodes, plurality of pads and the remainder of the metal film 340 as a mask, and a step for forming a plurality of passing holes 25, each penetrating the substrate at a position between a pair of electr...	electron beam exposure method and system for exposing a pattern on a substrate with an improved accuracy and throughput [SEP] an electron beam exposure process includes a step of producing a plurality of electron beam elements from a single electron beam by shaping and radiating the plurality of electron beam elements on a substrate. the exposure is achieved in a plurality of times with respective electron beam patterns by means of different sets of electron beam elements, wherein the electron beam elements of different sets are produced simultaneously and deflected simultaneously so as to scan the substrate consecutively. the electron beam elements in one set are offset from corresponding electron beam elements of the other set by a pitch of m/n wherein n represents the number of the electron beam sets and m is an integer smaller than n. [SEP] a method for exposing a pattern on an object by means of an electron beam, comprising the steps of: producing an electron beam such that said e...	mobile energy carrier and energy storage device [SEP] a mobile energy carrier with which energy in the form of materials from zones distributed widely throughout the world, for example with a large amount of solar energy, wind energy or other co 2 -neutral energy, for example the equator, can be transported to zones where there is a high energy requirement, for example europe. [SEP] a method for energy transport and/or energy storage, comprising: obtaining electrical energy from at least one of sun, wind, biogas, and excessively produced electrical energy; producing, from the electrical energy, an energy carrier formed as an elementary metal; changing the energy carrier to a transportable or storable species; transporting or storing the energy carrier in the transportable or storable species; and releasing the electrical energy stored in the energy carrier by reaction with at least one of water and oxygen.
  cartridge for cleaning, drive device, adjusting method for magnetic head, and magnetic storage system [SEP] provide a cartridge for cleaning, using new magnetic tape travel control, a drive device, an adjusting method for a magnetic head, and a magnetic recording system which enable a user to adjust the magnetic head while performing cleaning operation on the site and further enable the user to detect and predict a fault of the magnetic head by performing the cleaning operation. the adjusting method for the magnetic head includes a step for setting the cartridge for cleaning in the drive device, a step for judging that the cartridge for cleaning is loaded by checking a cleaning bit in a nonvolatile memory, a step for performing adjusting operation after the cleaning operation when judging that the cleaning cartridge is loaded, and a step for reading a pattern signal out of a specified area of a magnetic tape held in the cleaning cartridge. [SEP] a drive unit comprising: means for ident...	linear tape drive head cleaning process [SEP] a method is provided for cleaning a transducer head in a tape drive. the method includes the steps of: providing a tape drive with a head cleaning device, a data tape cartridge having data tape, and a cleaning tape cartridge having cleaning tape; detecting error rate for the transducer head with the data tape; determining when the detected error rate exceeds a specified level; and when the detected error rate exceeds a specified level, loading the cleaning tape cartridge into the tape drive and running cleaning media on the cleaning tape over the transducer head to clean the transducer head. another method includes using a head cleaning device to clean the transducer head when there is an identified need, or as a preventative measure. [SEP] a linear tape drive head cleaning process, comprising: providing a tape drive having a head cleaning device, and a data tape cartridge having data tape; inserting the data tape cartridge into the tape dr...	tunnel-type magneto-resistance effect elemet and manufacturing method therefor [SEP] solve a problem that the control of the introduced pressure of oxygen and time is difficult and only a metallic layer is completely oxidized since an insulating barrier is necessary to be formed thin at the time of forming the insulating barrier of the metallic layer by oxidization in a conventional tunnel-type magneto-resistance effect element. two ferromagnetic layers 11 and 12 are two-dimensionally installed on an insulating barrier layer since the insulating barrier layer 10 can previously be formed, it is not necessary to consider the influence of the ferromagnetic layers 11 and 12 to oxidization at the time of forming the insulating burrier layer 10 by oxidizing the metallic layer. the insulating barrier layer 10 can be formed thick and the defect of a pin hole can be suppressed. thus, the tunnel-type magneto-resistance effect element with a satisfactory characteristic can be manufactured. [SEP] ...
  image forming apparatus [SEP] provide an image forming apparatus in which a residual toner remaining on a latent electrostatic image bearing member is recovered and reused, the contamination of a charging member to charge the latent electrostatic image bearing member is prevented, the recovery of the residual toner at a development step is facilitated, and superior image stability is ensured, and to provide a toner, a toner container and a process cartridge. in the image forming apparatus in which the residual toner remaining on a surface of the latent electrostatic image bearing member, after transfer is passed from the latent electrostatic image bearing member through a charging component of the subsequent recharging unit for recharging and is then recovered in a developing device; the charging component is a polymer sheet having a surface roughness (ra) of 12- 51 m; the toner contains at least a pigment, a binder resin and a releasing agent, and contains inorganic fine particles as ...	toner and method of preparing the toner [SEP] a toner is provided including a binder resin, a colorant, and a release agent, which has a volume average particle diameter (dv) of from 3 to 9 m, and wherein the binder resin and the release agent form a sea-island structure in which the island formed of the release agent is dispersed in the sea formed of the binder resin in a cross-sectional image of the toner obtained by a transmission electron microscope (tem), and the following relationships are satisfied: ib>ia and ib>ic, wherein each of ia, ib, and ic represents an area ratio (%) of the island in an outermost region (a) of the cross-sectional image of the toner, an intermediate region (b) thereof located under the outermost region (a), and an innermost region (c) thereof located under the intermediate region (b); and a method of preparing the toner. [SEP] a toner, comprising: a binder resin; a colorant; and a release agent, wherein the toner has a volume average particle diameter (dv...	vibration device for dust removal and imaging device [SEP] a vibration device comprises a vibrating member having at least n (n 2) piezoelectric elements arranged on a vibrating plate, each of the piezoelectric elements being formed by using a lead-free piezoelectric material and electrodes, wherein if the temperature that maximizes the piezoelectric constant of the piezoelectric material of each of the n piezoelectric elements is expressed as t m (m being a natural number between 1 and n), at least two of t 1 through t n differ from each other. [SEP] a vibration device comprising a vibrating member having at least n piezoelectric elements arranged on a vibrating plate, each of the piezoelectric elements being formed by using a lead-free piezoelectric material and electrodes, wherein, if a temperature that maximizes a piezoelectric constant of the piezoelectric material of each of the n piezoelectric elements is expressed as t m , at least two of t 1 through t n differ from each other,...

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• gradient_accumulation_steps: 4
• learning_rate: 2e-05
• num_train_epochs: 1
• warmup_ratio: 0.1
• fp16: True
• gradient_checkpointing: True

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: no
• prediction_loss_only: True
• per_device_train_batch_size: 8
• per_device_eval_batch_size: 8
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 4
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 2e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 1
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• bf16: False
• fp16: True
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch_fused
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• project: huggingface
• trackio_space_id: trackio
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: True
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: no
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: True
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional

Framework Versions

• Python: 3.12.13
• Sentence Transformers: 3.3.1
• Transformers: 4.57.6
• PyTorch: 2.11.0+cu128
• Accelerate: 1.14.0
• Datasets: 4.0.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}