Add new SentenceTransformer model

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+  "word_embedding_dimension": 768,
+  "pooling_mode_cls_token": false,
+  "pooling_mode_mean_tokens": true,
+  "pooling_mode_max_tokens": false,
+  "pooling_mode_mean_sqrt_len_tokens": false,
+  "pooling_mode_weightedmean_tokens": false,
+  "pooling_mode_lasttoken": false,
+  "include_prompt": true
+}

README.md

@@ -0,0 +1,543 @@
+---
+language:
+- en
+license: apache-2.0
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- generated_from_trainer
+- dataset_size:800
+- loss:TripletLoss
+base_model: nomic-ai/modernbert-embed-base
+widget:
+- source_sentence: Engineering Services. Executive Senior Manager (Managering Procurement).
+    The Senior Engineer (Engineering Procurement) is responsible for managing procurement
+    operations for the organisation's projects. He/She ensures adherence to quality
+    standards in all procurement activities and processes, and further improves the
+    procurement processes by proposing sourcing strategies and suggesting improvement
+    initiatives to enhance the organisation's ability for timely delivery on projects.
+    He manages a team of engineers and ensures efficient business operations.He typically
+    comes from an engineering background. He is comfortable engaging and interacting
+    with vendors and other external parties to manage the vendor selection and evaluation
+    processes, as well as vendor relationships and performance. As an experienced
+    worker with both engineering and procurement expertise, he may also be called
+    upon to preparing training materials to develop the team's procurement capabilities.
+  sentences:
+  - Senior Engineer (Engineering Procurement)
+  - Senior Nurse Clinician
+  - Hotel and Accommodation Services. Senior Linen Room Attendant / Laundry Valet
+    Attendant. The Linen Room Attendant/Laundry Valet Attendant performs daily assigned
+    duties to support the day-to-day laundry, linen and uniform room operations, ensuring
+    the delivery of clean garments, uniforms, towels and linens to all internal and
+    external customers. He/She collects and delivers guest laundry, performs laundry
+    cleaning, sorts and issues linens and uniforms, and assists in inventory count.
+    He also cleans and maintains laundry equipment and the work area.As part of service
+    delivery, the Linen Room Attendant/Laundry Valet Attendant has to handle guests'
+    requests and respond to their concerns and feedback in a professional and courteous
+    manner. He complies with organisational guidelines and regulations on hygiene
+    and workplace safety and health, and reports safety hazards observed to ensure
+    workplace safety and security.He is a team player with a high level of attentiveness
+    to details and good communication skills to interact with guests and all levels
+    of staff. He works on shifts, including weekends and public holidays. He is physically
+    fit to meet the physical demands of the job which may involve constant standing,
+    walking and lifting of heavy laundry and linen loads during a shift.
+- source_sentence: Social Service. Analyst Master Social Worker. The Master Social
+    Worker works in the field of social work. He/She has expertise in social work
+    domains and assists in supervising the delivery of interventions and programmes
+    at the cluster or sub-sector level, driving community development work and uplifting
+    the professional practice in social work. He strengthens partnership with key
+    influencers within the community and across the organisation to guide the development
+    of social service for various clients. He is also in charge of overseeing casework
+    and group work intervention as well as providing strategic leadership to develop
+    community development programmes. He initiates professional development projects
+    for staff.A highly experienced professional with excellent management and leadership
+    skills, the Master Social Worker inspires staff in their field of work. He works
+    in institutional settings, communities, voluntary welfare organisations and hospitals.
+    He leads collaborations with other agencies and ministries in the course of his
+    work.
+  sentences:
+  - Air Transport. Senior Baggage Services Assistant. The Baggage Services Assistant
+    operates automated baggage handling systems, Automated Guided Vehicles/Autonomous
+    Vehicles (AGV/AVs) and conveyors to load and unload baggage from aircraft. He/She
+    carries out checks on baggage to ensure there are no hazardous materials and dangerous
+    goods. He tows, loads and unloads baggage containers. He adheres to individual
+    safety and/or security standards in the workplace and reports breaches in safety
+    and/or security standards.A Class 3 Driving Licence and an Airfield Driving Permit
+    (ADP) are required of the Baggage Services Assistant to operate vehicles and conveyors.
+    He works outdoors under all weather conditions as well as works in shifts to accommodate
+    round-the-clock flight arrivals and departures. He is also physically strong and
+    is familiar with baggage handling systems and processes. In addition, he has good
+    time management and communication skills in order to work effectively with the
+    team and carry out his duties.
+  - Master Social Worker
+  - Principal Engineer / Engineering Manager (Mechanical and Electrical)
+- source_sentence: BioPharmaceuticals Manufacturing. Associate Process Development
+    / MS&T Executive. The Process Development/MS&T Manager reviews the operational
+    and financial viability of developing, monitoring and improving biopharmaceuticals
+    manufacturing processes within the facilities. He/She translates the departments
+    objectives and priorities into actionable operating plans and Key Performance
+    Indicators (KPIs) for Process Development/MS&T teams and tracks the progress.
+    He is responsible for optimising internal processes while keeping in line with
+    external guidelines and managing risks for the department. The Process Development/MS&T
+    Manager is responsible for facilitating cross-departmental collaboration in order
+    to successfully implement large-scale manufacturing processes for new biopharmaceuticals
+    products or significant changes to equipment, systems and processes for existing
+    products.The Process Development/MS&T Manager is expected to serve as a role model
+    in the department and should be a personable and inspiring leader who can communicate
+    well to influence internal and external stakeholders. He should be a champion
+    for innovation and particularly enjoys leading efficiency and improvement initiatives
+    across the organisation.
+  sentences:
+  - Director of Sales and Marketing
+  - Process Development / MS&T Manager
+  - Hotel and Accommodation Services. Associate Linen Room Attendant / Laundry Valet
+    Attendant. The Linen Room Attendant/Laundry Valet Attendant performs daily assigned
+    duties to support the day-to-day laundry, linen and uniform room operations, ensuring
+    the delivery of clean garments, uniforms, towels and linens to all internal and
+    external customers. He/She collects and delivers guest laundry, performs laundry
+    cleaning, sorts and issues linens and uniforms, and assists in inventory count.
+    He also cleans and maintains laundry equipment and the work area.As part of service
+    delivery, the Linen Room Attendant/Laundry Valet Attendant has to handle guests'
+    requests and respond to their concerns and feedback in a professional and courteous
+    manner. He complies with organisational guidelines and regulations on hygiene
+    and workplace safety and health, and reports safety hazards observed to ensure
+    workplace safety and security.He is a team player with a high level of attentiveness
+    to details and good communication skills to interact with guests and all levels
+    of staff. He works on shifts, including weekends and public holidays. He is physically
+    fit to meet the physical demands of the job which may involve constant standing,
+    walking and lifting of heavy laundry and linen loads during a shift.
+- source_sentence: Trade Associations and Chambers. Executive Branding, Marketing
+    & Communications Director / Assistant Director. The Branding, Marketing & Communications
+    Director/Assistant Director leads the organisations branding and marketing efforts.
+    He/She reviews and endorses the organisations overall marketing, communication
+    and branding strategies, and drives initiatives in adherence to the strategy.
+    He leads the communications with key stakeholders within the organisation and
+    drives cross-functional collaboration in support of achievement of the plan. He
+    is also responsible for leading the development and adoption of new technologies
+    into existing marketing processes and channels.The Branding, Marketing & Communications
+    Director/Assistant Director is highly innovative, creative, strategic and forward-looking.
+    He is encouraging, open to new ideas and strives to improve the organisation's
+    marketing initiatives. He keeps abreast with the latest marketing technologies
+    and serves as a mentor to direct reports, providing guidance on marketing, communication
+    and branding strategies.
+  sentences:
+  - Branding, Marketing & Communications Director / Assistant Director
+  - Monitoring, Surveillance and Testing Executive
+  - Hotel and Accommodation Services. Executive Linen Room Attendant / Laundry Valet
+    Attendant. The Linen Room Attendant/Laundry Valet Attendant performs daily assigned
+    duties to support the day-to-day laundry, linen and uniform room operations, ensuring
+    the delivery of clean garments, uniforms, towels and linens to all internal and
+    external customers. He/She collects and delivers guest laundry, performs laundry
+    cleaning, sorts and issues linens and uniforms, and assists in inventory count.
+    He also cleans and maintains laundry equipment and the work area.As part of service
+    delivery, the Linen Room Attendant/Laundry Valet Attendant has to handle guests'
+    requests and respond to their concerns and feedback in a professional and courteous
+    manner. He complies with organisational guidelines and regulations on hygiene
+    and workplace safety and health, and reports safety hazards observed to ensure
+    workplace safety and security.He is a team player with a high level of attentiveness
+    to details and good communication skills to interact with guests and all levels
+    of staff. He works on shifts, including weekends and public holidays. He is physically
+    fit to meet the physical demands of the job which may involve constant standing,
+    walking and lifting of heavy laundry and linen loads during a shift.
+- source_sentence: Accountancy. Senior Internal Audit Assistant Consultant. The Internal
+    Audit Assistant Manager is responsible for developing audit procedures and programmes
+    based on internal audit engagement objectives and scope. He/She is involved in
+    supervising internal audit engagements. The Internal Audit Assistant Manager analyses
+    implications of significant changes and infocomm technology (IT) developments
+    to the organisation, business units and key processes. He also guides the team
+    to uphold professional standards and ensure internal audit engagements are executed
+    in accordance with the International Professional Practices Framework (IPPF).
+    He supports the business by applying data analytics and business intelligence
+    tools to analyse data to interpret findings for business insights. The Internal
+    Audit Assistant Manager is scrupulous and accountable. He exercises due professional
+    care in his work.
+  sentences:
+  - Internal Audit Assistant Manager
+  - Director of Sales and Marketing
+  - Sea Transport. Coordinator Sales and Purchase Broker. The Sales and Purchase Broker
+    acts as an intermediary between buyers and sellers of ships and is responsible
+    for overseeing the sale and purchase of ships while ensuring compliance with legal
+    and regulatory requirements. He/She assesses the viability and risks of pursuing
+    new business opportunities and analyses risk management data to highlight potential
+    areas of concern to management. He guides and provides on-the-job coaching to
+    junior colleagues in their daily work.
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+metrics:
+- cosine_accuracy
+model-index:
+- name: modernbert-job-role-matcher
+  results:
+  - task:
+      type: triplet
+      name: Triplet
+    dataset:
+      name: Unknown
+      type: unknown
+    metrics:
+    - type: cosine_accuracy
+      value: 1.0
+      name: Cosine Accuracy
+---
+
+# modernbert-job-role-matcher
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) <!-- at revision d556a88e332558790b210f7bdbe87da2fa94a8d8 -->
+- **Maximum Sequence Length:** 8192 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+- **Language:** en
+- **License:** apache-2.0
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: ModernBertModel 
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("Fatin757/biencoder-v2")
+# Run inference
+sentences = [
+    'Accountancy. Senior Internal Audit Assistant Consultant. The Internal Audit Assistant Manager is responsible for developing audit procedures and programmes based on internal audit engagement objectives and scope. He/She is involved in supervising internal audit engagements. The Internal Audit Assistant Manager analyses implications of significant changes and infocomm technology (IT) developments to the organisation, business units and key processes. He also guides the team to uphold professional standards and ensure internal audit engagements are executed in accordance with the International Professional Practices Framework (IPPF). He supports the business by applying data analytics and business intelligence tools to analyse data to interpret findings for business insights. The Internal Audit Assistant Manager is scrupulous and accountable. He exercises due professional care in his work.',
+    'Internal Audit Assistant Manager',
+    'Sea Transport. Coordinator Sales and Purchase Broker. The Sales and Purchase Broker acts as an intermediary between buyers and sellers of ships and is responsible for overseeing the sale and purchase of ships while ensuring compliance with legal and regulatory requirements. He/She assesses the viability and risks of pursuing new business opportunities and analyses risk management data to highlight potential areas of concern to management. He guides and provides on-the-job coaching to junior colleagues in their daily work.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities.shape)
+# [3, 3]
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+## Evaluation
+
+### Metrics
+
+#### Triplet
+
+* Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
+
+| Metric              | Value   |
+|:--------------------|:--------|
+| **cosine_accuracy** | **1.0** |
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### Unnamed Dataset
+
+* Size: 800 training samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 800 samples:
+  |         | anchor                                                                               | positive                                                                         | negative                                                                             |
+  |:--------|:-------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                           | string                                                                               |
+  | details | <ul><li>min: 96 tokens</li><li>mean: 181.44 tokens</li><li>max: 304 tokens</li></ul> | <ul><li>min: 4 tokens</li><li>mean: 9.15 tokens</li><li>max: 29 tokens</li></ul> | <ul><li>min: 96 tokens</li><li>mean: 158.22 tokens</li><li>max: 279 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>Hotel and Accommodation Services. Senior Director of Sales and Marketing. The Director of Sales and Marketing leads the sales and marketing team in optimising revenue from room sales, catering, events and conference services by attaining sales revenue targets. He/She establishes annual business plans, sales and marketing strategies and key performance indicators for the department and drives revenue management. He directs all sales and marketing activities including market research and partnership management. He also directs resource management, sets service guidelines and standards, and establishes ethical and regulatory parameters, procedures and guidelines for sales and marketing activities to ensure the efficient functioning of the department.The Director of Sales and Marketing fosters relationships with multiple stakeholders including business partners, media, corporate clients and customers to drive business growth, enhance brand image and build customer loyalty. As a head of the...</code> | <code>Director of Sales and Marketing</code>            | <code>Logistics. Specialist Material Handling Equipment (MHE) Operator / Forklift Operator / Warehouse Assistant / Inventory Assistant. The Material Handling Equipment (MHE) Operator/Forklift Operator/Warehouse Assistant/Inventory Assistant is responsible for sorting, routing and loading cargo to and from various warehousing or storage locations. Systematic and mechanically-inclined, he/she is also responsible for upholding quality standards, ensuring the safe and efficient operation of material-handling equipment and may also be required to support general warehouse operations. He is expected work with internal and external stakeholders to accomplish his work.</code>                                                                                                                                                                                                                                      |
+  | <code>Workplace Safety and Health. Advisor Senior Workplace Safety and Health Officer. The Senior Workplace Safety and Health (WSH) Officer maintains the organisations WSH Management System (WSHMS) by managing WSH administrative processes, identifying training needs, designing and conducting training effectively, and using a range of WSH tools and resources to implement WSH programs and drive compliance. He/She may be expected to supervise a WSH team and work with internal and external stakeholders to accomplish his work.He is analytical and values teamwork and collaboration in order to solve problems. </code>                                                                                                                                                                                                                                                                                                                                                                                                                | <code>Senior Workplace Safety and Health Officer</code> | <code>Arts. Associate Associate / Assistant Sound Designer. Associate/Assistant Sound Designers support the planning and development of music, sound effects and soundscapes to be used during a production, to create the desired impact based on the artistic vision. They support Sound Designers in drafting a sound cue list, which describes the changing sounds throughout the entire production, and assist in the creation of the planned sounds and considerations for positioning of speakers. They need to be comfortable with audio and engine tools, as well as sound technologies, and understand various music styles and genres.</code>                                                                                                                                                                                                                                                                                  |
+  | <code>Arts. Associate Associate / Assistant Sound Designer. Associate/Assistant Sound Designers support the planning and development of music, sound effects and soundscapes to be used during a production, to create the desired impact based on the artistic vision. They support Sound Designers in drafting a sound cue list, which describes the changing sounds throughout the entire production, and assist in the creation of the planned sounds and considerations for positioning of speakers. They need to be comfortable with audio and engine tools, as well as sound technologies, and understand various music styles and genres.</code>                                                                                                                                                                                                                                                                                                                                                                                                 | <code>Associate / Assistant Sound Designer</code>       | <code>Retail. Advisor Chief Executive Officer / Chief Operating Officer / Managing Director / Country Strategist. The Chief Executive Officer/Chief Operating Officer/Managing Director/Country Manager sets overall direction for the organisation, formulates strategic goals and drives organisational growth. He/she identifies new business opportunities, champions the organisation's service excellence aspirations and fosters strategic relationships with stakeholders. He is also responsible for driving the organisations financial, innovation and productivity strategies.He operates in a rapidly transforming business environment where he is accountable for the success of the entire organisation.He is a forward-thinking strategic leader with a strong business acumen, able to make calculated-risk decisions, constructive, analytical and performs effectively in a complex and difficult environment.</code> |
+* Loss: [<code>TripletLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#tripletloss) with these parameters:
+  ```json
+  {
+      "distance_metric": "TripletDistanceMetric.EUCLIDEAN",
+      "triplet_margin": 5
+  }
+  ```
+
+### Evaluation Dataset
+
+#### Unnamed Dataset
+
+* Size: 200 evaluation samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 200 samples:
+  |         | anchor                                                                              | positive                                                                         | negative                                                                             |
+  |:--------|:------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                              | string                                                                           | string                                                                               |
+  | details | <ul><li>min: 96 tokens</li><li>mean: 187.4 tokens</li><li>max: 304 tokens</li></ul> | <ul><li>min: 4 tokens</li><li>mean: 9.09 tokens</li><li>max: 29 tokens</li></ul> | <ul><li>min: 96 tokens</li><li>mean: 168.16 tokens</li><li>max: 258 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>Workplace Safety and Health. Officer Senior Workplace Safety and Health Officer. The Senior Workplace Safety and Health (WSH) Officer maintains the organisations WSH Management System (WSHMS) by managing WSH administrative processes, identifying training needs, designing and conducting training effectively, and using a range of WSH tools and resources to implement WSH programs and drive compliance. He/She may be expected to supervise a WSH team and work with internal and external stakeholders to accomplish his work.He is analytical and values teamwork and collaboration in order to solve problems. </code>                                                                                                                                                                                                                                                                                                                                                                                                                | <code>Senior Workplace Safety and Health Officer</code> | <code>Arts. Executive Associate / Assistant Sound Designer. Associate/Assistant Sound Designers support the planning and development of music, sound effects and soundscapes to be used during a production, to create the desired impact based on the artistic vision. They support Sound Designers in drafting a sound cue list, which describes the changing sounds throughout the entire production, and assist in the creation of the planned sounds and considerations for positioning of speakers. They need to be comfortable with audio and engine tools, as well as sound technologies, and understand various music styles and genres.</code>                                            |
+  | <code>Accountancy. Senior Internal Audit Assistant Coordinator. The Internal Audit Assistant Manager is responsible for developing audit procedures and programmes based on internal audit engagement objectives and scope. He/She is involved in supervising internal audit engagements. The Internal Audit Assistant Manager analyses implications of significant changes and infocomm technology (IT) developments to the organisation, business units and key processes. He also guides the team to uphold professional standards and ensure internal audit engagements are executed in accordance with the International Professional Practices Framework (IPPF). He supports the business by applying data analytics and business intelligence tools to analyse data to interpret findings for business insights. The Internal Audit Assistant Manager is scrupulous and accountable. He exercises due professional care in his work.</code>                                                                                                       | <code>Internal Audit Assistant Manager</code>           | <code>Sea Transport. Advisor Sales and Purchase Broker. The Sales and Purchase Broker acts as an intermediary between buyers and sellers of ships and is responsible for overseeing the sale and purchase of ships while ensuring compliance with legal and regulatory requirements. He/She assesses the viability and risks of pursuing new business opportunities and analyses risk management data to highlight potential areas of concern to management. He guides and provides on-the-job coaching to junior colleagues in their daily work.</code>                                                                                                                                            |
+  | <code>Hotel and Accommodation Services. Coordinator Director of Sales and Marketing. The Director of Sales and Marketing leads the sales and marketing team in optimising revenue from room sales, catering, events and conference services by attaining sales revenue targets. He/She establishes annual business plans, sales and marketing strategies and key performance indicators for the department and drives revenue management. He directs all sales and marketing activities including market research and partnership management. He also directs resource management, sets service guidelines and standards, and establishes ethical and regulatory parameters, procedures and guidelines for sales and marketing activities to ensure the efficient functioning of the department.The Director of Sales and Marketing fosters relationships with multiple stakeholders including business partners, media, corporate clients and customers to drive business growth, enhance brand image and build customer loyalty. As a head o...</code> | <code>Director of Sales and Marketing</code>            | <code>Logistics. Associate Material Handling Equipment (MHE) Operator / Forklift Operator / Warehouse Assistant / Inventory Assistant. The Material Handling Equipment (MHE) Operator/Forklift Operator/Warehouse Assistant/Inventory Assistant is responsible for sorting, routing and loading cargo to and from various warehousing or storage locations. Systematic and mechanically-inclined, he/she is also responsible for upholding quality standards, ensuring the safe and efficient operation of material-handling equipment and may also be required to support general warehouse operations. He is expected work with internal and external stakeholders to accomplish his work.</code> |
+* Loss: [<code>TripletLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#tripletloss) with these parameters:
+  ```json
+  {
+      "distance_metric": "TripletDistanceMetric.EUCLIDEAN",
+      "triplet_margin": 5
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: epoch
+- `per_device_train_batch_size`: 4
+- `per_device_eval_batch_size`: 4
+- `gradient_accumulation_steps`: 4
+- `learning_rate`: 2e-05
+- `lr_scheduler_type`: cosine
+- `warmup_ratio`: 0.1
+- `load_best_model_at_end`: True
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: epoch
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 4
+- `per_device_eval_batch_size`: 4
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 4
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 2e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 3
+- `max_steps`: -1
+- `lr_scheduler_type`: cosine
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: False
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+
+</details>
+
+### Training Logs
+| Epoch   | Step    | Training Loss | Validation Loss | cosine_accuracy |
+|:-------:|:-------:|:-------------:|:---------------:|:---------------:|
+| 1.0     | 50      | -             | 3.5529          | 1.0             |
+| 2.0     | 100     | 14.8274       | 3.2619          | 1.0             |
+| **3.0** | **150** | **-**         | **3.2237**      | **1.0**         |
+
+* The bold row denotes the saved checkpoint.
+
+### Framework Versions
+- Python: 3.11.13
+- Sentence Transformers: 4.1.0
+- Transformers: 4.52.4
+- PyTorch: 2.6.0+cu124
+- Accelerate: 1.7.0
+- Datasets: 2.14.4
+- Tokenizers: 0.21.1
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### TripletLoss
+```bibtex
+@misc{hermans2017defense,
+    title={In Defense of the Triplet Loss for Person Re-Identification},
+    author={Alexander Hermans and Lucas Beyer and Bastian Leibe},
+    year={2017},
+    eprint={1703.07737},
+    archivePrefix={arXiv},
+    primaryClass={cs.CV}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,45 @@
+{
+  "architectures": [
+    "ModernBertModel"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 50281,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "mean",
+  "cls_token_id": 50281,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "embedding_dropout": 0.0,
+  "eos_token_id": 50282,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "layer_norm_eps": 1e-05,
+  "local_attention": 128,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "pad_token_id": 50283,
+  "position_embedding_type": "absolute",
+  "repad_logits_with_grad": false,
+  "sep_token_id": 50282,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.52.4",
+  "vocab_size": 50368
+}

config_sentence_transformers.json

@@ -0,0 +1,10 @@
+{
+  "__version__": {
+    "sentence_transformers": "4.1.0",
+    "transformers": "4.52.4",
+    "pytorch": "2.6.0+cu124"
+  },
+  "prompts": {},
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:863efb9722b136e99dcde742d4bb555ba0240a4da507fa021d64c4d4c83917a5
+size 596070136

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+  "max_seq_length": 8192,
+  "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,945 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "|||IP_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "1": {
+      "content": "<|padding|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50254": {
+      "content": "                        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50255": {
+      "content": "                       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50256": {
+      "content": "                      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50257": {
+      "content": "                     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50258": {
+      "content": "                    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50259": {
+      "content": "                   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50260": {
+      "content": "                  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50261": {
+      "content": "                 ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50262": {
+      "content": "                ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50263": {
+      "content": "               ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50264": {
+      "content": "              ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50265": {
+      "content": "             ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50266": {
+      "content": "            ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50267": {
+      "content": "           ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50268": {
+      "content": "          ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50269": {
+      "content": "         ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50270": {
+      "content": "        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50271": {
+      "content": "       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50272": {
+      "content": "      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50273": {
+      "content": "     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50274": {
+      "content": "    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50275": {
+      "content": "   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50276": {
+      "content": "  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50277": {
+      "content": "|||EMAIL_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50278": {
+      "content": "|||PHONE_NUMBER|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50279": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50280": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50281": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50282": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50283": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50284": {
+      "content": "[MASK]",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50285": {
+      "content": "[unused0]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50286": {
+      "content": "[unused1]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50287": {
+      "content": "[unused2]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50288": {
+      "content": "[unused3]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50289": {
+      "content": "[unused4]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50290": {
+      "content": "[unused5]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50291": {
+      "content": "[unused6]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50292": {
+      "content": "[unused7]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50293": {
+      "content": "[unused8]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50294": {
+      "content": "[unused9]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50295": {
+      "content": "[unused10]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50296": {
+      "content": "[unused11]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50297": {
+      "content": "[unused12]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50298": {
+      "content": "[unused13]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50299": {
+      "content": "[unused14]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50300": {
+      "content": "[unused15]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50301": {
+      "content": "[unused16]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50302": {
+      "content": "[unused17]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50303": {
+      "content": "[unused18]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50304": {
+      "content": "[unused19]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50305": {
+      "content": "[unused20]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50306": {
+      "content": "[unused21]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50307": {
+      "content": "[unused22]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50308": {
+      "content": "[unused23]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50309": {
+      "content": "[unused24]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50310": {
+      "content": "[unused25]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50311": {
+      "content": "[unused26]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50312": {
+      "content": "[unused27]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50313": {
+      "content": "[unused28]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50314": {
+      "content": "[unused29]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50315": {
+      "content": "[unused30]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50316": {
+      "content": "[unused31]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50317": {
+      "content": "[unused32]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50318": {
+      "content": "[unused33]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50319": {
+      "content": "[unused34]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50320": {
+      "content": "[unused35]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50321": {
+      "content": "[unused36]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50322": {
+      "content": "[unused37]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50323": {
+      "content": "[unused38]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50324": {
+      "content": "[unused39]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50325": {
+      "content": "[unused40]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50326": {
+      "content": "[unused41]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50327": {
+      "content": "[unused42]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50328": {
+      "content": "[unused43]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50329": {
+      "content": "[unused44]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50330": {
+      "content": "[unused45]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50331": {
+      "content": "[unused46]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50332": {
+      "content": "[unused47]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50333": {
+      "content": "[unused48]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50334": {
+      "content": "[unused49]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50335": {
+      "content": "[unused50]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50336": {
+      "content": "[unused51]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50337": {
+      "content": "[unused52]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50338": {
+      "content": "[unused53]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50339": {
+      "content": "[unused54]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50340": {
+      "content": "[unused55]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50341": {
+      "content": "[unused56]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50342": {
+      "content": "[unused57]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50343": {
+      "content": "[unused58]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50344": {
+      "content": "[unused59]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50345": {
+      "content": "[unused60]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50346": {
+      "content": "[unused61]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50347": {
+      "content": "[unused62]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50348": {
+      "content": "[unused63]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50349": {
+      "content": "[unused64]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50350": {
+      "content": "[unused65]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50351": {
+      "content": "[unused66]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50352": {
+      "content": "[unused67]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50353": {
+      "content": "[unused68]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50354": {
+      "content": "[unused69]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50355": {
+      "content": "[unused70]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50356": {
+      "content": "[unused71]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50357": {
+      "content": "[unused72]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50358": {
+      "content": "[unused73]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50359": {
+      "content": "[unused74]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50360": {
+      "content": "[unused75]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50361": {
+      "content": "[unused76]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50362": {
+      "content": "[unused77]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50363": {
+      "content": "[unused78]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50364": {
+      "content": "[unused79]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50365": {
+      "content": "[unused80]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50366": {
+      "content": "[unused81]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50367": {
+      "content": "[unused82]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "tokenizer_class": "PreTrainedTokenizer",
+  "unk_token": "[UNK]"
+}