minsolimbu/smart-job-search-model

SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for retrieval.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 256 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity
• Supported Modality: Text

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
  (1): Pooling({'embedding_dimension': 384, 'pooling_mode': 'mean', 'include_prompt': True})
  (2): Normalize({})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("minsolimbu/smart-job-search-model")
# Run inference
sentences = [
    'ACCOUNTANT Professional Summary Emerging accounting professional ready to develop career foundation with expanding operation. Dedicated to keeping records accurate and controls tight to meet all business needs. Systematic and well-organized with strong attention to detail, mathematical acumen and GAAP knowledge. Skills Microsoft Office Account Reconciliation Processes Financial statements Interpersonal, active-listening, and critical thinking skills Proficient in Polish language Data Entry Superior analytical skills General ledger proficiency Administrative support Customer service Work History Accountant , 04 2020 to Current Company Name City , State Prepares necessary adjusting journal entries and period end financial statements. Executes core financial processes, including vendor setup and payment, operational expenses, administration of bank accounts and account reconciliations. Processes journal entries and performs accounting corrections to ensure accurate records. Strengthened financial management processes to bring errors to near-zero in reporting, payroll administration and general bookkeeping. Prepares governmental reports in compliance with strict standards. Branch Service Specialist , 11 2017 to 04 2020 Company Name City , State Provided excellent customer care by responding to requests, assisting with product selection and handling ordering functions. Managed deposits, withdrawals, transfers and check cashing verified customer identification, signature and balance information processes loan payments and opened closed accounts. Ensured compliance with banking policies and audit procedures maintained and balanced cash drawers on a daily basis. Overlooked ATM balances, refilled cash as needed and ensured the system is in good working order. Assessed caller accounts to determine member benefits, identify service needs and resolve issues. Cashier , 09 2012 to 06 2017 Company Name City , State Reconciled',
    'Job Type Full-time Description Due to continuing growth, we are seeking a Tax Advisor to join our team. The Tax Advisor is a key part of our team you will be a part of tax preparation, compliance, and advising clients on tax planning. Building long-lasting client relationships is our goal by providing the highest level of service and oversight to the people we work for. Our teams are collaborative and friendly, and we offer a great work life balance. Who we are Platform Accounting Group is a rapidly growing professional services firm providing tax, accounting, assurance, IT consulting, and wealth management services to small and medium sized businesses and their owners. We currently have 28 offices in 11 States with much more growth on the horizon. We fully understand that every employee has different needs, so our unique business model allows for more flexible work arrangements than most firms can offer. Enjoy a professional and dynamic work environment while making work life balance a priority. What you will do Prepare individual and business c-corps, s-corps, partnerships tax returns. Develop your skills and knowledge to increase complexity and types of returns completedBuild, maintain and enhance client relationships and demonstrate knowledge of each client s business and financesProvide or assist with accounting services including bookkeeping, payroll, sales tax, etc. Identify, research, and resolve tax issues What we look for 0-3 year of experience preparing a variety of tax returnsUnderstanding of practices, theories, and policies related to taxes and accountingBachelor s Degree Required, Master s Degree PreferredEA or CPA',
    'Aya Locums has an immediate opening for a 13-week locum Emergency Medicine Physician job in Chattanooga, TN paying 225 hr - 250 hr. Job Responsibilities Assess patients, document medical histories and address patient inquiries and concerns.Diagnose and manage injuries, illnesses and medical conditions.Conduct, analyze and interpret diagnostic tests and communicate results to patients.Keep patient records current by updating information and treatments.Develop treatment plans and recommendations.Collaborate with other healthcare professionals to coordinate patient care.Stay up to date with advances in medicine and best practices. Qualifications An active and unencumbered physician license in the state of employment if a new license is needed for your assignment, Aya Locums can help .Board certification or eligibility for certification in a specialty relevant to the role highly preferred .Basic Life Support BLS and Advanced Cardiac Life Support ACLS certification. Skills Experienced in diagnostic and clinical decision-making.Effectively communicates with others.Ability to work independently and in a team setting.Commitment to providing compassionate, patient-centered care.Familiarity with electronic medical record systems and technology. Working Hours 5, 12-Hour 07 00 - 19 00 Education Requirements A Bachelor of Science BS degree in a relevant field.A Doctor of Medicine M.D. or Doctor of Osteopathic Medicine D.O. degree.Completed residency program in your chosen specialty.Continuing medical education CME activities to maintain medical licenses. With Aya Locums, You Get Access to top hospitals and healthcare systems in diverse care settings.Highly competitive, transparent locum tenens pay.Dedicated application and assignment support.In-house credentialing and licensing teams.Travel and lodging coverage.Easy timekeeping and streamlined management of documents.Malpractice coverage and risk management support.Aya may provide other',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.9555, 0.5520],
#         [0.9555, 1.0000, 0.4165],
#         [0.5520, 0.4165, 1.0000]])

Evaluation

Metrics

Semantic Similarity

• Dataset: resume-job-validation
• Evaluated with EmbeddingSimilarityEvaluator

Metric	Value
pearson_cosine	0.7952
spearman_cosine	0.7778

Training Details

Training Dataset

Unnamed Dataset

• Size: 43,993 training samples
• Columns: sentence_0, sentence_1, and label
• Approximate statistics based on the first 100 samples:

  	sentence_0	sentence_1	label
  type	string	string	float
  modality	text	text
  details	min: 191 tokens mean: 254.9 tokens max: 256 tokens	min: 4 tokens mean: 243.83 tokens max: 256 tokens	min: 0.0 mean: 0.5 max: 1.0

• Samples:

  sentence_0	sentence_1	label
  HR MANAGER BUSINESS PARTNER Summary A Human Resources Business Partner with extensive experience aligning HR strategy with business strategy for assigned business groups. Employee Relations Coaching Mentoring Talent Acquisition Salary Planning Organizational Design Workforce Planning Talent Management Succession Planning Change Management Development Highlights Lominger Korn Ferry Certifications Talking Talent, Succession Architect, Voices 360 and Leadership Architect HRIS Workday, PeopleSoft, Oracle, HR Workways Taleo Excellent Written and Verbal Communication Skills Self-motivated, detail oriented, organized, customer focused Maintains high level of confidentiality Proficient with MS Word, Excel, PowerPoint, Outlook Performance management strategies Employment law knowledge Employee relations Manager coaching and training HRIS applications proficient Talent management Employee Relations Coaching Talent Acquisition Workforce planning Experience HR Manager Business Partner January 2000...	Here are the job details for your review Job Title Graphics Art Design Operator 4Job Location 511 Benedict Ave, Tarrytown, NY 10591Pay Rate 36 HR on W2 Duration 12 Months Possibility of extension Client Name Siemens Position SummaryManages graphic projects from beginning design stages through to final production.Project leader for graphics labeling related projects including project management, development of new, and modification of, current packaging graphics for Product Labeling Specific Job Duties Complete project management of labeling projects submitted from project assignment through component release including graphic development, artwork approvals, translations, artwork submission through the Documentum system and print supplier proof approvals.Liaises with print production experts internally and externally, such as Engineering for in-house printing and external print suppliers.Maintain artwork files, including digital files and artwork archives.Manage artwork approval process...	1.0
  BUSINESS DEVELOPMENT REPRESENTATIVE Professional Summary Experienced administrative professional with excellent client and project management skills. Action-oriented with strong ability to communicate effectively with technology, executive, and business audiences. Core Qualifications Computer proficient Reports generation and analysis Client Relations File records maintenance Multi-Task Management Territory Sales Experience Purchase Order Processing Creative Problem Solving Experience Business Development Representative November 2014 to Current Company Name City , State Identified prospective customers using lead generating methods and obtained leads through cold calls. Managed organization s South Texas and West Texas region and performed full sales cycle duties, therefore increasing division profits. Quoted prices for services outlined in brochure. Maintained friendly and professional customer interactions. Consistently met and exceeded divisional expectations for productivity and ac...	Location Cayce, SC, US, 29172 29172 Job Type Administrative 29172 Aspire Bakeries is a North American baking company with a leadership position in specialty frozen baked goods. Formed from leading bakery companies, its innovative food portfolio includes breads, artisan breads, buns, cookies, donuts, muffins and pastries from beloved brands like La Brea Bakery , Otis Spunkmeyer , and Oakrun Farm Bakery . With 14 bakeries in North America, we are committed to driving innovation, predicting upcoming consumer trends and flavors, and exceeding our customers expectations. Aspire Bakeries champions the values of Integrity, Ownership, Customer Focus, Creativity and Care to help us deliver on People Safety, Food Safety, Quality and Collaboration. Responsibilities Liaison between Warehouse operators on inventory-related issues.Systematically physically returns WIP to freezer locationMonitor and track all material movements to ensure inventory accuraciesPerform daily physical inventory cycle coun...	0.0
  IT SUPPORT OFFICER Executive Profile Seeking assignments in Hardware Network Servers Technical Support with an organization to deliver results by leveraging strong exposure in IT Operations. Cisco certified Network Associates with nearly 6 year 3 months of experience in Site Networking Operations, Installation, Configuration, Technical Support Troubleshooting, Incident Management as well as Client Servicing. Server 2k3, 2k8 Ubuntu server configuration, Network Configuration, implementation of DHCP Server, File server, DNS server and Network Monitoring tools. An effective communicator with excellent skills in building relationships Possess, strong analytical, problem solving and organizational abilities. Assembling and disassembling PC, motherboard, hard disk drives, and working with local and network printer, configure cable UTP,STP, coaxial Key Highlights Manage the data server and data security. Successfully performed configuration of NAS Server, AD Server, Child Domain, Cisco Router...	We are seeking a dedicated Customer Experience Representative to provide exceptional service to customers. This is a permanent, onsite opportunity with an outstanding Oklahoma City employer Great benefits and a stable work environment Responsibilities Assist customer with product selection, availability inquiries, and order entry tracking.Address customer concerns promptly and professionally.Communicate effectively with customer via phone and email.Act as a customer advocate within the organization, conveying customer feedback and insights to relevant departs to drive continuous improvement in products and services.Build and maintain strong relationships with customers by demonstrating a genuine desire to help.Accurately document customer interactions to track and ensure follow- up as needed. Qualifications Previous experience in customer service or account management This is not a sales role .Excellent communication skills.Ability to multi-task in a fast-paced environment.Strong compu...	0.5

• Loss: CosineSimilarityLoss with these parameters:

  {
      "loss_fct": "torch.nn.modules.loss.MSELoss",
      "cos_score_transformation": "torch.nn.modules.linear.Identity"
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 32
• num_train_epochs: 20
• per_device_eval_batch_size: 32
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand

• per_device_train_batch_size: 32
• num_train_epochs: 20
• max_steps: -1
• learning_rate: 5e-05
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_steps: 0
• optim: adamw_torch_fused
• optim_args: None
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• optim_target_modules: None
• gradient_accumulation_steps: 1
• average_tokens_across_devices: True
• max_grad_norm: 1
• label_smoothing_factor: 0.0
• bf16: False
• fp16: False
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• use_liger_kernel: False
• liger_kernel_config: None
• use_cache: False
• neftune_noise_alpha: None
• torch_empty_cache_steps: None
• auto_find_batch_size: False
• log_on_each_node: True
• logging_nan_inf_filter: True
• include_num_input_tokens_seen: no
• log_level: passive
• log_level_replica: warning
• disable_tqdm: False
• project: huggingface
• trackio_space_id: None
• trackio_bucket_id: None
• trackio_static_space_id: None
• per_device_eval_batch_size: 32
• prediction_loss_only: True
• eval_on_start: False
• eval_do_concat_batches: True
• eval_use_gather_object: False
• eval_accumulation_steps: None
• include_for_metrics: []
• batch_eval_metrics: False
• save_only_model: False
• save_on_each_node: False
• enable_jit_checkpoint: False
• push_to_hub: False
• hub_private_repo: None
• hub_model_id: None
• hub_strategy: every_save
• hub_always_push: False
• hub_revision: None
• load_best_model_at_end: False
• ignore_data_skip: False
• restore_callback_states_from_checkpoint: False
• full_determinism: False
• seed: 42
• data_seed: None
• use_cpu: False
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• dataloader_prefetch_factor: None
• remove_unused_columns: True
• label_names: None
• train_sampling_strategy: random
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• ddp_static_graph: None
• ddp_backend: None
• ddp_timeout: 1800
• fsdp: None
• fsdp_config: None
• deepspeed: None
• debug: []
• skip_memory_metrics: True
• do_predict: False
• resume_from_checkpoint: None
• warmup_ratio: None
• local_rank: -1
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: round_robin
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss	resume-job-validation_spearman_cosine
0.3636	500	0.1739	-
0.4996	687	-	0.3990
0.7273	1000	0.1503	-
0.9993	1374	-	0.5211
1.0	1375	-	0.5210
1.0909	1500	0.1339	-
1.4545	2000	0.1257	-
1.4989	2061	-	0.5632
1.8182	2500	0.1188	-
1.9985	2748	-	0.6092
2.0	2750	-	0.6088
2.1818	3000	0.1084	-
2.4982	3435	-	0.6405
2.5455	3500	0.1030	-
2.9091	4000	0.0985	-
2.9978	4122	-	0.6587
3.0	4125	-	0.6571
3.2727	4500	0.0874	-
3.4975	4809	-	0.6886
3.6364	5000	0.0840	-
3.9971	5496	-	0.7051
4.0	5500	0.0832	0.7058
4.3636	6000	0.0705	-
4.4967	6183	-	0.7089
4.7273	6500	0.0701	-
4.9964	6870	-	0.7218
5.0	6875	-	0.7219
5.0909	7000	0.0690	-
5.4545	7500	0.0613	-
5.496	7557	-	0.7251
5.8182	8000	0.0591	-
5.9956	8244	-	0.7387
6.0	8250	-	0.7399
6.1818	8500	0.0554	-
6.4953	8931	-	0.7470
6.5455	9000	0.0527	-
6.9091	9500	0.0524	-
6.9949	9618	-	0.7450
7.0	9625	-	0.7433
7.2727	10000	0.0476	-
7.4945	10305	-	0.7421
7.6364	10500	0.0455	-
7.9942	10992	-	0.7492
8.0	11000	0.0457	0.7521
8.3636	11500	0.0400	-
8.4938	11679	-	0.7530
8.7273	12000	0.0400	-
8.9935	12366	-	0.7582
9.0	12375	-	0.7598
9.0909	12500	0.0372	-
9.4545	13000	0.0348	-
9.4931	13053	-	0.7657
9.8182	13500	0.0360	-
9.9927	13740	-	0.7615
10.0	13750	-	0.7610
10.1818	14000	0.0323	-
10.4924	14427	-	0.7601
10.5455	14500	0.0316	-
10.9091	15000	0.0320	-
10.992	15114	-	0.7711
11.0	15125	-	0.7691
11.2727	15500	0.0285	-
11.4916	15801	-	0.7685
11.6364	16000	0.0288	-
11.9913	16488	-	0.7670
12.0	16500	0.0279	0.7687
12.3636	17000	0.0246	-
12.4909	17175	-	0.7705
12.7273	17500	0.0262	-
12.9905	17862	-	0.7745
13.0	17875	-	0.7739
13.0909	18000	0.0250	-
13.4545	18500	0.0233	-
13.4902	18549	-	0.7725
13.8182	19000	0.0228	-
13.9898	19236	-	0.7723
14.0	19250	-	0.7714
14.1818	19500	0.0223	-
14.4895	19923	-	0.7722
14.5455	20000	0.0216	-
14.9091	20500	0.0216	-
14.9891	20610	-	0.7736
15.0	20625	-	0.7756
15.2727	21000	0.0202	-
15.4887	21297	-	0.7756
15.6364	21500	0.0192	-
15.9884	21984	-	0.7778

Training Time

• Training: 1.4 hours

Framework Versions

• Python: 3.11.15
• Sentence Transformers: 5.6.1
• Transformers: 5.14.1
• PyTorch: 2.12.0.dev20260408+cu128
• Accelerate: 1.14.0
• Datasets: 5.0.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}