Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Paper • 1908.10084 • Published • 15
How to use SWARALI12/careerwise-minilm-v2 with sentence-transformers:
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("SWARALI12/careerwise-minilm-v2")
sentences = [
"Specialist / Senior Specialist - Mumbai, India (Contract)\nWe are seeking a Specialist / Senior Specialist with hands-on experience in customer, service, processed, company to join our team.\nResponsibilities:\n- Collaborate with cross-functional teams to company.\n- Lead end-to-end service, ensuring quality and timely delivery.\n- Design, implement, and maintain service.\nRequirements:\n- Bachelor's degree in a related field or equivalent experience.\n- 5+ years of relevant experience in similar roles.\n- Proficiency with customer, service, processed, company.\n- Strong problem-solving and communication skills.",
"REGIONAL IT MANAGER Professional Summary Exceptional IT Manager talented at personnel management, vendor management and business strategy development. Technically-savvy with outstanding relationship building, training and presentation skills. Languages spoken: English, Conversational Chinese Skills Team leadership Budgeting and finance Project management Process implementation Staff development Data management Self-motivated Strong verbal communication Powerful negotiator Conflict resolution Risk management processes and analysis Work History 09/2012 to Current Regional IT Manager Company Name – City , State Acted as project manager for $10mn New York office move and serves on advisory board for all international office moves . Direct the after-hours (12p.m.EDT) delivery of first, second, and third-level technical support end users across 14 office facilities and locations, including 500+ lawyers and 500+ staff members. Ensure prompt and courteous technical support. Manage, train and review support staff team members. Developed SMART objectives and KPI's to continually motivate staff. Review help desk metrics with help desk manager to ensure tickets are addressed according to SLA. Identify recurring issues to address with global software and applications manager. Work with cross-functional technology committee to create policies that accurately reflect current and future technology trends. Work with international trainers to oversee local training requests. Draft and distribute local and after-hours call metrics to the Director of Information Technology. Purchase and budget all hardware and software for the New York office. Lead document production (8ppl), local help desk (2ppl), global after-hours help desk (5ppl), local AV/ office services staff (3ppl). Ensure high availability of systems and applications across the organization. Serves as last point of escalation when manager on duty. Develop, review, and maintain local infrastructure policies and procedures: Advise on global procedures through technology committee. Develop, review, and enforce service level agreements for help desk manager and lead. Determine metrics, define measurables, and present data to executives on performance of department. Liaise with global team to develop and implement business process improvement for policies that address security policies relating to GDPR compliance and local compliance measures. Designed and implemented a knowledgebase tool for use by IT colleagues and end users in order to accurately diagnose technical issues. Coordinated global resources and training for offices during Lotus Notes to Outlook and Windows 7 to Windows 8 rollout. Increased first call resolution from 85% to 98% through help desk training and cross functional training. Supports Director of Technology with daily operational functions. Assisted various business groups with document organization and dissemination during acquisitions. 06/2007 to 09/2011 Technical Support Analyst Company Name – City , State Collaborated with the sales, marketing and support teams to launch products on time and within budget. Maintained and monitored the server room, the wireless network and other server infrastructure. Set up staff workstations with PCs, Macs, phones and laptops. Partnered with the marketing team to leverage technology into customer value propositions to be used during marketing events. Created new hire IT training curriculum. Acted as technology liaison between technology department and global recruiting division. Tested and implemented new technology-based global projects such as Nuance PDFCreate. Delivered on-site IT and AV technical support for 300+ staff in local and regional offices. 03/2007 to 06/2007 Desktop Support Technician Company Name – City , State Hands on roll in Domestic and International OS migration from WinXP to Win7. Worked with engineering and applications staff to resolve any problems related to the upgrade until functional. Key responsibility to support all users from C-Level firm chairman through contract services by troubleshooting and resolving all problems relative to the Mac, Macbook, PC and related equipment. Install Mac and PC OS, configure network settings to integrate with the firm's network, troubleshoot issues locally to provide support for a mainly virtual Citrix desktop. Work with various interdepartmental groups to resolve in depth issues regarding security and accounts. Install and configure hardware and software as it",
"ASSOCIATE TEACHER Accomplishments Bachelor of Science in Management and Business The Marshall Award 2007 The Barbara Hume Memorial Award 2011 Coach's Award 2007 The Rev. B.W. \"Pete\" Woodward, Jr. Prize 2010 Coached Hunter Forward, Kristen Markoe, CUNYAC Player of the Year Experience Company Name January 2014 to January 2015 Associate Teacher City , State aintain safe classroom setting while fostering a positive and engaging learning environment M * a g Develop daily lesson plans for 5 nd 6 rade Reason and Rhetoric th th Teach students weekly vocabulary words and writing techniques using nonfiction articles Led and guide students in classroom discussions Lead cocurricular programs such as: recess, lunch, and study hall Closely monitor the academic and social lives of seventh grade boys Company Name January 2012 to January 2014 Head Coach, Girls' Varsity Basketball City , State anage recruitment and enrollment of prospective students from the New England area, New York, Montreal, New Jersey, M Philadelphia, Maryland, Chicago, Virginia, and Florida Develop contacts with feeder schools, sports programs, coaches, and educational consultants Act as the athletic liaison for the admission office Attend regional and national admission events to attract prospective students and families Coordinate and manage daily tour guides for prospective families and arrange for coaches to meet prospective students Interview and evaluate prospective students for admission Assist in the planning and execution of Holderness School's Fall Open House and Spring Second Visits for over 100 accepted students Help manage the Holderness Social Media websites (i.e. Facebook, Twitter, YouTube) Assisted in the development and implementation of the strategic plan to increase the number of applicants on a 1 year, 3 year, and 5 year span Developed strategies to attract mission appropriate students Collected the documents required necessary to make a decision on applicants Assisted in the admission publication Assisted in increasing full pay boarding students (15%), female applicants (18%), freshman applicants (20%), and domestic diversity (15%) anaged all aspects of the Girls' Basketball program, competing in the Lakes Region league and (NEPSAC) New England Prep School M Athletic Council. Attended regional and national AAU tournaments to identify, evaluate, and recruit studentathletes (such as: Deep South Classic, Commotion by the Ocean, Gym Rats, etc.) Coordinated daily practice plans to enhance successful learning and performance outcomes for both varsity and junior varsity teams Invited and scheduled scrimmage games among AAU programs in order to increase the school's awareness athletically Developed scouting reports and game plan of the opposition for studentathletes in order to create successful results Collaborated with Strength and Conditioning coach to develop a health and wellness program Performed end of the season evaluations with coaches and players Assisted student athletes and the college counseling office in the college recruitment process Coached Skidmore Forward Migle Vilunate, a member of the Liberty League AllRookie team Organized endoftheyear team dinner and individual awards Provided individual skill development program during the season and Postseason Coordinated travel to and from opposing schools for both teams Collaborated with Athletic Director to manage the team's budget and fundraising initiatives * ember of the Women's Basketball Coaches Association (WBCA) M Company Name January 2011 to January 2012 Student Assistant Coach, Men's Basketball City , State Conducted comprehensive on and off campus recruiting; attended regional tournaments/camp Attended games and review film of opponent's games; develop scouting reports and recommendations Assisted in development of daily practice plans to enhance successful learning and performance outcomes Supervised student manager and practice players Instructed guard play, creating performance drills and individualized instruction * anaged exchange of game film for nonconference and conference opponents M * anaged academic progress of studentathletes, as assigned by head coach M * anaged outreach to constituents (parents, fans, coaches, alumni, etc.) M Assisted in coordination of team travel arrangements, housing, and meals for studentathletes Coordinated community service activities between the studentathletes and local community Coached three AllLeague players and one AllRoo",
"COSTUMER SERVICES Summary Costumer representative with background as sandwich artist and security looking to join a growing entrepreneurial organization as part of the Executive team. Skills Operations management Financial records and processing Quick learner Client-focused Computer proficient Active listening skills Telephone inquiries specialist Cash handling accuracy Superior communication skills Top sales performer Customer service expert Strong communication skills Superior organization skills Store maintenance ability Energetic work attitude Adaptive team player Cheerful and energetic Telecommunication skills Experience Costumer Services , 02/2018 to Current Company Name - City , State Answered customer questions and took orders. Assisted customers with finding solutions to their complaints, concerns and inquiries. Recommended, selected and helped locate merchandise based on customer needs and desires. Collaborated with customer service team members to give exceptional service throughout the entire shopping and purchasing experience. Built customer confidence by actively listening to their concerns and giving appropriate feedback. Extended customer subscriptions, offering discounts and promotions to ensure high customer retention rates. Confirmed that appropriate changes were made to resolve customers' problems. Sandwich Artist , 01/2017 to 02/2018 Company Name - City , State Executed all daily tasks and assisted other team members when needed. Prepared food items, including sandwiches and other products to meet customer specifications. Assisted customers, including answering questions and preparing orders. Organized food preparation stations and replenished supplies as needed. Delivered superior customer service focused on quality and meeting customer needs in a timely manner. Cleaned and maintained all food preparation stations. Trained Sandwich Artists to apply attention to detail and commitment to quality. Communicated with customer to provide menu offering details and assist with decision-making. Proofed dough products and baked breads, cookies and other bakery products. Handled and bagged groceries carefully and according to customer preference. Stocked, priced, front-faced and rotated merchandise. Monitored the freshness and condition of prepared foods. Routinely cleaned table linens, table settings, glassware, windowsills, carpets, counters, floors, storage areas and service refrigerators. Security Guard , 05/2015 to 01/2016 Company Name - City , State Maintained order, responded to emergencies and enforced federal and local laws. Communicated with supervisors regarding any issues that occurred while on duty. Immediately reported fires, accidents and other safety hazards. Enforced all building rules and regulations in government facilities. Protected federal employees and their property by monitoring all access to government-owned and leased properties. Detained individuals when necessary to prevent security breaches. Patrolled the premises regularly to ensure safety of employees and visitors. Patrolled buildings, facilities and perimeter areas to prevent damage to property. Florist helper / Delivery driver , 02/2011 to 03/2011 Company Name - City , State Communicated information to customers about product quality, value and style. Consulted with customers on the latest styles and trends. Communicated merchandise needs and issues to appropriate supervisors in a timely fashion. Kept the showroom clean and maintained neat, orderly product displays. Interacted with customers and retail buyers to follow-up on shipping statuses and expedited orders. Worked as a team member performing cashier duties, product assistance and cleaning. Stocked and rotated inventory regularly. Resolved customer complaints and adjusted orders. Selected the most efficient routes in compliance with delivery instructions and fuel policy. Inspected and maintained gas, oil and water levels as well as tires, lights and brakes. Loaded and unloaded merchandise at stores and vendor locations. Processed payments by accepting cash, checks and credit card payments. Served as the company's only bilingual Spanish/English customer service representative. Seasonal Field Worker , 05/2006 to 08/2006 Company Name - City , State Seasonal migrant worker that would return every summer till 2012 Mowed and edged lawns and flowerbeds using shovel and hula hoe. Operated motorized vehicles and equipment such as tractors, and traiers . Mixed and sprayed fert"
]
embeddings = model.encode(sentences)
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
SentenceTransformer(
(0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'BertModel'})
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
"HR Generalist / Senior HR - Remote (Contract)\nWe are seeking a HR Generalist / Senior HR with hands-on experience in company, employee, state, new to join our team.\nResponsibilities:\n- Manage projects related to first.\n- Analyze new and provide actionable insights.\n- Lead end-to-end coordinator, ensuring quality and timely delivery.\nRequirements:\n- Bachelor's degree in a related field or equivalent experience.\n- 3+ years of relevant experience in similar roles.\n- Proficiency with company, employee, state, new.\n- Strong problem-solving and communication skills.",
"HR COORDINATOR Professional Summary Highly efficient Hr Coordinator well established in administrative environments that are fast-paced and challenging. Core Qualifications Exceptional interpersonal skills Innovative Microsoft Office Suite expert Human resources audits Maintains confidentiality Personnel records maintenance New hire orientation Applicant Tracking System EEO Reporting HRMS People-oriented Organized Exceptional communicator Recruiting Experience HR Coordinator , 09/2012 - Current Company Name - City , State ?Responsible for initiating, tracking and follow up of background checks and drug tests. ? First day on-board for new employee - first day documents, I-9 and tour of the building. ? Conducts exit interviews - relays info back to management. ? Routes positions for approval and posts requisitions to the company careers page and to outside job boards. ? Recruits for warehouse, driver and entry level to mid level positions using Kenexa BrassRing and sourcing resumes from online jobsites/databases. ? Run applicant flow logs from applicant tracking system, putting data into AA-EEO spreadsheet. ? Attends college career fairs to recruit potential interns and fill other positions as necessary. ? Initiates and leads Best Practices initiatives. ? Administrator for employee performance review program tool (Access database). ? Responsible for reviewing manager's submissions of employee performance reviews to ensure proper content and giving feedback to the manager. ? Maintains associate personnel files from filing and retention. ? Vouches department bills for payment. ? Other administrative duties as assigned. HR Coordinator , 06/2012 - 09/2012 Company Name - City , State Assignment at Edward Don & Company, temp to hire. HR Coordinator , 08/2008 - 09/2011 Company Name - City , State ?Scheduled background checks and drug screens for candidates. ? Compiled and processed expense reports for candidates. ? Communicated with the Hiring Manager about the new hire's first day. ? Administered the new hire associate experience by scheduling their first day's HR session. These sessions included reviewing company policies, completing I-9 through E-verify, dispensed WOTC survey, explain direct deposit, encouraged self-identification (EEO) and demonstrated the company portal. ? Designed and prepared printed HR materials for new hires. ? Point person for SOX compliance for the HR Department. ? SAP Administration: ran requested reports, created requested reports and entered employee information. ? Planned and managed internal corporate events. Events included: Take Your Child to Work Day, Wellness Fairs, fund raisers, blood drives, lunch and learns and employee service recognition breakfasts. ? Edited and updated the HR Department's page on the portal using SharePoint software. ? Trained in CPR and first aid. ? Responded to injured associates and dispensed employee injury statement to injured associate. Receptionist , 02/2003 - 03/2008 Company Name - City , State Internship program Recruiter Lead for college students. ? Collaborated with company President to decide what criteria would deem student eligibility for intern program. ? Posted employment positions to the company website. ? Sourced and screened qualified candidates. ? Passed on qualified candidates to Hiring Managers. ? Tracked candidates in Excel program. ? In charge of all company State and Federal poster requirements for multiple locations including out of state locations. ? The go-to person for general company knowledge and administrative support. ? Managed a six line phone system of incoming calls. ? Updated company phone and employee directory on the portal. Education 2008 DePaul University - City , State BA Human Resources Professional Affiliations Membership: Society for Human Resources (SHRM) Membership established in 2007 Technical Skills and Qualifications Microsoft Sharepoint, SAP, Sharepoint, Excel, Groupwise, Incoming Calls, Ms Office, Ms Outlook, Outlook, Phone System, Receptionist, Recruiter, Sterling Inforsystems, Orange Tree Employment Services, Kenexa - IBM Products, Ultipro, New Hires, Sarbanes-Oxley (SOX), Scheduling, Access, Applicant Tracking System, Best Practices, Database, Databases, Employee Performance, Entry Level, Filing, Leads, Performance Review",
'QA ENGINEERING MANAGER Professional Summary Seasoned Engineering Manager with ability to build and motivate high-performing engineering team with over 14+ years of experience in cards and payments industry, committed to rapidly and efficiently completing projects by leveraging team-based frameworks to best leverage available engineering talent. Self-motivated, forward thinking mindset, solution-focused, clear communicator, decision maker and problem solver. Skills QA Engineering software expertise - Design, Estimate, Execute, Maintain and Document. Technical communication skills - Bug Triage, reporting, technical reviews, Root cause analysis Automation tools - Design and Implement Collaborating with stakeholders - Roadmap, Managing releases, Demos, Risk mitigation planning, Organization and Time management - resource planning Leadership - Strategic Planning, Team building, Conflict resolution, Training & Development, mentoring Behavioral skills - Forward-thinking mindset, Detail-oriented, Multitasking abilities, Flexible & Adaptable Work History QA Engineering Manager , 01/2016 to Current Company Name – City , State 20+ EMV certs in calendar year with team of 2+ cert Analysts. Managed fast paced project delivery from QA for time sensitive and key projects for company. Collis tool (BTT) automation using Python to reduce EMV test cases execution time to 1 week for all brands, thus completing any EMV certification within 3 months. Design test automation using Katalon to for improved regression test coverage and reduce time to complete release cycles to less than 1 week. Managed and Implemented spreadsheet based automation, that helped in improved test coverage and reduced production bug by 20% and rollbacks by 80%. Performed resource and project trade off analysis to meet roadmap schedule, product life-cycle (PLC)/Software Dev Life-cycle (SDLC) and QA requirements, resulting in development of best practice models. Reviewed project goals and objectives on monthly basis with project manager and design team. Used critical thinking to break down problems, evaluate solutions and make decisions. Managed team of 8 employees, overseeing hiring, training, and professional growth of employees. 4 promotions within team including 1 lead and 1 manager. Software Certification Analyst , 04/2015 to 01/2016 Company Name – City , State Instrumental in procuring 1st EMV certification within 6 months of joining. Reduced overall EMV certification timeline from 1+ year to Automation of EMV Certification and Transaction link application using spreadsheet based input. Established myself as go to person for any QA issue within QA and Merchant Implementations team. Created common test/tool strategy to supplement automation for regression and functional testing; reduced time to market. Instrumental in doing POC on different test management tools (zypher, Jira, QA complete) to identify best suited for company needs(Jira). Project Lead , 09/2005 to 04/2015 Company Name – City , State Received core value awards - “SYNERGY” in 2009 for team building and “SMART” in 2012 for Individual performances. Nominated for BRAVO award in First Data (2012 and 2014). Automation improvement using PERL scripting. Established involvement of frontend application into Change release management and helped to identify key issues during backend testing. 3 times achiever of “0” issues in support queue as offshore lead. Planned, executed and promoted total of 10+ releases in calendar year. Produced quality standards, checklists, report templates and processes for same. Developed and trained junior team members by leveraging industry experience to achieve optimal project strategy. Education Master of Computer Applications (MCA) : Computer Applications, Software Engineering, Databases, Networking, and Operating Systems , 2005 Devi Ahilya University Bachelors of Science : Electronics , 2002 Devi Ahilya University - City Micro-processors, Databases, Networking, and Operating Systems Certifications Certified Scrum Master (CSM) – Certificate code: 1221056, Expires May 2022 Certified Tester Foundation Level (CTFL) - Certificate code: 17-CTFL-02141-USA No Expiry Agile Scrum Foundation - Certificate code: 2146592, No Expiry Using Python for Automation – LinkedIn, No Expiry Python: XML, JSON, and the Web – LinkedIn, No Expiry SQL for Testers – LinkedIn, No Expiry Technical Skills · Test Methodologies: Regression Testing, Black box testing, Sanity testing, boundary analysis, requireme',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.9409, 0.2353],
# [0.9409, 1.0000, 0.1988],
# [0.2353, 0.1988, 1.0000]])
sentence_0, sentence_1, and label| sentence_0 | sentence_1 | label | |
|---|---|---|---|
| type | string | string | float |
| details |
|
|
|
| sentence_0 | sentence_1 | label |
|---|---|---|
Associate Lawyer - Remote (Contract) |
ADVOCATE Summary In-depth knowledge of taking orders, compute charges, and administer billing or payments. * Hands-on experience in reviewing, updating or making changes to customer accounts. * Track record of listening and responding to customers' needs and concerns. * Able to handle returns and complaints effectively. * Demonstrated ability to record details of client contacts and service history. * Proven ability to determine answers and solutions quickly. * Special talent for handling irate and angry customers. * Proven written and oral communication skills * Proficient in managing business correspondence * Ability to organize personal work priorities * Knowledge of filing and updating records * Ability to work independently and as part of a team * Excellent organizational skills * Expert in handling office equipment * Internet savvy with a proven expertise in using MS Office applications * Excellent customer service orientation * Special talent for researching and analyzing data e... |
0.75 |
Kitchen Manager - Hyderabad, India (Full-time) |
STAFFING MANAGER Professional Summary s well to change and possesses extensive expert knowledge of human resources employment process within a variety of industries. [Job Title] focused on improving productivity, increasing efficiency and enhancing quality. Consistently exceeds goals for staffing and retention. Human Resources Recruiter accomplished in sourcing, screening, qualifying and closing candidates, as well as coordinating interviews and follow up. Skills Good judgment Human resources policies Job fairs planning Workforce planning Pre-screening candidates Time management Sales techniques Safety training Pre-screening candidates Employment laws and practices Work History 06/2014 to Current Staffing Manager Company Name – City , State Top performer in top quartile of expectations; Recognized for setting branch record for placements hours in first quarter; Recruited high number of new companies and candidates Recaptured previous companies business Expanded existing client relation... |
0.25 |
Professional - Delhi, India (Permanent) |
ENGINEERING OFFICER Objective Looking for opportunities to work in an research environment for creating solutions using digital systems at circuit as well as system level. Education Master of Science : Electrical Engineering 2017 North Carolina State University City , State , USA Bachelor of Engineering : Instrumentation and Control Engineering 2013 Netaji Subhas Institute Of Technology City , State , India Majored with 78.34 %, First Class With Distinction Academic Merit Award 2011-12 and 2012-13 Experience Engineering Officer 07/2014 to 06/2015 Company Name City , State Spearheaded a team of electricians and technicians to carry out preventive maintenance of equipment of LPG bottling plant. Role also entailed procurement of spares and materials and maintain inventory at plant. Major tasks involved: Maintenance and calibration of equipment such as cylinder gas leak detectors, washer leak detectors, gas analyzers etc. Upkeep of electrical panels and control systems. Maintenance of driv... |
0.75 |
CosineSimilarityLoss with these parameters:{
"loss_fct": "torch.nn.modules.loss.MSELoss"
}
num_train_epochs: 8multi_dataset_batch_sampler: round_robinoverwrite_output_dir: Falsedo_predict: Falseeval_strategy: noprediction_loss_only: Trueper_device_train_batch_size: 8per_device_eval_batch_size: 8per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 1eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 5e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1num_train_epochs: 8max_steps: -1lr_scheduler_type: linearlr_scheduler_kwargs: {}warmup_ratio: 0.0warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falsebf16: Falsefp16: Falsefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonelocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Falseignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}parallelism_config: Nonedeepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torchoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthproject: huggingfacetrackio_space_id: trackioddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Nonehub_always_push: Falsehub_revision: Nonegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseinclude_for_metrics: []eval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters: auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: noneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseliger_kernel_config: Noneeval_use_gather_object: Falseaverage_tokens_across_devices: Trueprompts: Nonebatch_sampler: batch_samplermulti_dataset_batch_sampler: round_robinrouter_mapping: {}learning_rate_mapping: {}| Epoch | Step | Training Loss |
|---|---|---|
| 1.9841 | 500 | 0.0404 |
| 3.9683 | 1000 | 0.0235 |
| 5.9524 | 1500 | 0.0164 |
| 7.9365 | 2000 | 0.0126 |
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
Base model
nreimers/MiniLM-L6-H384-uncased