Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Paper • 1908.10084 • Published • 17
How to use g-tertho/cv-matcher-confit with sentence-transformers:
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("g-tertho/cv-matcher-confit")
sentences = [
"SummaryQuality-focused Data Entry Clerk experienced in data processing, coding and transcription. Skilled at entering data quickly with strong attention to detail and accuracy. Team player with outstanding communication skills and flexibility in working with others.\nSkillsRequirements DefinitionStatistical AnalysisData QualityConfiguration ManagementReporting ToolsAnalytical Problem SolvingAttention to DetailData AnalysisFlexible ScheduleStrong Work EthicData Visualization and PresentationsStakeholder CommunicationDecision MakingCustomer CommunicationBusiness AnalysisDatabase BuildingMail ManagementAccounting SupportMeeting PlanningData Entry DocumentationExcel SpreadsheetsResearch and Analytical SkillsMicrosoft Office SuiteMicrosoft OfficeSchedule ManagementComputers and TechnologyDocument and File ManagementStrong Organizational SkillsMultitasking and Time ManagementVerbal and Written Communication\nExperience01/2022to04/2023Data AnalystHumana Inc.|Clermont,FL,Worked with internal teams to understand business needs and changing strategies.Conducted data analysis to prepare forecasts and identify trends.Utilized data analysis to monitor process efficiencies and identify data integrity exceptions.Collected, tracked and reviewed data to evaluate business and market trends.Analyzed and tracked data to prepare forecasts and identify trends.Provided technical support for existing reports, dashboards or other tools.Gathered and organized data to analyze current industry trends.understand the business, analyze, process the data using python06/2019to04/2020Infant and Toddler TeacherColumbia Academy|Fulton,MD,Supervised circle time, free play, outside play and learning and developmental activities.Communicated with children's parents and guardians about daily activities, behaviors and problems.Taught children foundational skills in colors, shapes and letters.Controlled classroom environments with clearly outlined rules and positive reinforcement techniques.Implemented hands-on, play-based strategies for experiential learning.Organized and led activities to promote physical, mental and social development.Read aloud and played alphabet games to encourage early literacy.Developed and enforced positive strategies to encourage good behavior.Supported children's emotional and social development by adapting communication tactics for differing client needs.Introduced learning activities and imaginative play to teach children to explore.Sparked creativity and imagination by helping children discover new things each day.Monitored children's play activities to identify additional learning opportunities or behavioral issues.Enhanced sensory abilities by giving children access to numerous textures and shapes.Observed behavioral issues to alert parents or guardians.Engaged with children on individual basis to build positive, trusting relationships.Read stories to children and taught painting, drawing and crafts.Organized creative and fun activities, enhancing children's physical, emotional and social well-being.Built and strengthened positive relationships with students, parents and teaching staff.Participated in workshops, trainings and conferences to improve educational skills.Incorporated music and art activities to encourage creativity and expression.06/2014to11/2014Administrative AssistantSalient Crgt|Tampa,FL,Answered phone calls and emails to provide information, resulting in effective business correspondence.Provided secretarial and office management support while building cooperative working relationships.Scheduled appointments, meetings and events for management staff.Responded effectively to sensitive inquiries or complaints.Coordinated appointments, meetings and conferences.Managed physical and digital files, monitored spreadsheets and updated reports to coordinate project materials.Developed administrative processes to achieve organizational objectives and improve office efficiency.Prepared and prioritized calendars and correspondence.Composed correspondence, reports and meeting notes.Created spreadsheets in Microsoft Excel for record-keeping and reporting.Kept office equipment functional and supplies well-stocked to promote efficient operations.Sorted and distributed incoming faxes, letters and emails for office distribution.01/2014to04/2014Front Desk ReceptionistDignity Health|Chandler,AZ,Handled payment processing and provided customers with receipts and proper bills and change.Welcomed patrons to front desk and engaged in friendly conversations while conducting check-in process.Input customer data into reservation systems and updated to reflect room changes.Greeted visitors to provide information and direct to appropriate personnel.Explained policies and procedures to visitors.Completed basic bookkeeping and document filing.Prepared daily shift close reports and balanced cash register to accurately reflect transactions.\nEducation and TrainingExpected in07/2022toto|Data ScienceData Science Certificate,Plano, TX,GPA:Expected in07/2022toto|Project Management CertificateUdemy,Plano, TX,GPA:Expected in06/2012toto|Information TechnologyISTA,Safi, Morocco,GPA:Expected in07/2010totoHigh School Diploma|Salah Eddin,Safi, Morocco,GPA:Expected intoto|Business EconomicsIbno Zohr University,Agadir, Morocco,GPA:",
"Infomatics is an Inc 5005000 corporation for the last 7 years in a row. We have an urgent need for a Business Analyst in Pontiac, MI. Please find the job details below. \nTitle: Business AnalystLocation: Pontiac, MIDuration: Long Term Contract \nDescription: Client is seeking an experienced business analyst to join the Application Services team working in a hybrid work environment. We are seeking a hands-on, self-starter, critical thinking team player possessing both general technical knowledge and interpersonal skills. Experienced in implementing process re-engineering, developing business requirements, use cases and test scripts using industry accepted practices. Should possess high level understanding of information technology concepts as well as the SDLC methodology. Must be flexible and able to multi-task, working on multiple projects and internal initiatives, inclusive of upgrades, maintenance, and enhancements. Under supervision, conducts business process analyses and needs assessments to align information technology solutions with the business initiatives. Supports analytical functions by assisting programmers in ascertaining user needs and adapting user procedures to final program design. Organizes and facilitates application testing and user acceptance to ensure business communitys needs are met. Acts as second and third level support for Production incidents and facilitates troubleshooting and close out of reported issues for multiple applications. Utilizes current county-wide andor department specific software to complete assignments.\nExperience Level: 4+ years\nStart Date: 09182023.Duration: 2+ years\nEnvironment: Azure DevOps, MS Visio, MS Office Suite\n\nIf you have the above skillsexperience, please share your resume in confidence to:\nRecruiter Name: Sravan KumarEmail: sravan@infomatinc.com\nEOE",
"Job DescriptionSeeking a seasoned accountant with experience in manufacturing and cost accounting.The ideal candidate will have 5-10 years of practical experienceStrong working knowledge of the monthly close process and inventory accounting.Bachelors degree in accounting preferred, CPA not required.\nAbout the company\nThe company pioneered the design and manufacturing of protective covers for robotic, and other industrial applications, over 35 years ago. Since then, we have expanded our industrial covering uses to include welding, painting, finishing, assembly, and many other applications for a variety of industries.Job InsightsNeed someone who would be a great right-handlieutenant for oversight of AR, AP, inventory accounting, and monthly close.Need someone who can execute and thinks critically.",
"Power BI Data Analyst (Remote) CARIAN is growing! We are a proud, nationally certified woman-owned management consulting firm providing programproject management, capital project delivery, consulting, and technology solutions to our customers in the renewable energy, power utilities, infrastructure, and transittransportation sectors.\nWe are searching for a Power BI Data Analyst to support our client in the Maryland area. The Power BI Data Analyst will be expected to work as part of the Project Management Office (PMO) and support project delivery improvement initiatives and provide Power BI support services to other team members.\nPositions at CARIAN offer comprehensive and competitive benefits (medical, dental, and vision), 401(k) matching, and the opportunity to work with a growing company.\nJob description: The Power BI Data Analyst is responsible for preparing, manipulating, and staging data from various data sources and loading them into Power BI environments, and create dashboards and provide consistent Power BI reports. Experiencefamiliarity with configuring and using Power BI or other business analytics dashboards and or using other Microsoft BI technologies such as SQL.\nResponsibilities:Translate business needs to technical specifications.Collaborate with stakeholders to understand business needs, and work to gain an in-depth understanding of processes and procedures.Act as primary analyst and work with Client staff to translate business needs into clearly defined, well-documented, high-quality requirements, functional designs, and system supplemental specifications.Develop sound methods to transform data from various data sources into viable formats for ingestion into Power BI environments.Responsible for designing, building, publishing, and scheduling Power BI reporting solutions.Responsible for maintaining and supporting data analytics platforms.Responsible for creating tools to store data.Responsible for creating visualizations and reports for requested projects.Responsible for developing and updating technical documentation.Responsible for providing monthly administrative reporting on project duration, updating the project percent complete, and estimated hours spent towards each project.Responsible for providing technical support and answering questions from Client staff about specific Power BI needs.Follows quality assurance and control processes, and performs routine data management tasks, such as data validation and correction, queries, and editing to ensure data accuracy, integrity, and completeness.Ability to work as a member of a team or independently with minimal supervision, depending on the project.Performs other duties as assigned.\nQualifications:\nRequired:Bachelor of Science degree in Engineering, Information Technology, or related degree.2+ years of experience using Power BI.3+ years of experience using Excel, VBA, Power Query, or other data modeling tools.3+ years of ExcelData ModelingData Transformation.Familiar with Power BI Administration, such as gateways, userreport access, and workspaces.Proficient use of Microsoft Office Suite and Microsoft Windows.Familiar with SQL language preferred.Experience working remotely, in a subcontractor format.Candidates must be legally authorized to work in the United States.\nPreferred:SQL: 2+ years\nJob location: Remote\nCARIAN takes pride in being an Equal Opportunity Employer. We do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, citizenship, gender expression or identity, status as a veteran, and basis of disability or any other federal, state, or local legally protected class.\nAs a WBESBEDBE, CARIAN is committed to providing employment opportunities to women, veterans, and underrepresented minorities."
]
embeddings = model.encode(sentences)
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]This is a sentence-transformers model finetuned from BAAI/bge-small-en-v1.5. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for retrieval.
SentenceTransformer(
(0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
(1): Pooling({'embedding_dimension': 384, 'pooling_mode': 'mean', 'include_prompt': True})
)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
'SummaryPerformance-driven data/instructional coach with 3 years of experience promoting innovative instructional practices which are student-focused, research-based and outcome-oriented.\nCore QualificationsEdD Curriculum and Instruction LeadershipMS EducationConference Presenter - LEAD, PIE, Title I, WTN Tech ConferenceRTI2 Coordinator K-12Classroom Teacher (8 yrs.) - Elementary gradesStudent-led Conferences dissertation - research in practiceProgram development - District Data Notebooks, RTI2 Teams, Parent/Teacher Conference reforms\nProfessional Experience2013to01/2016Data/Instructional CoachMorris Hospital|Ottawa,IL,Responsibilities: K-12 position, assist teachers to improve classroom instruction, analyze data, implement RTI2, conduct PD for teachers, facilitate PLC meetings, fulfill Learning Leader responsibilities, serve on school Leadership Teams (WCES and WCPS), and chair District RTI2 Team meetings.07/2008to06/2013General EducatorMorris Hospital|Seneca,IL,Faculty - West Carroll Elementary School Math, Science, and Social Studies - 4th grade and 5th grade07/2005to06/2008General EducatorMilan Elementary|City,STATE,Faculty - Milan Elementary School General Education Teacher - 1st grade and 3rd grade\nEducation and TrainingExpected in2016totoEdD|Instruction and Curriculum LeadershipThe University of Memphis,Memphis,TNGPA:Successfully defended dissertation on Feb. 26, 2016Expected in2012totoSelect One|Humboldt State University,Arcata,CAGPA:Completed 3 credit hoursExpected in2009toto|The University of Tennessee,Chattanooga,TNGPA:Completed 3 credit hoursExpected in2009totoMS|Education Counseling School CounselingUniversity of TN Martin,Martin,TNGPA:Magna Cum LaudeEducation Counseling School Counseling Magna Cum LaudeExpected in2005totoB.S|Education Human Learning Human Learning K-8 Postgraduate StudiesUniversity of TN Martin,,TNGPA:Magna Cum LaudeEducation Human Learning Human Learning K-8 Magna Cum Laude Postgraduate Studies\nSkillsInstruction, Leadership, School Counseling, RTI2 Meetings, PLCs',
"Title: Data EngineerLocation: fully remote, however, priority is given to candidates local to Boston, MA; Long Island, NY; or Golden, COWork Model: 12 month contract with extensions or conversions highly possiblePay Rate: 58-68 an hour\nDay to DayA mid-sized telecom company is looking for a Sr Data Engineer to join their Business Intelligence Insights team. This team is responsible for all of the data migration, data clean up, data integration, and warehousing for the company. In this role, you will primarily be responsible for data migration and clean up in existing platforms as well as newly or soon to be integrated systems. It is necessary to be well versed in MS SQL, with the ability to import data, manipulate data and put it back in, querying, and building indexes. It is also crucial to be versed with SSIS to load and validate dimensions and measures. Lastly, it will be important for this person to have exposure and understanding of Salesforce - ability to import data, query data, get data out of Salesforce, and use SOQL. This position is currently slated as a 12 month contract, with possibility to extend or convert to an FTE. This role is offering a pay rate of $58-68hr. During the contract period, health benefits and a 401k are offered by Insight Global. Priority is given to candidates sitting in Boston, Colorado, or Long Island, however the role is fully remote. If you're interested, please apply today!\nMust Haves7 years of Data Engineering experience5+ years of experience with MS SQL or SOQLExperience with ETL tools, specifically SSISFamiliarity and understanding of Salesforce PlussesOracle or Postgress experienceTalend, Matillion, or similar tool",
'ERM is hiring a motivated consulting Senior Electrical Engineer, PE with a focus on electrical design and analysis across Multiple Locations in the U.S. The position is hybrid with the opportunity for flexibility in working from home & office. In this role, you will work closely with multi-discipline teams including project managers, engineers, and scientists to contribute to the planning, design, permitting and implementation of engineering projects in the renewable energy and power sectors.\nSeeking candidates with Project based Engineering experience, NOT Product based. Must have experience with utility projects above 20MW and a background in renewables.\nProjects will include development and review of construction drawings, technical specifications, contract documents, permit applications and calculations for renewable energy system components including photovoltaic solar technology, electrical substations, battery energy storage systems (BESS), distribution collector systems, and wind turbines. Staff management, project controls and management support for consulting and construction projects, including scheduling, labor resourcing, and cost estimating, will be a component of this position. Diverse and broad-based experiences, both in office and field settings, should be anticipated.\nRESPONSIBILITIES:Generate andor review equipment drawings and specifications for photovoltaic system components, solar modules, inverters, BESS, transformers, cable management systems and balance of systems (BOS).Procurement of equipment.Prepare electrical designs, including electrical loading and equipment sizing calculations. Apply technical knowledge of short circuiting, reactive capability, arc flash, cable ampacity, grounding, and voltage drop. Apply knowledge of NEC and IEEEANSI standards and electrical codes, as appropriate.Prepare electrical construction project cost estimates and schedules. Develop progress-tracking and completion reports.Provide technical expertise to navigate permitting challenges in the renewable energy and power sectors.Prepare technical proposals and participate in business development with existing clients and identified leads. Assist clients in developing strategies and preparing designs for proposed facilities, and prepare project work scopes, schedules, and budgets.Conduct field investigations, construction oversight and quality assurance activities and provide field exploration support as needed for design parameter development, and during construction for oversight and Construction Quality Assurance purposes.Work with other ERM resources to deepen relationships with ERM key clients and establish new client relationships that result in significant net revenue growth.Participate in project teams and independently on a global platform in varying settings that demand new and creative solutions.Lead, manage performance, hire and retain, inspire and mentor personnel for overall success of the technical team.\nREQUIREMENTS:B.S. andor M.S. in Electrical Engineering, with a focus on electricalProfessional Engineer (PE) license.5-10 years of electrical design experience, with focus in power generation, power distribution, andor renewable energy sectors. Candidates with significantly more experience or high performing candidates with less experience are encouraged to apply as multiple positions are available.Ability to work independently with minimal supervision, individually and as part of a project team.Experience with PVsyst (preferred) or pvCase or pvDesign, AutoCAD, and ERP Software.Advanced knowledge of the local regulatory climate, with proven negotiation skills with state and local regulators.Excellent verbal, writing, and computer skills (Excel, Word, PowerPoint).Demonstrated ability to research and prepare concise and accurate technical documents, with a keen attention to detail.Excellent interpersonal communication skills with complex technical knowledge and concepts.Proven business development experience for large programscontracts and client relationships supported by repeat business, including established contacts.Ability and willingness to travel. Less than 25% travel expected.\nWho We Are:As the largest global pure play sustainability consultancy, we partner with the worlds leading organizations, creating innovative solutions to sustainability challenges and unlocking commercial opportunities that meet the needs of today while preserving opportunity for future generations.\nAt ERM we know that creating a diverse, equitable and inclusive work environment is an essential part of making our company a great place to build a career. We also see our diversity as a strength that helps us create better solutions for our clients. Our diverse team of world-class experts supports clients across the breadth of their organizations to operationalize sustainability, underpinned by our deep technical expertise in addressing their environmental, health, safety, risk and social issues. We call this capability our boots to boardroom approach for its comprehensive service model that allows ERM to develop strategic and technical solutions that advance objectives on the ground or at the executive level.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.7283, 0.5536],
# [0.7283, 1.0000, 0.5912],
# [0.5536, 0.5912, 1.0000]])
anchor and positive| anchor | positive | |
|---|---|---|
| type | string | string |
| details |
|
|
| anchor | positive |
|---|---|
Professional Summary5 years of experience on Database development and administration, knowledge of relational database on SQL Server particularly on SSMS, SSRS, SSIS, Transact-SQL and SQL Server Agent. |
|
| *Extensive exposure to creation of Database Objects, Stored Procedures, Triggers, Views, User Defined Functions and Cursors. | |
| Core QualificationsSQL Server Tools: SQL Server Management Studio (SSMS)Data Warehouse Tools: MS SQL Server 2005/2008/2012 Integration ServicesBusiness Intelligence Tools: SQL Server 2005/2008/2012 Business Intelligence Development StudioProgramming Languages: T-SQLReporting Tools: SQL Server 2005/2008/2012 Reporting ServicesDevelopment Environment: Visual Studio 2005/2008/2012Operating Systems: Windows XP/2003/2008 Server, Win 3.x/95/98, Vista, Win 7Advanced Excel V-lookup, Sub-total, Pivot table, and Chart. | |
| ExperienceData Analyst,11/2014toCurrentLiberty Healthcare Corporation–,OK,Experience in Cons... | Kindly focus on the highlighted skill in the below requirements. |
Professional SummaryYoung professional with |
|
| hands-on experience analyzing data and model structures for large companies, | |
| including the Telecom industry. Skilled Data Analyst and Business Consultant. | |
| Accomplished in problem solving, advising best solutions and improving business | |
| through data analysis. Experience leading teams | |
| and presenting projects. Committed to delivering best possible outcomes and | |
| consistently recognized for outstanding excellence on several projects. Highly | |
| regarded by peers and co-workers. Technical proficiency in BSCS IX, Cognos, BMC | |
| Remedy, Tableau, Putty, Image Now, Rstudio, Oracle, MYSQL, Java, HTML, Python, | |
| Shell and Pearl. | |
| Areas of ExpertiseData Analysis & | |
| Visualization, Data Warehousing, Decision Modeling, Business Intelligence, Data & | |
| Statistical AnalysisOperations Management, Project Leadership, Reporting & Analysis, Client Management, Product Development,Change management | |
| ExperienceSenior Software Engineer,2004to2011The Hartford–Peace Dale,RI,Analyzed... | Mada is a startup powering inspired shopping experiences. Our A.I.-based marketplace app, The Mada App, uses patented technology to recommend personalized and shoppable outfits for each user. Dubbed Tinder for Outfits, the app curates millions of products from thousands of brands and retailers, like Revolve, Bloomingdale's, Shopbop, Urban Outfitters, and more, to revolutionize the way Gen Z shops. Now, we are working with some of the worlds largest brands on a new venture, and are looking for an uber-talented full stack developer to join our team. |
| As a Software Development Engineer for Mada, you will be at the forefront of our product development, contributing to both the front-end and back-end aspects of our applications. You will work collaboratively with a multidisciplinary team to design, develop, and deploy robust and scalable solutions. Your responsibilities will include: | |
| iOS Application Development (Cordova & JavaScript):Design, develop, and maintain iOS applications using the C... | |
Professional ProfileExpert in Functional Testing .6-Year Record of Proven ResultsSenior software QA testerwith full system development life cycle experience, including designing, developing and implementing test plans, high level calendar test cases and test processes with attention to detail resulting in high quality Change Request and production change implementationsHands-on technology professionalaccustomed to working in complex, project-based environments. Multifaceted experience in QA software testing, system testing, user-acceptance testing and production certification testing.Backed by strong credentialsincluding a Bachelor's degree, certificate in business management and advanced command of various testing tools, agile methodologies and cross-platform skills in Windows, and Unix. |
|
| Summary of SkillsTest Plans, Cases & ProcessesFunctional RequirementsDocumentationScrum/Agile MethodologiesUI & Compatibility TestingTest strategiesDefect / Bug TrackingUAT and System TestingTesting A... | Job Description |
| As a Principal Software Engineer, you will be responsible for helping design, build, test, deploy and operate highly scalable solutions for the canonical asset management system for all of Oracles next generation Cloud Infrastructure. You should be a rock-solid coder, and a distributed systems generalist who can dive deep into any part of the stack and low-level systems and design broad distributed system interactions. Your passion for excellence combined with your experience will help you be an outstanding technical contributor but also help you mentor more junior engineers. You should be able to work independently and as part of a team in an Agile environment. You should be an expert communicator to both technical and non-technical stakeholders in multiple locations around the globe. You should also be able to manage multiple projects and priorities in a fast-paced environment, be results-driven, and thrive even when faced with ambiguity and uncertainty. Most importan... |
MultipleNegativesRankingLoss with these parameters:{
"scale": 20.0,
"similarity_fct": "cos_sim",
"gather_across_devices": false,
"directions": [
"query_to_doc"
],
"partition_mode": "joint",
"hardness_mode": null,
"hardness_strength": 0.0
}
per_device_train_batch_size: 16num_train_epochs: 1learning_rate: 2e-05warmup_steps: 19bf16: Trueper_device_train_batch_size: 16num_train_epochs: 1max_steps: -1learning_rate: 2e-05lr_scheduler_type: linearlr_scheduler_kwargs: Nonewarmup_steps: 19optim: adamw_torch_fusedoptim_args: Noneweight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08optim_target_modules: Nonegradient_accumulation_steps: 1average_tokens_across_devices: Truemax_grad_norm: 1.0label_smoothing_factor: 0.0bf16: Truefp16: Falsebf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonegradient_checkpointing: Falsegradient_checkpointing_kwargs: Nonetorch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Noneuse_liger_kernel: Falseliger_kernel_config: Noneuse_cache: Falseneftune_noise_alpha: Nonetorch_empty_cache_steps: Noneauto_find_batch_size: Falselog_on_each_node: Truelogging_nan_inf_filter: Trueinclude_num_input_tokens_seen: nolog_level: passivelog_level_replica: warningdisable_tqdm: Falseproject: huggingfacetrackio_space_id: Nonetrackio_bucket_id: Nonetrackio_static_space_id: Noneper_device_eval_batch_size: 8prediction_loss_only: Trueeval_on_start: Falseeval_do_concat_batches: Trueeval_use_gather_object: Falseeval_accumulation_steps: Noneinclude_for_metrics: []batch_eval_metrics: Falsesave_only_model: Falsesave_on_each_node: Falseenable_jit_checkpoint: Falsepush_to_hub: Falsehub_private_repo: Nonehub_model_id: Nonehub_strategy: every_savehub_always_push: Falsehub_revision: Noneload_best_model_at_end: Falseignore_data_skip: Falserestore_callback_states_from_checkpoint: Falsefull_determinism: Falseseed: 42data_seed: Noneuse_cpu: Falseaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}parallelism_config: Nonedataloader_drop_last: Falsedataloader_num_workers: 0dataloader_pin_memory: Truedataloader_persistent_workers: Falsedataloader_prefetch_factor: Noneremove_unused_columns: Truelabel_names: Nonetrain_sampling_strategy: randomlength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falseddp_static_graph: Noneddp_backend: Noneddp_timeout: 1800fsdp: []fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}deepspeed: Nonedebug: []skip_memory_metrics: Truedo_predict: Falseresume_from_checkpoint: Nonewarmup_ratio: Nonelocal_rank: -1prompts: Nonebatch_sampler: batch_samplermulti_dataset_batch_sampler: proportionalrouter_mapping: {}learning_rate_mapping: {}| Epoch | Step | Training Loss |
|---|---|---|
| 0.2577 | 50 | 2.2187 |
| 0.5155 | 100 | 1.9433 |
| 0.7732 | 150 | 1.9014 |
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
@misc{oord2019representationlearningcontrastivepredictive,
title={Representation Learning with Contrastive Predictive Coding},
author={Aaron van den Oord and Yazhe Li and Oriol Vinyals},
year={2019},
eprint={1807.03748},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/1807.03748},
}
Base model
BAAI/bge-small-en-v1.5