Hugging Face's logo

ivvvvvi
/
cv_embedder

Sentence Similarity
sentence-transformers
Safetensors
qwen3
feature-extraction
Generated from Trainer
dataset_size:2890
loss:CoSENTLoss
text-embeddings-inference
Model card Files
xet
 Community

SentenceTransformer based on Qwen/Qwen3-0.6B

This is a sentence-transformers model finetuned from Qwen/Qwen3-0.6B. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for retrieval.

Model Details

Model Description

  • Model Type: Sentence Transformer
  • Base model: Qwen/Qwen3-0.6B
  • Maximum Sequence Length: 1024 tokens
  • Output Dimensionality: 1024 dimensions
  • Similarity Function: Cosine Similarity
  • Supported Modalities: Text, Message

Model Sources

Full Model Architecture 

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}, 'message': {'method': 'forward', 'method_output_name': 'last_hidden_state', 'format': 'flat'}}, 'module_output_name': 'token_embeddings', 'architecture': 'Qwen3Model'})
  (1): Pooling({'embedding_dimension': 1024, 'pooling_mode': 'lasttoken', 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.\nQuery: Title: Junior Project Manager (PMO Support – SAP Program)\nCompany: Sii Ukraine\nCategory: Project Manager\nSkills: Management, Project Manager\nLanguages: English - C1 - Advanced, Ukrainian - Native\nExperience: 1 year experience\nEmployment: FULL_TIME\nWork format: Full Remote\nLocation: Tax residence in Ukraine is required\nDomain: Energy / Utilities\n\nDescription:\nSii Ukraine is a subsidiary of Sii Poland — the leader in IT, engineering, and consultancy services with over 7500 IT experts in Poland and more than 250 prestigious customers. We are looking for ambitious and top-quality professionals to join our project teams.\n \nThe Junior Project Manager (PMO Support) provides administrative and organizational support within a large-scale, multi-year SAP S/4HANA implementation programme in a complex, international environment. \n\nThis role is designed for a junior or trainee-level professional who is motivated to grow in project management and gain hands-on experience in supporting experienced project managers and cross-functional teams.\n\nThe position focuses on ensuring smooth coordination, documentation, and communication across stakeholders, while contributing to the successful delivery of a global transformation programme within a leading international energy technology organization.\n \nYour Tasks:\nSupport experienced Project Managers in the coordination of a large SAP S/4HANA implementation programme\nOrganize and coordinate meetings (scheduling, agendas, logistics, follow-ups)\nPrepare meeting minutes, action trackers, and project documentation\nManage and structure project documentation, presentations, and files\nMaintain and administer SharePoint spaces for cross-functional collaboration\nSupport Track & Trace activities across project tasks and deliverables\nAssist in preparing presentations for internal and stakeholder meetings\nProvide support in risk tracking and basic budget monitoring activities\nEnsure proper documentation management and version control\nFacilitate communication between project teams, stakeholders, and external partners\nProvide general administrative and organizational support to the PMO\n\nRequirements:\n1-2 years of experience in PMO support, project coordination, or administrative roles (junior or trainee profiles are welcome)\nBasic knowledge of project management principles and PMO practices\nPractical experience with Microsoft SharePoint and Microsoft PowerPoint\nAbility to manage and organize project documentation, including structuring and version control\nExperience supporting meeting and presentation preparation, including note-taking and follow-ups\nBasic understanding of Track & Trace activities related to project tasks and deliverables\nStrong organizational and coordination abilities with close attention to detail\nAbility to communicate effectively and collaborate with diverse stakeholders\nCapability to work in a structured and professional environment\nProactive mindset with motivation to learn and take initiative\nFluency in English (required)\nTax residence in Ukraine is required',
    'Candidate Resume: Title: Project Manager\nSeniority: Middle\nLanguages: English, Ukrainian, Russian\nLocation: Ukraine\nExperience: 0-3 years\n\nSummary: Currently working as a project manager mostly. Partially doing some front-end development (JS/CSS/HTML5) and back-end (PHP/Smarty/MySQL).\nWork history: My responsibilities include... managing projects :) | Design and development',
    'Candidate Resume: Title: Senior Software Engineer\nSeniority: Senior\nLocation: Michigan\nExperience: 10+ years\n\nSummary: Team player software engineer with a positive attitude, phenomenal time management skills, attention to detail, and a strong focus on user experience. Worked as a full-stack developer in the medical and automotive industries. Recently traveled the world while developing small business websites and mobile apps, including a photo collage maker and several games for iOS. Passionate about the future of technology and human-centered design. Email: chris@chris-hendrickson.com Github: https://github.com/ninjacom Website: http://www.chris-hendrickson.com Escape Cube (iOS) - Preview Video: https://youtu.be/X7VHpmiCsfo iTunes Games: https://itunes.apple.com/us/developer/chris-hendrickson/id557902223 Global Game Jam 2018 - Unity VR game: https://globalgamejam.org/2018/games/dominoes\nWork history: Skills: .NET Framework, C#, Object Oriented Programming (OOP), Domain-Driven Design (DDD), SQL Server Management Studio, Stored Procedures, Entity Framework (EF) Core, JSON, REST APIs, Postman, XML, Python, Azure Devops, Powershell Scripting, Test Driven Development (TDD), Unit and Integration Testing, Git & Github, ASP.NET MVC, API Development and Testing, Design Patterns | Developed token authorized C# API calls to expose core bank data. Project managed and developed python automations to save employees hundreds of back-office labor hours. Created ETL and API applications with Mulesoft Anypoint Studio. Built and managed CICD pipelines in Azure Devops. | Game Designer, Software Developer, World Traveler, Optimistic Futurist | Pluralsight Continuous Testing with NCrunch | Pluralsight Encapsulation and SOLID',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[0.9999, 0.7596, 0.6911],
#         [0.7596, 1.0000, 0.7885],
#         [0.6911, 0.7885, 1.0000]])

Training Details

Training Dataset

Unnamed Dataset

  • Size: 2,890 training samples
  • Columns: sentence1, sentence2, and score
  • Approximate statistics based on the first 100 samples:
    sentence1 sentence2 score
    type string string float
    modality text text
    details
    • min: 346 tokens
    • mean: 687.81 tokens
    • max: 1024 tokens
    • min: 36 tokens
    • mean: 229.69 tokens
    • max: 448 tokens
    • min: 0.0
    • mean: 0.4
    • max: 1.0
  • Samples:
    sentence1 sentence2 score
    Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.
    Query: Title: Head of Security
    Company: Label Your Data
    Category: Information Security
    Skills: Operations (Ops), Security, Information Security
    Languages: English - B1 - Intermediate, Ukrainian - Native
    Experience: 3 years experience
    Employment: FULL_TIME
    Work format: Full Remote
    Location: Countries of Europe or Ukraine
    Domain: Machine Learning / Big Data

    Description:
    At Label Your Data, we are looking for a Head of Security who will build and lead the company’s dedicated security direction from the ground up.

    Label Your Data is part of a group of companies with an existing centralized security function. Now, we are establishing a standalone security capability, closely collaborating with the group security team while taking ownership of security operations, processes, and long-term security strategy specifically for ...    		 Candidate Resume: Title: Computer Engineer (Information Security)
    Seniority: Middle
    Location: Washington, District of Columbia
    Experience: 5-10 years

    Summary: Experienced systems engineering professional with a demonstrated history of success in government and commercial civilian and defense sectors. Skilled in Operations and Engineering Management, Communications Engineering, Cyber Security, System Safety, Computer Science, Software Engineering, and Contract Management. Registered Professional Mechanical Engineer. Strong research professional with a PhD in Information Technology from George Mason University.
    Work history: Supporting the FAA Information Security Architect in the planning, development and implementation of the information security architecture and development of information security requirements, standards, and architecture for the FAA Next Generation Air Transportation System (NEXTGEN) modernization of America's air transportation system. Perform professional engineer...    		 0.3333333333333333
    Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.
    Query: Title: Senior Azure DevOps Engineer (Azure / Kubernetes / Terraform)
    Company: Hanna Robulets Company
    Category: DevOps
    Skills: Operations (Ops), DevOps
    Languages: English - B2 - Upper Intermediate, Ukrainian - Native
    Experience: 5 years experience
    Employment: FULL_TIME
    Work format: Full Remote
    Location: Ukraine
    Domain: Other

    Description:
    About the Company
    A global trading and investing platform with 20M+ registered users across Stocks, Crypto, and ETFs is expanding its DevOps organization.
    The team works on large-scale distributed production systems, infrastructure automation, Kubernetes multi-cluster environments, CI/CD architecture, and reliability engineering. This role is ideal for engineers who enjoy solving real production challenges related to scalability, security, observability, and platform engineering.
    ...    		 Candidate Resume: Title: Co-Founder Golang Developer
    Seniority: Middle
    Languages: English
    Location: Tehran Province
    Experience: 0-3 years

    Summary: DevOps Engineer with over 5 years of hands-on experience in CI/CD pipelines, container orchestration (Docker & Kubernetes), infrastructure automation (IaC), and monitoring. Proficient in managing complex production environments using tools like GitLab CI, Rancher, and Prometheus. Founder of GitNegar, a content platform focused on software development. Currently expanding expertise in the Go programming language.
    Work history: Web Pishgaman is a technology-driven team specializing in web development, mobile app creation, and DevOps infrastructure. We help businesses build reliable, scalable digital products tailored to their needs. Our mission is to deliver modern solutions that empower your digital growth. | Managed Vcenter/ESXi , pfSense , LDAP and Rancher RKE2-based Kubernetes clusters (Dev, Staging, Production) Deployed Ceph (Rook) and M...    		 0.6666666666666666
    Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.
    Query: Title: Frontend Engineer (React)
    Company: borimm.io
    Category: React.js
    Skills: Development, JavaScript / Front-End, React.js
    Languages: English - B1 - Intermediate
    Experience: 3 years experience
    Employment: FULL_TIME
    Work format: Full Remote
    Location:
    Domain: Fintech

    Description:
    We are looking for a Frontend Engineer to help build Fillx, a fintech product focused on crypto market workflows and trading operations.

    You will work on production-facing web interfaces where clarity, performance, and reliability matter. The role is a good fit for someone who enjoys turning complex market data and operational flows into clean, fast, maintainable user experiences.

    Responsibilities:
    - Build and maintain React + TypeScript web interfaces.
    - Work with real-time or frequently updated market and trading data.
    - Design reus...    		 Candidate Resume: Title: Frontend Developer
    Seniority: Middle
    Skills: JavaScript
    Languages: English, Hindi
    Location: Chennai, Tamil Nadu
    Experience: 0-3 years

    Work history: Part of one of the new products that provides WFM (Work Force Management) solutions using dimensions and Dell Boomi integration. | Passionate Full Stack Developer adept at crafting elegant solutions across the entire web development stack. Proficient in React.js, Node.js, Redux, Express    		 0.3333333333333333
  • Loss: CoSENTLoss with these parameters:
    {
    "scale": 20.0,
    "similarity_fct": "pairwise_cos_sim"
}

Evaluation Dataset

Unnamed Dataset

  • Size: 273 evaluation samples
  • Columns: sentence1, sentence2, and score
  • Approximate statistics based on the first 100 samples:
    sentence1 sentence2 score
    type string string float
    modality text text
    details
    • min: 416 tokens
    • mean: 716.14 tokens
    • max: 1024 tokens
    • min: 32 tokens
    • mean: 191.44 tokens
    • max: 463 tokens
    • min: 0.0
    • mean: 0.29
    • max: 1.0
  • Samples:
    sentence1 sentence2 score
    Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.
    Query: Title: System Administrator
    Company: CHRM GROUP
    Category: Sysadmin
    Skills: Operations (Ops), Sysadmin
    Languages: Ukrainian - Native
    Experience: 1 year experience
    Employment: FULL_TIME
    Location: Ukraine
    Domain: Telecom / Communications

    Description:
    Працюєш системним адміністратором і шукаєш стабільну офісну роботу з чіткими задачами та перспективою розвитку?

    Запрошуємо System Administrator до команди, яка працює з IT-інфраструктурою

    У ваш функціонал буде входити:

    1. Технічна підтримка користувачів: вирішення базових проблем з ПК, друком, мережею, оновленнями та ПЗ.
    2. Робота з тікет-системою: прийом і виконання заявок (дистанційно та на місці).
    3. Перевірка справності офісного обладнання: комп’ютери, Wi-Fi, комутатори, периферія.
    4. Діагностика та блочний ремонт техніки: заміна комплектуючих, перевстановленн...    		 Candidate Resume: Title: System Integrator
    Seniority: Middle
    Skills: Java
    Languages: English, Arabic, French
    Location: Egypt
    Experience: 5-10 years

    Summary: My job will protect the world
    Work history: Microsoft Maintains computing environment by identifying system requirements; installing upgrades; monitoring system performance Installing/configuring new computers Repairing/upgrading PC hardware and software Maintaining inventory of equipment and supplies (cables, adapters, etc.). install and configure Dns and Dhcp in windows server 2012 Establishes system by planning and executing the selection, installation, configuration, and testing of PC and server hardware, software, LAN networks, and operating and system management systems; defining system and operational policies and procedures deal with hyper-v and Vmware basics Show less    		 0.3333333333333333
    Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.
    Query: Title: Senior Backend Python Developer (Django)
    Company: Kozak Agency
    Category: Python
    Skills: Development, Python
    Languages: English - B2 - Upper Intermediate, Ukrainian - Native
    Experience: 5 years experience
    Employment: FULL_TIME
    Work format: Full Remote
    Location:
    Domain: Other

    Description:
    We’re preferably looking for someone based in Asia, or someone who has already relocated there from Europe.
    We’re also open to candidates in Europe who are comfortable working night shifts due to the timezone overlap requirements with the client in Australia.

    Right now we need someone ASAP for a full-time 2-week discovery phase. The key requirement is an early start and at least partial overlap with the client’s working hours.
    After the discovery phase, the plan is to continue with a long-term full-time engagement, ideal...    		 Candidate Resume: Title: Senior Software Engineer
    Seniority: Senior
    Skills: Python, HTML, Shell, JavaScript
    Languages: Russian, English, German
    Location: Berlin
    Experience: 0-3 years

    Summary: Experienced senior engineer with 7+ years of hands-on development in software…
    Work history: Backend Python developer | Backend Python developer | Python (Django) / JS developer | Python developer at AG Schwartz, UKB | Writing magic words in a snake language    		 0.3333333333333333
    Search for a candidate for this job: Instruct: Given a job listing, retrieve the most relevant candidate profiles that match the required skills, experience, and role.
    Query: Title: Hardware Engineer
    Company: Reintech
    Category: Hardware Engineer
    Skills: Hardware, Hardware Engineer
    Languages: English - B1 - Intermediate, Ukrainian - Native
    Experience: 5 years experience
    Employment: FULL_TIME
    Location: Ukraine
    Domain: Other

    Description:
    As a Hardware Engineer, you will contribute to the development of the most advanced electronic equipment used in the UAV application area. There’s an opportunity to join the exceptionally skilled cross- functional team capable of creating advanced system-level solutions from scratch.

    Responsibilities:
    — participation in product and prototype development;
    — design, develop, and review PCBs and their sub-components;
    — drive resolution of different technical issues, including those related to architecture (performance, power consumption, thermal behavior)...    		 Candidate Resume: Title: QA Engineer
    Seniority: Middle
    Languages: English, Ukrainian
    Location: Lviv, Lviv Oblast
    Experience: 0-3 years

    Summary: I have experience in E2E internal and external testing, security testing, integrations testing, experience in UAT , communication with vendor, stories and defects testing, regression testing, finding design gaps , creating defects and test cases, experience in studying colleagues in India (knowledge transfer). Also B2 – C1 level of English (upper intermediate), good knowledge of SQL. SOAP UI– intermediate , Postman – intermediate, SQL developer – intermediate, Excel – intermediate, Advanced – MS Word , Atlassian Jira – intermediate, working with browser console – intermediate, win scp – intermediate, Putty - intermediate .
    Work history: Coursera Interactivity with JavaScript | Coursera Course Certificates Introduction to CSS3 | Coursera Course Certificates Introduction to HTML5    		 0.3333333333333333
  • Loss: CoSENTLoss with these parameters:
    {
    "scale": 20.0,
    "similarity_fct": "pairwise_cos_sim"
}

Training Hyperparameters

Non-Default Hyperparameters

  • num_train_epochs: 4
  • learning_rate: 2e-05
  • warmup_steps: 0.1
  • gradient_accumulation_steps: 4
  • bf16: True
  • tf32: True
  • per_device_eval_batch_size: 4

All Hyperparameters

Click to expand
  • per_device_train_batch_size: 8
  • num_train_epochs: 4
  • max_steps: -1
  • learning_rate: 2e-05
  • lr_scheduler_type: linear
  • lr_scheduler_kwargs: None
  • warmup_steps: 0.1
  • optim: adamw_torch_fused
  • optim_args: None
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • optim_target_modules: None
  • gradient_accumulation_steps: 4
  • average_tokens_across_devices: True
  • max_grad_norm: 1.0
  • label_smoothing_factor: 0.0
  • bf16: True
  • fp16: False
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: True
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • use_liger_kernel: False
  • liger_kernel_config: None
  • use_cache: False
  • neftune_noise_alpha: None
  • torch_empty_cache_steps: None
  • auto_find_batch_size: False
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • include_num_input_tokens_seen: no
  • log_level: passive
  • log_level_replica: warning
  • disable_tqdm: False
  • project: huggingface
  • trackio_space_id: None
  • trackio_bucket_id: None
  • trackio_static_space_id: None
  • per_device_eval_batch_size: 4
  • prediction_loss_only: True
  • eval_on_start: False
  • eval_do_concat_batches: True
  • eval_use_gather_object: False
  • eval_accumulation_steps: None
  • include_for_metrics: []
  • batch_eval_metrics: False
  • save_only_model: False
  • save_on_each_node: False
  • enable_jit_checkpoint: False
  • push_to_hub: False
  • hub_private_repo: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_always_push: False
  • hub_revision: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • restore_callback_states_from_checkpoint: False
  • full_determinism: False
  • seed: 42
  • data_seed: None
  • use_cpu: False
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • parallelism_config: None
  • dataloader_drop_last: False
  • dataloader_num_workers: 0
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • dataloader_prefetch_factor: None
  • remove_unused_columns: True
  • label_names: None
  • train_sampling_strategy: random
  • length_column_name: length
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • ddp_static_graph: None
  • ddp_backend: None
  • ddp_timeout: 1800
  • fsdp: None
  • fsdp_config: None
  • deepspeed: None
  • debug: []
  • skip_memory_metrics: True
  • do_predict: False
  • resume_from_checkpoint: None
  • warmup_ratio: None
  • local_rank: -1
  • prompts: None
  • batch_sampler: batch_sampler
  • multi_dataset_batch_sampler: proportional
  • router_mapping: {}
  • learning_rate_mapping: {}

Training Logs

Epoch Step Training Loss Validation Loss
0.1105 10 3.1358 -
0.2210 20 2.9751 -
0.3315 30 3.1855 -
0.4420 40 2.9830 -
0.5525 50 2.8721 -
0.6630 60 3.0209 -
0.7735 70 2.9303 -
0.8840 80 2.9119 -
0.9945 90 2.8226 -
1.0 91 - 1.5093
1.0994 100 2.6964 -
1.2099 110 2.6714 -
1.3204 120 2.7469 -
1.4309 130 2.6812 -
1.5414 140 2.7814 -
1.6519 150 2.6438 -
1.7624 160 2.6611 -
1.8729 170 2.6188 -
1.9834 180 2.6251 -
2.0 182 - 1.4555
2.0884 190 2.4713 -
2.1989 200 2.4649 -
2.3094 210 2.2881 -
2.4199 220 2.5158 -
2.5304 230 2.3849 -
2.6409 240 2.1406 -
2.7514 250 2.4799 -
2.8619 260 2.1610 -
2.9724 270 2.3063 -
3.0 273 - 1.3578
3.0773 280 2.2504 -
3.1878 290 2.0670 -
3.2983 300 2.0648 -
3.4088 310 1.9947 -
3.5193 320 2.0342 -
3.6298 330 2.1131 -
3.7403 340 1.9564 -
3.8508 350 2.0953 -
3.9613 360 1.8951 -
4.0 364 - 1.3413

Training Time

  • Training: 15.7 minutes

Framework Versions

  • Python: 3.12.13
  • Sentence Transformers: 5.6.0
  • Transformers: 5.12.1
  • PyTorch: 2.11.0+cu128
  • Accelerate: 1.14.0
  • Datasets: 4.0.0
  • Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers 

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

CoSENTLoss 

@article{10531646,
    author={Huang, Xiang and Peng, Hao and Zou, Dongcheng and Liu, Zhiwei and Li, Jianxin and Liu, Kay and Wu, Jia and Su, Jianlin and Yu, Philip S.},
    journal={IEEE/ACM Transactions on Audio, Speech, and Language Processing},
    title={CoSENT: Consistent Sentence Embedding via Similarity Ranking},
    year={2024},
    doi={10.1109/TASLP.2024.3402087}
}
Downloads last month
78
Safetensors
Model size
0.6B params
Tensor type
BF16
·
Inference Providers NEW
Sentence Similarity
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ivvvvvi/cv_embedder

Base model

Qwen/Qwen3-0.6B-Base
Finetuned
Qwen/Qwen3-0.6B
Finetuned
(1252)
this model

Paper for ivvvvvi/cv_embedder