--- tags: - sentence-transformers - sentence-similarity - feature-extraction - generated_from_trainer - dataset_size:1244 - loss:GISTEmbedLoss widget: - source_sentence: Girl with long black hair, healthy tan, and captivating brown eyes smiles warmly. She wears a vibrant blue one-piece swimsuit, high-cut to elongate her toned thighs and highlight her perky breasts. A cute hairclip holds back some strands, and an earclip adds elegance. Seated on a plain chair with a red lollipop near her slightly open mouth, she exudes playful seduction. The simple chalkboard background keeps the focus on her engaging, alluring presence. Overall atmosphere is sensual and enticing, with a bright, cheerful vibe. sentences: - In a quiet library, a figure emerges from the shadows. Her hair, a dark cascade, frames her pale face, and her eyes, a deep shade of mahogany, hold a mysterious allure. She wears a vintage dress, its color a muted blue, and her movements are graceful. As she sits beside you, the scent of old books and secrets fills the air. Her voice, soft and cultured, shares tales of forgotten worlds, drawing you into a realm of intellectual seduction. - You find yourself on a tropical beach, the sun warming your skin. A beautiful stranger, with a radiant smile, catches your eye. She sits across from you, her swimsuit hugging her curves, and her hair shimmering in the sunlight. As she leans forward, offering you the lollipop, her scent, a mix of coconut and summer breeze, envelops you. Her eyes, deep pools of chocolate, hold a promise of sweet delights, and you can't help but be drawn into her playful game. - You stand in front of the camera, feeling a little nervous but excited. The photographer, a friend of yours, encourages you to strike a playful pose, something that shows off your personality. You bite your lip, a mix of shyness and mischief in your eyes, and lean against the wall, one hand on your hip. The outfit clings to your curves, and you can't help but feel a little sexy, a side of yourself you don't often explore. - source_sentence: Horse girl with orange hair tied by a white hairband, revealing her nape and flowing down her back. She stands confidently with hands on hips, facing away but looking back with aqua eyes. She wears a black sports bra, showcasing her toned midriff and sweat-glistened muscular physique. Her horse tail extends seamlessly through her clothing. Dark background focuses attention on her strength, determination, and hint of sensuality. Artwork signed by Kibidango_14-gou. sentences: - Saren's heart pounds as she kneels on the luxurious bed, her maid outfit a stark contrast to the broken plate on the floor. You witness her vulnerability, her large breasts heaving with each rapid breath. Suzume, with a mischievous glint in her eye, lifts Saren's skirt, exposing her even further. The dark-skinned man's hand on Saren's thigh sends a jolt through you; you can almost feel the electricity of their touch. The tension is thick, and you're captivated by the raw emotions playing out before you. - You're a horse girl, standing tall and proud. Your orange hair, tied back with a simple white band, frames your face, drawing attention to your aqua eyes. The black sports bra accentuates your defined abs and the sheen of sweat on your skin. You exude a raw, untamed energy, a testament to your strength and spirit. The artist's signature, Kibidango_14-gou, is a subtle reminder of the captivating world you inhabit. - In the dimly lit room, you sit on a leather couch, your fiery red hair cascading over your shoulders. You're dressed in a sleek, red latex bodysuit, the material hugging your curves. The scent of fresh roses fills the air as you lean forward, your green eyes sparkling with anticipation. A mysterious figure approaches, their face hidden in shadow. - source_sentence: 'Jingliu from Honkai: Star Rail lies on her side, showcasing her bare shoulders and legs. Her long white hair falls between her piercing red eyes. She wears a blue dress with a high-low skirt and detached sleeves, revealing her medium breasts. The dress incorporates traditional Chinese design elements. The image focuses on Jingliu''s feet and soles, emphasized by the foreshortening technique. Dark, icy shards form the background, while shadowy purple hands reach towards her, creating a tense and eerie atmosphere.' sentences: - You stride forward, your body language exuding raw, untamed power. The wind catches your golden tresses, framing your devilish features. Your horns gleam with a sinister allure. As you lift your shirt, you reveal your ample bosom, the nipples hardening in the cool air. You sense the eyes on you, but you're in control, a seductive grin spreading across your face, daring anyone to come closer. - In a dimly lit chamber, you're tied to a chair, your heart pounding. A figure approaches, their face obscured by a dark hood. They kneel before you, and you catch a glimpse of their outfit—a tattered blue dress, a far cry from the elegant attire you expected. As they lift their head, you see it's not Jingliu, but a stranger with piercing eyes. Their touch sends shivers down your spine, not of desire, but of fear. - You find yourself in a surreal, icy landscape, the cold air making your breath visible. Lying on a crystalline platform is Jingliu, her beauty captivating. Her bare feet, delicate and graceful, draw your attention. As you move closer, you notice the intricate design of her dress, a fusion of modern and traditional styles. The shadowy hands reaching towards her create a sense of urgency, and you feel a rush of adrenaline as you instinctively want to protect her. - source_sentence: Two girls sit inside a sporty car. The driver, Takina Inoue, has long black hair in a ponytail and purple eyes. She wears a formal suit with a black jacket, white shirt, and necktie. In the passenger seat, Chisato Nishikigi smiles at the viewer. She has medium-length blonde hair with a red ribbon and red eyes. She wears a white shirt and an orange jacket. Sunglasses rest on her head. The scene is set outdoors during the day, with a magazine cover overlay featuring the title "LYCORIS" and "LycoReco Partner". sentences: - You're in the passenger seat, the wind blowing through your hair as Takina accelerates. Her eyes, focused on the road, shine with determination. You feel the thrill of the ride, the engine's roar, and the warm sun on your skin. As you glance at the magazine cover, you imagine yourself as a powerful duo, ready to take on any adventure that comes your way. - The car ride is bumpy, and you're squeezed into the back seat with your friends. Inoue-san, with her short, spiky hair, is driving recklessly, and you can't help but feel nervous. The magazine on your lap flutters in the wind, its pages flipping uncontrollably. You try to focus on the article about the Lycoris flower, but it's hard to concentrate in this chaotic environment. - Lillie's innocent smile greets you from the photo, her face adorned with a playful peace sign. But the image takes a darker turn as you notice the semen on her face. Lusamine, standing before you, exudes a confident aura, her sailor outfit and sunglasses adding to her allure. The muscular figure in the background, with its explicit markings, adds a layer of forbidden desire to the scene, leaving you captivated by the contrast between purity and corruption. - source_sentence: Soga no Tojiko sits with a playful smile, looking directly at the viewer. Her short green hair falls over her eyes, highlighting her blush and expressive gaze. She wears a green dress with long sleeves and a high collar, along with a distinctive black hat featuring a red accent. Notably, she has a ghost tail instead of legs, showcasing her black panties and large breasts. Japanese text appears on the right side of the image. sentences: - You stand in front of the mirror, your reflection revealing a stunning sight. Jean, with her captivating blonde locks and mesmerizing blue eyes, you lift your arms, fingers gracefully playing with your high ponytail. The black ribbon adds a touch of elegance, matching the sophistication of your corset-like top. You feel the fabric hugging your curves, accentuating your cleavage, a subtle invitation. The soft white background and lilies create a serene ambiance, but your eyes, they hold a promise of something more, a seductive allure that draws one's gaze. - Tojiko's playful smile captivates you, her green eyes sparkling with mischief. Her unique green dress, a perfect match for her hair, hugs her curves, emphasizing her ample chest. But it's her ghostly tail that draws your attention, a mysterious feature that adds to her allure. She sits there, legs crossed, her black panties barely visible, leaving much to the imagination. The Japanese text beside her seems to whisper secrets, adding to the enigmatic charm of this playful spirit. - A young woman with a similar smile sits cross-legged on a cozy couch, her long, dark hair cascading over her shoulders. She's dressed in a casual, loose-fitting shirt and jeans, a comfortable outfit for a relaxed evening. Her legs are very much human, and she wears cute, colorful socks. The atmosphere is lighthearted, and she seems ready for a fun conversation, her expression inviting and warm. pipeline_tag: sentence-similarity library_name: sentence-transformers --- # SentenceTransformer This is a [sentence-transformers](https://www.SBERT.net) model trained. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. ## Model Details ### Model Description - **Model Type:** Sentence Transformer - **Maximum Sequence Length:** 512 tokens - **Output Dimensionality:** 384 dimensions - **Similarity Function:** Cosine Similarity ### Model Sources - **Documentation:** [Sentence Transformers Documentation](https://sbert.net) - **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers) - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers) ### Full Model Architecture ``` SentenceTransformer( (0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) (2): Normalize() ) ``` ## Usage ### Direct Usage (Sentence Transformers) First install the Sentence Transformers library: ```bash pip install -U sentence-transformers ``` Then you can load this model and run inference. ```python from sentence_transformers import SentenceTransformer # Download from the 🤗 Hub model = SentenceTransformer("sentence_transformers_model_id") # Run inference sentences = [ 'Soga no Tojiko sits with a playful smile, looking directly at the viewer. Her short green hair falls over her eyes, highlighting her blush and expressive gaze. She wears a green dress with long sleeves and a high collar, along with a distinctive black hat featuring a red accent. Notably, she has a ghost tail instead of legs, showcasing her black panties and large breasts. Japanese text appears on the right side of the image.', "Tojiko's playful smile captivates you, her green eyes sparkling with mischief. Her unique green dress, a perfect match for her hair, hugs her curves, emphasizing her ample chest. But it's her ghostly tail that draws your attention, a mysterious feature that adds to her allure. She sits there, legs crossed, her black panties barely visible, leaving much to the imagination. The Japanese text beside her seems to whisper secrets, adding to the enigmatic charm of this playful spirit.", "A young woman with a similar smile sits cross-legged on a cozy couch, her long, dark hair cascading over her shoulders. She's dressed in a casual, loose-fitting shirt and jeans, a comfortable outfit for a relaxed evening. Her legs are very much human, and she wears cute, colorful socks. The atmosphere is lighthearted, and she seems ready for a fun conversation, her expression inviting and warm.", ] embeddings = model.encode(sentences) print(embeddings.shape) # [3, 384] # Get the similarity scores for the embeddings similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] ``` ## Training Details ### Training Dataset #### Unnamed Dataset * Size: 1,244 training samples * Columns: anchor, positive, and negative * Approximate statistics based on the first 1000 samples: | | anchor | positive | negative | |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------| | type | string | string | string | | details | | | | * Samples: | anchor | positive | negative | |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | A Jiangshi girl with short blue hair and bright blue eyes stands in a graveyard. She wears a red traditional Chinese dress with a black skirt trimmed with white and patterned borders, a white petticoat, and a hat adorned with a star. An ofuda talisman is stuck to her forehead. Her arms are outstretched in a classic zombie pose, she has bare legs, and her tongue sticks out slightly as she walks towards the viewer with an eerie expression. Cherry blossoms surround her, contrasting with the tombstones and full moon illuminating the scene. | The moonlight bathes the graveyard in an ethereal glow, and you, the Jiangshi girl, feel a surge of power. You stride forward, your bare feet brushing against the cool grass, your tongue lolling out in a playful gesture. The cherry blossoms sway in the breeze, their fragrance filling the air. As you approach, you see your target, a handsome man, his eyes wide with a mixture of fear and desire. You reach out, your fingers icy cold, and he shivers, his breath quickening. You whisper ancient incantations, your voice seductive, and he's drawn into your embrace, captivated by your otherworldly allure. | You find yourself in a bustling city square, surrounded by vibrant street life. The air is filled with the aroma of street food and the lively chatter of vendors. As you wander, you spot a fortune teller's booth, adorned with colorful scarves and crystals. Intrigued, you step inside, where an elderly woman with kind eyes greets you. She offers you a cup of tea, its steam carrying the scent of jasmine, and begins to read your fortune, her words offering guidance and insight. | | Gunnthra is lying on her back, her pink hair adorned with a flower crown, while her torn bikini barely covers her, revealing her to be covered in cum. Tears stream down her face as she's surrounded by nude men engaging in various sexual acts. Laegjarn, with her dark skin and green-orange hair, wears a torn dark bikini top, showing her breasts also covered in cum. Her expression is a mix of anger and forced enjoyment as she receives oral sex. The scene takes place on a worn stone floor, emphasizing chaos and violation. | The men surround you, their hands exploring your body, their mouths leaving trails of wetness. You feel exposed, vulnerable, but a strange excitement courses through you. Gunnthra's sobs fill your ears, her delicate beauty contrasting with the roughness of the scene. Laegjarn's eyes meet yours, a silent plea in her gaze, and you realize the power you hold in this moment. The stone floor is cold beneath you, but your body burns with desire. | You stand in a lush garden, the sun warming your skin. Lucina, with her blue hair and determined eyes, leans in for a kiss, her touch gentle and full of unspoken promises. The sound of birds and the scent of flowers create a peaceful ambiance, and you feel a deep connection as you surrender to the moment. | | Sunday and Robin are engaged in sexual intercourse. Sunday, a male with long grey hair and yellow eyes, wears a white shirt and gloves. Robin, a female with long grey hair and blue eyes, wears a turquoise skirt with her top removed, exposing her breasts. Firefly is sketched in the corner, looking displeased. The scene is sketchily drawn, with a minimal white background, creating an intimate and raw atmosphere. | Sunday's hands glide over your body, his touch sending shivers down your spine. You run your fingers through his soft grey hair as Robin's kisses trail down your neck, her breasts brushing against your skin. The sketchy lines of the drawing seem to pulsate with the rhythm of your passion, Firefly's disapproving gaze only adding to the thrill. | In a serene garden, you lie with Robin, her grey hair cascading over her shoulders. Sunday, however, is nowhere to be seen. Robin's touch is gentle, her eyes filled with love, but you can't shake the feeling that something is amiss. The absence of Sunday's energetic presence leaves a void, and you find yourself longing for the complete trio. | * Loss: [GISTEmbedLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#gistembedloss) with these parameters: ```json {'guide': SentenceTransformer( (0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) (2): Normalize() ), 'temperature': 0.1} ``` ### Evaluation Dataset #### Unnamed Dataset * Size: 139 evaluation samples * Columns: anchor, positive, and negative * Approximate statistics based on the first 139 samples: | | anchor | positive | negative | |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------| | type | string | string | string | | details | | | | * Samples: | anchor | positive | negative | |:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | Saren from "Princess Connect!" is on a bed, topless with her blonde hair styled in double buns secured by a black bow. She's wearing a maid outfit, visibly nervous and sweating; her large breasts are exposed as she kneels with her hands raised. Her blue and white skirt is being lifted by Suzume, who stands behind her with a smug look, showcasing her brown hair in double buns and a pink bow. A dark-skinned man is partially visible, suggestively touching Saren, conveying a scene of sexual tension. The setting is an upscale bedroom with detailed decor, including a broken plate on the floor. The image captures intense emotions and dynamic movements highlighted by Japanese text visuals. | Saren's heart pounds as she kneels on the luxurious bed, her maid outfit a stark contrast to the broken plate on the floor. You witness her vulnerability, her large breasts heaving with each rapid breath. Suzume, with a mischievous glint in her eye, lifts Saren's skirt, exposing her even further. The dark-skinned man's hand on Saren's thigh sends a jolt through you; you can almost feel the electricity of their touch. The tension is thick, and you're captivated by the raw emotions playing out before you. | In a serene garden, you witness a different scene. A red-headed elf, her hair adorned with white flowers, sits beside a fountain, her green dress flowing gracefully. She's not nervous like Saren; instead, she's calm, her eyes closed in peaceful meditation. A gentle breeze stirs, and you feel a sense of tranquility as she opens her eyes, her gaze meeting yours with a serene smile, inviting you to join her in this moment of quiet bliss. | | Kamisato Ayaka and Lumine from Genshin Impact are depicted in an explicit yuri scene. Ayaka, with her long silver hair tied in a ponytail, is nude and her skin looks wet. She's performing oral sex on Lumine, who has short blonde hair. Lumine's expression varies from pleasure to relaxation, and both characters are nude, emphasizing their wet bodies and saliva. The background is minimal, focusing on the detailed and passionate interaction between the two. There are no texts in the image. | You feel Ayaka's soft, wet hair brush against your skin as she moves her head in a steady rhythm. Her lips and tongue work in perfect harmony, sending waves of pleasure through your body. You run your fingers through her silver locks, guiding her movements, feeling her passion. The sensation is overwhelming, and you can't help but moan, your eyes fluttering shut as you surrender to the ecstasy. | Lumine's fingers gently caress your face as she leans in, her blonde hair framing her face. She whispers sweet nothings, her breath hot against your ear, sending shivers down your spine. You feel her lips brush against yours, a soft kiss that ignites a fire within. As the kiss deepens, you can almost taste the forbidden fruit, a sweet temptation you can't resist. | | Irisviel von Einzbern, a girl with long white hair and red eyes, is depicted in a state of arousal on all fours, with her buttocks raised and upper body leaning forward. She is completely nude, displaying her large breasts with visible nipples and a flushed complexion. Her expression shows pained pleasure, and moisture covers her skin, suggesting sweat or other bodily fluids. A partially visible male figure's hand rest on her buttocks in a suggestive manner. The background is a blurred reddish-brown tone that suggests an indistinct interior space. Motion lines and sweat droplets enhance the scene, characteristic of anime style. Portions of the image are obscured by mosaic censorship. The atmosphere is sexually explicit, emphasizing their intimate interaction, highlighted by Irisviel's expression, body language, and the warmer color palette. | In a dimly lit chamber, you find yourself on a soft fur rug, the air heavy with anticipation. Irisviel, her white hair cascading down her back, kneels before you, her eyes locked on yours. Her body glistens with desire, and as she arches her back, you see the full splendor of her naked form. The warmth of her skin radiates, and when she leans forward, her breath caresses your skin, sending shivers of pleasure through your body. The man's hand on her thigh adds to the intensity, and you're drawn into a world of pure, unadulterated passion. | A serene beach at sunset sets the stage for a romantic encounter. A woman with flowing blonde hair and deep blue eyes stands before you, her body glistening with seawater. She wears a sheer white cover-up, hinting at the curves beneath. As she turns towards you, the sun highlights her profile, and her smile is both inviting and mysterious. The sound of the waves and the warm breeze create an atmosphere of sensual tranquility. | * Loss: [GISTEmbedLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#gistembedloss) with these parameters: ```json {'guide': SentenceTransformer( (0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) (2): Normalize() ), 'temperature': 0.1} ``` ### Training Hyperparameters #### Non-Default Hyperparameters - `eval_strategy`: steps - `per_device_train_batch_size`: 12 - `per_device_eval_batch_size`: 24 - `learning_rate`: 1e-05 - `weight_decay`: 0.01 - `warmup_ratio`: 0.1 - `fp16`: True - `gradient_checkpointing`: True - `batch_sampler`: no_duplicates #### All Hyperparameters
Click to expand - `overwrite_output_dir`: False - `do_predict`: False - `eval_strategy`: steps - `prediction_loss_only`: True - `per_device_train_batch_size`: 12 - `per_device_eval_batch_size`: 24 - `per_gpu_train_batch_size`: None - `per_gpu_eval_batch_size`: None - `gradient_accumulation_steps`: 1 - `eval_accumulation_steps`: None - `torch_empty_cache_steps`: None - `learning_rate`: 1e-05 - `weight_decay`: 0.01 - `adam_beta1`: 0.9 - `adam_beta2`: 0.999 - `adam_epsilon`: 1e-08 - `max_grad_norm`: 1.0 - `num_train_epochs`: 3 - `max_steps`: -1 - `lr_scheduler_type`: linear - `lr_scheduler_kwargs`: {} - `warmup_ratio`: 0.1 - `warmup_steps`: 0 - `log_level`: passive - `log_level_replica`: warning - `log_on_each_node`: True - `logging_nan_inf_filter`: True - `save_safetensors`: True - `save_on_each_node`: False - `save_only_model`: False - `restore_callback_states_from_checkpoint`: False - `no_cuda`: False - `use_cpu`: False - `use_mps_device`: False - `seed`: 42 - `data_seed`: None - `jit_mode_eval`: False - `use_ipex`: False - `bf16`: False - `fp16`: True - `fp16_opt_level`: O1 - `half_precision_backend`: auto - `bf16_full_eval`: False - `fp16_full_eval`: False - `tf32`: None - `local_rank`: 0 - `ddp_backend`: None - `tpu_num_cores`: None - `tpu_metrics_debug`: False - `debug`: [] - `dataloader_drop_last`: False - `dataloader_num_workers`: 0 - `dataloader_prefetch_factor`: None - `past_index`: -1 - `disable_tqdm`: False - `remove_unused_columns`: True - `label_names`: None - `load_best_model_at_end`: False - `ignore_data_skip`: False - `fsdp`: [] - `fsdp_min_num_params`: 0 - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False} - `fsdp_transformer_layer_cls_to_wrap`: None - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None} - `deepspeed`: None - `label_smoothing_factor`: 0.0 - `optim`: adamw_torch - `optim_args`: None - `adafactor`: False - `group_by_length`: False - `length_column_name`: length - `ddp_find_unused_parameters`: None - `ddp_bucket_cap_mb`: None - `ddp_broadcast_buffers`: False - `dataloader_pin_memory`: True - `dataloader_persistent_workers`: False - `skip_memory_metrics`: True - `use_legacy_prediction_loop`: False - `push_to_hub`: False - `resume_from_checkpoint`: None - `hub_model_id`: None - `hub_strategy`: every_save - `hub_private_repo`: None - `hub_always_push`: False - `gradient_checkpointing`: True - `gradient_checkpointing_kwargs`: None - `include_inputs_for_metrics`: False - `include_for_metrics`: [] - `eval_do_concat_batches`: True - `fp16_backend`: auto - `push_to_hub_model_id`: None - `push_to_hub_organization`: None - `mp_parameters`: - `auto_find_batch_size`: False - `full_determinism`: False - `torchdynamo`: None - `ray_scope`: last - `ddp_timeout`: 1800 - `torch_compile`: False - `torch_compile_backend`: None - `torch_compile_mode`: None - `dispatch_batches`: None - `split_batches`: None - `include_tokens_per_second`: False - `include_num_input_tokens_seen`: False - `neftune_noise_alpha`: None - `optim_target_modules`: None - `batch_eval_metrics`: False - `eval_on_start`: False - `use_liger_kernel`: False - `eval_use_gather_object`: False - `average_tokens_across_devices`: False - `prompts`: None - `batch_sampler`: no_duplicates - `multi_dataset_batch_sampler`: proportional
### Training Logs | Epoch | Step | Validation Loss | |:------:|:----:|:---------------:| | 2.4038 | 250 | 0.0846 | | 3.0 | 312 | 0.0840 | | 2.4038 | 250 | 0.0724 | | 3.0 | 312 | 0.0720 | | 2.4038 | 250 | 0.0642 | | 3.0 | 312 | 0.0639 | ### Framework Versions - Python: 3.10.6 - Sentence Transformers: 3.3.1 - Transformers: 4.48.0 - PyTorch: 2.5.1+cu121 - Accelerate: 1.0.1 - Datasets: 3.1.0 - Tokenizers: 0.21.0 ## Citation ### BibTeX #### Sentence Transformers ```bibtex @inproceedings{reimers-2019-sentence-bert, title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks", author = "Reimers, Nils and Gurevych, Iryna", booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing", month = "11", year = "2019", publisher = "Association for Computational Linguistics", url = "https://arxiv.org/abs/1908.10084", } ``` #### GISTEmbedLoss ```bibtex @misc{solatorio2024gistembed, title={GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning}, author={Aivin V. Solatorio}, year={2024}, eprint={2402.16829}, archivePrefix={arXiv}, primaryClass={cs.LG} } ```