Add new SentenceTransformer model

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+    "word_embedding_dimension": 384,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
+    "pooling_mode_max_tokens": false,
+    "pooling_mode_mean_sqrt_len_tokens": false,
+    "pooling_mode_weightedmean_tokens": false,
+    "pooling_mode_lasttoken": false,
+    "include_prompt": true
+}

README.md

@@ -0,0 +1,704 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- dense
+- generated_from_trainer
+- dataset_size:710769
+- loss:DenoisingAutoEncoderLoss
+base_model: sentence-transformers/all-MiniLM-L6-v2
+widget:
+- source_sentence: I'll as possible I in massive spiral a back . My father me I back
+    through fault own currently in around loans further in with Hire I my father .
+    all all (£6000 through girlfriend our own to . She has is 3 have on together due
+    June have around disposable eachn't work care andn't be able years (until enough
+    credit, all are showing we be . will get child will rise here all the are correct
+    should £1200 each month . are looking renting time the being a in rent able and
+    get food.
+  sentences:
+  - I can sometimes see it happening before it's escalated too far and smooth the
+    situation over, but it's really hard sometimes while she's blowing up on me and
+    it feels very personal. It can take her hours to fully come back from an episode,
+    and after it's happened she feels very embarrassed. It really impacts her self
+    esteem as it's continued and impacted her relationships over the years. She often
+    says "I don't want this, I didn't ask for this"  I've seen it happen as frequently
+    as weekly, but a couple of times of month is more common. Being in crowds can
+    more easily trigger it but not always, and she can be fine in them at other times
+    as well. She has a very hard time describing the actual feeling often saying she
+    doesn't have the proper words for it, but she describes it as being overwhelmed
+    and lost, sometimes a dark void that she's swirling down into, and she can't figure
+    out how to get out of. She often doesn't see it coming, and by the time it's happening
+    it's often too late or difficult to stop. She says she feels like she missed learning
+    how to cope with these everyday normal situations as a kid, and now she can't.
+    Sometimes she can see it happening though and can remove herself from the situation.
+    She's seen counsellors about it before and they've all basically been telling
+    her she needs to take better care of herself. Get a full nights sleep, eat properly
+    etc.
+  - My Shift Manager is extremely toxic. Every shift i close the store with him he
+    takes my mistakes and shoves them down my throat. I pass him the keys but miss
+    it's a 12 minute event of making fun of me, i say something off he takes an entire
+    hour just poking fun at me. There are a lot of instances but my memory is not
+    very good, i can't list them  He was talking to a bunch of coworkers in the back
+    about how he used to bully this kid with autism that he reported to the point
+    where he's afraid he'll shoot up the store. He admitted that he's bullying me
+    t o a couple coworkers while i was in the room today and He told me about how
+    he makes the environment toxic to push out people he doesn't like out. I'm his
+    next victim because of my anxiety disorder and my ADHD makes me not fit in to
+    this very famously clique environment (the store is known in the district for
+    this and for being the asshole store) and the store manager doesn't really care.
+  - Advice on Finance and Renting I'll try keep this as short as possible. I'm in
+    a massive rut, I got myself into the loan debt spiral a few years back. My father
+    helped me clear the majority and I stupidly got back into debt through no other
+    fault than my own. I am currently in around £10,000 debt with Personal loans and
+    a further £6000 in debt with Hire Purchase. I owe my father £6000. So all in all
+    around £22,000 debt (only £6000 is secured debt through HP). Me and my girlfriend
+    desperately need our own place to live. She has a child who is 3 and we have another
+    child on the way together (due June). I have around £450/£500 disposable income
+    each month. My partner can't work due to child care and won't be able too for
+    another few years (properly) until our other child to be is here and old enough.
+    We have looked at various Universal credit calculators, all of which are showing
+    we should be entitled too £600 per month UC. On top of this we will get £82 a
+    month in child maintenance, this will rise when our girl is here. If all the calculators
+    are correct we should have an income of £1200 each month. We are looking at renting
+    privately due to the waiting time of the council being a joke. We can realistically
+    afford £495/500 per month in rent and be able to pay bills and get food etc.
+- source_sentence: life Ok so .'m on mobile 2 have autism formatting sucks so I tired
+    . I'm done I had nothing literally my mom in entitledparents . l to buy laptop
+    to find my was . I never anything's straw that broke . my a She gas many times
+    cant count now the of she the landlord . I'm the . So my her out instead brother
+    is . am just the abuse claiming . I'm . goodbye wrote my . I through and have
+    had
+  sentences:
+  - My life is hell Ok so 1. I'm on mobile 2 l have autism. If my formatting sucks
+    so be it.   I'm tired of living. I'm done. I have had nothing good in my life.
+    I literally lost everything exept 1 suitcase. I posted my battle with my mom in
+    entitledparents. My birthday is next week and l tried to buy a laptop to find
+    my ebay was suspended.  I never did anything that's the straw that broke the cameks
+    back.  Now my mom is a narcissist. She gas abandoned me so many times l cant count.
+    I am now on the verge of being homeless because she's scared the landlord is going
+    to kick her out. I'm on the lease too. So my brother and her are kicking me out
+    instead. My brother is her favorite.  I am just tired of the abuse and her claiming
+    l am. I'm done. So goodbye life.  Oh and l wrote my own obituary.  I'm through
+    and l have had enough.
+  - The joy in me is just no longer there. Whenever I talk about this, no one can
+    relate to the unrest I feel about being left behind my by peers and not being
+    able to do anything about it. Everyone says that it's a natural thing to be conscripted
+    and I should just suck it up. Living a life like this, confined by the law even
+    when I did nothing wrong. Getting 2 years of my life stolen like this. Apparently
+    it's something that is naturally accepted in my country. I am well into my second
+    year with only 5 months left of the clock. People tell me that I should be happy
+    because it's ending soon. On one hand I am, but on the other, that just means
+    that I have already wasted 1 and a half years of my life. And there is nothing
+    I can do to stop them from stealing another 5 more months of my life. I am filled
+    with self doubt and self loathing. I hate myself for not being able to do the
+    things that actually matter to me. I hate that I didn't start learning to draw
+    earlier. If I knew I wanted to walk this path, I would probably have picked a
+    different path and would have probably been out there somewhere hard at work using
+    every Fibre of my being to work for something that I actually care about. But
+    now, its too late. I have lost most of my drive and tolerance for anything.
+  - Suicide grants agency Thinking about killing myself a lot lately, and it’s made
+    me realize how comforting it is to know I get to choose when to stop it all.
+- source_sentence: So s . great motivated wash brush teeth . Go bed get and over Weekends
+    all, hard out bed get shower brush teeth, I stay late sleep I super depressed
+    I t of for a of this week and just feel like totally shit . ’ if anyone any or
+    has too please comment I m so
+  sentences:
+  - Suspension of overnight visitation due to lack of bed/room? Attorney required?
+    [PA] Hi everyone, recently I posted a thread about my stepdaughter being forced
+    to sleep on a futon with her grandmother every night during overnight visitation
+    with her father because her father took her bed and room (dad lives with his parents
+    and apparently decided he didn't like the basement anymore.) She has not had a
+    bedroom or a bed of her own for at least a couple of months and is forced to change
+    in the living room in front of everyone - she has no private space. She has repeatedly
+    requested a bed and room and has been told no. She has her own cell phone that
+    is limited to calls/texts (due to her father's mental issues) and we told her
+    she can call us to come get her if she doesn't want to sleep with grandma anymore.
+    Apparently, during the second-to-last sleepover, she told her dad she wanted to
+    come home and he told her no, and told her his mom (grandma) was buying her a
+    bed and it'll be here next week. So, she stayed. ​  Well, next week
+    was last night, and surprise - still no bed. She was told that the bed was "supposed
+    to be delivered the other day but the truck never showed up." So, she was stuck
+    on the futon again with grandma on the porch. We asked her why she didn't call
+    us, and she said she did not want to upset her father.
+  - Squatting with heel of hand on the bar I find it far more comfortable to squat
+    with the heel of my hand on the bar, with basically the outside three fingers
+    holding the bar. It puts far less pressure on my wrists when I do this.  I just
+    want to know - is there anything inherently wrong with doing this?  And as an
+    addendum, I have heard lots of different advice about how far your elbows travel
+    behind your back - if they remain the same for the whole squat does it matter?
+  - Weekend depression!? Please read So here’s my issue. I feel great, motivated,
+    and happy. I wash my face twice a day and brush my teeth. Go to bed and get good
+    sleep and over all am more disciplined.  Weekends I lose all motivation to live,
+    it’s hard to get out of bed I can’t get myself to shower or brush my teeth face,
+    I stay up late get awful sleep. I over all feel super depressed. I usually don’t
+    get out of bed for much a lot of times. this will bleed into the week and I just
+    feel like totally shit.  It’s a viciously loop if anyone has any advice or has
+    this too please leave a comment I’m so confused by this.
+- source_sentence: It takes everything've to resist the urge break the and hurt When
+    having BPD day'm ready rip into my to my a dish, light and then or claw eyes out
+    anyone do banshee would last a minute a breath . Whenever get my core abandon
+    all and I've held back years Of I ca I would feel horrible on this impulse 5150
+    hold would relish doing whatever I felt like afterward and feel . are intense
+    to the least . I side me hear on and another of me that to the when I
+  sentences:
+  - Doctor is going to call in a prescription for Brand Ritalin for me (dispense as
+    written). Is there a chance any pharmacies will have brand in stock? Hello!  I've
+    been taking the Mallinckrodt generic ritalin for 2 months.  My doctor wants me
+    to try the brand name.  He's going to electronically submit the script w/ "Dispense
+    as written".    Where is the best place for him to call it in?  I asked the Walgreens
+    I've been going to and they do not have the brand.  Is it likely any other pharmacies
+    will have brand in stock?  Or if my doctor submits it electronically to Walgreens
+    should they have it the next day?      I've used a few pharmacies in my area (California)
+    and I'll be paying out of pocket (+goodrx) so it wouldn't be a problem to have
+    him call it in to CVS, Costco, Rite Aid, or Albertsons.  I just don't want to
+    run out and if it takes more than a day or two I may.    If anyone could suggest
+    the best way to do this to assure that I get the brand as efficiently as possible
+    I'd very much appreciate it!!!  I hate calling to talk about this on the phone
+    as I know many pharmacies are weary about talking about stimulants unless you
+    come in.
+  - I’m exhausted and can barely sleep. I don’t know what to do. I’m supposed to go
+    to hospital if I get too bad but I’m scared when forced a meal. My mum presented
+    me with celery and carrot recently and I panicked and tried making my own portions
+    and ended up throwing it away. At hospital I went for another reason recently
+    and ate up the whole meal I was given (first meal since last year). I felt guilty
+    and tried restriction the next day. I am on waiting list for some public therapy
+    but because I’m in NZ it’s limited for support.. someone told me 3 month wait.
+    Can’t afford private. Dr keeps telling me to take ensure but I’m vegan so can’t.
+    I bought some of my own vegan powder but refuse to take it because it’s soy based
+    but because it’s sweet I’m craving it badly. Help me.. please
+  - It takes everything I've got to resist the urge to break everything in the house
+    and not hurt people When I'm having a BPD day, I'm ready to rip into whatever
+    is in my way to get my stresses out. I want to kill the tv with a baseball bat,
+    break every dish,mug, light bulb, and then bite anyone or claw the eyes out of
+    anyone who tries to stop me.    I want to do a full banshee scream that would
+    last a full minute without taking a breath. Whenever I get angry to my core, I
+    want to do this all with abandon and unleash all the rage and pissed off energy
+    I've held back over the years.  Of course, I can't. I would feel horrible if I
+    acted on this impulse and could possibly end up in a 5150 hold situation. In the
+    moment, I would relish the freedom of doing whatever the hell I felt like, but
+    afterward I would be an apologetic wreck and feel like shit.  My emotions are
+    intense to say the least. I have a side of me that cries when I hear depressing
+    stories on the news, and another side of me that wants to rip the world apart
+    when I'm angry.
+- source_sentence: I think the . Obviously find the She of.
+  sentences:
+  - Someone tricked me into buying phones for them So I met this guy on Craigslist
+    offering 300$ to people who would go into phone stores buy him the phones and
+    he would clear the line so they wouldn’t get charged. He said he was a manager
+    for Verizon and has the power to do this. Me being a broke college student in
+    need of desperate money for paying tuition bought into it. Today I got an AT&T
+    bill saying I have to pay 175 dollars before the 20th which was when I needed
+    to pay my bills for next semester. I don’t know how to report this man, or who
+    will be able to help me. He blocked my number, but I have a picture of his debit
+    card number and the first name on it. He’s also been on surveillance camera at
+    target, and I know the exact date and time frame.  What I need to know is how
+    I can resolve this issue or where to start, I was so stupid.
+  - Yeah I think at the time she was 13/14. Obviously didn't find out at the time.
+    She was also sexualy assaulted by a member of the Murderdolls as well.
+  - Index Fund Investment I am 22, and I have approximately 160k net worth.  Currently,
+    I have close to 90k in Ally savings earning close to 2.25% interest. I am looking
+    to invest in index funds - Schwab 1000 in particular. Is it wise to invest about
+    30k for starters in it? I am a total beginner at investing. Any suggesting on
+    how to better distribute the money? Thanks!
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
+
+# SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) <!-- at revision c9745ed1d9f207416be6d2e6f8de32d1f16199bf -->
+- **Maximum Sequence Length:** 256 tokens
+- **Output Dimensionality:** 384 dimensions
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'BertModel'})
+  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("FritzStack/tsdae-model")
+# Run inference
+sentences = [
+    'I think the . Obviously find the She of.',
+    "Yeah I think at the time she was 13/14. Obviously didn't find out at the time. She was also sexualy assaulted by a member of the Murderdolls as well.",
+    'Someone tricked me into buying phones for them So I met this guy on Craigslist offering 300$ to people who would go into phone stores buy him the phones and he would clear the line so they wouldn’t get charged. He said he was a manager for Verizon and has the power to do this. Me being a broke college student in need of desperate money for paying tuition bought into it. Today I got an AT&amp;T bill saying I have to pay 175 dollars before the 20th which was when I needed to pay my bills for next semester. I don’t know how to report this man, or who will be able to help me. He blocked my number, but I have a picture of his debit card number and the first name on it. He’s also been on surveillance camera at target, and I know the exact date and time frame.  What I need to know is how I can resolve this issue or where to start, I was so stupid.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 384]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities)
+# tensor([[ 1.0000,  0.5130, -0.0890],
+#         [ 0.5130,  1.0000,  0.0377],
+#         [-0.0890,  0.0377,  1.0000]])
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### Unnamed Dataset
+
+* Size: 710,769 training samples
+* Columns: <code>sentence_0</code> and <code>sentence_1</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | sentence_0                                                                         | sentence_1                                                                          |
+  |:--------|:-----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
+  | type    | string                                                                             | string                                                                              |
+  | details | <ul><li>min: 3 tokens</li><li>mean: 67.33 tokens</li><li>max: 212 tokens</li></ul> | <ul><li>min: 3 tokens</li><li>mean: 151.71 tokens</li><li>max: 256 tokens</li></ul> |
+* Samples:
+  | sentence_0                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
+  |:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>my neighbor his can where If not here! Me and boyfriend] in nicer area city . was unoccupied awhile had a couple next door paper thin a on . We a move week or ago with & lt They've lot of course happens you, the are so The night we a lot of crying and was . hours guy screaming the girl very then stops she leaves screams constantly is and about Tonight yelling and heard very yelp then begging not to hurt . and on their door and one answered I've only ever them while walking my dog seeing the three of going into</code> | <code>Pretty sure my neighbor is hitting his partner. What can I do? (Unsure where this belongs. If not here, please direct me!)  Me [29f] and my boyfriend [23m] live in a townhouse in a nicer area of our city. The unit next to us was unoccupied for awhile, and we recently had a couple move in next door. The walls here are paper thin so we can hear a lot that goes on. We had a couple move in a week or so ago with their &lt;4yo daughter. They've been making a lot of noise, but of course that happens when you move and again, the walls are so thin. The other night we could hear a lot of yelling and crying and we assumed it was the tv. After several hours we realized it was the guy screaming at the girl. He has a very distinctive voice. Since then, the yelling only stops when she leaves. He screams constantly about her losing something, asking her where it is, and about her male friends. Tonight he started yelling again and we heard a very clear smack then yelp then bawling and begging him not t...</code> |
+  | <code>I'm being excluded friends butn't want believe</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      | <code>Or maybe I'm being excluded by my friends but don't want to believe it.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
+  | <code>Someone tricked me buying for them I met this guy Craigslist offering would go into phone phones clear the wouldn ’ t charged Verizon and has to . being college student for into . Today I AT amp; I to pay 20th which I needed I don ’ how man, or be to me He blocked my number of card and ’ s been on surveillance at, the exact What I to know I resolve this or where to start I so.</code>                                                                                                                                         | <code>Someone tricked me into buying phones for them So I met this guy on Craigslist offering 300$ to people who would go into phone stores buy him the phones and he would clear the line so they wouldn’t get charged. He said he was a manager for Verizon and has the power to do this. Me being a broke college student in need of desperate money for paying tuition bought into it. Today I got an AT&amp;T bill saying I have to pay 175 dollars before the 20th which was when I needed to pay my bills for next semester. I don’t know how to report this man, or who will be able to help me. He blocked my number, but I have a picture of his debit card number and the first name on it. He’s also been on surveillance camera at target, and I know the exact date and time frame.  What I need to know is how I can resolve this issue or where to start, I was so stupid.</code>                                                                                                                                                        |
+* Loss: [<code>DenoisingAutoEncoderLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#denoisingautoencoderloss)
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `num_train_epochs`: 1
+- `multi_dataset_batch_sampler`: round_robin
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: no
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 8
+- `per_device_eval_batch_size`: 8
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 1
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 5e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1
+- `num_train_epochs`: 1
+- `max_steps`: -1
+- `lr_scheduler_type`: linear
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.0
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `bf16`: False
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: False
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `parallelism_config`: None
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch_fused
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `project`: huggingface
+- `trackio_space_id`: trackio
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `hub_revision`: None
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: no
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `liger_kernel_config`: None
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: True
+- `prompts`: None
+- `batch_sampler`: batch_sampler
+- `multi_dataset_batch_sampler`: round_robin
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Training Logs
+<details><summary>Click to expand</summary>
+
+| Epoch  | Step  | Training Loss |
+|:------:|:-----:|:-------------:|
+| 0.0056 | 500   | 5.7586        |
+| 0.0113 | 1000  | 4.9642        |
+| 0.0169 | 1500  | 4.7484        |
+| 0.0225 | 2000  | 4.6033        |
+| 0.0281 | 2500  | 4.5275        |
+| 0.0338 | 3000  | 4.4556        |
+| 0.0394 | 3500  | 4.3778        |
+| 0.0450 | 4000  | 4.3618        |
+| 0.0506 | 4500  | 4.3195        |
+| 0.0563 | 5000  | 4.294         |
+| 0.0619 | 5500  | 4.2533        |
+| 0.0675 | 6000  | 4.2338        |
+| 0.0732 | 6500  | 4.2144        |
+| 0.0788 | 7000  | 4.1689        |
+| 0.0844 | 7500  | 4.1655        |
+| 0.0900 | 8000  | 4.1441        |
+| 0.0957 | 8500  | 4.1122        |
+| 0.1013 | 9000  | 4.0953        |
+| 0.1069 | 9500  | 4.0657        |
+| 0.1126 | 10000 | 4.0832        |
+| 0.1182 | 10500 | 4.0554        |
+| 0.1238 | 11000 | 4.0392        |
+| 0.1294 | 11500 | 4.0221        |
+| 0.1351 | 12000 | 4.0012        |
+| 0.1407 | 12500 | 4.0086        |
+| 0.1463 | 13000 | 3.9904        |
+| 0.1519 | 13500 | 3.9914        |
+| 0.1576 | 14000 | 3.9727        |
+| 0.1632 | 14500 | 3.9604        |
+| 0.1688 | 15000 | 3.939         |
+| 0.1745 | 15500 | 3.9351        |
+| 0.1801 | 16000 | 3.9355        |
+| 0.1857 | 16500 | 3.9388        |
+| 0.1913 | 17000 | 3.9078        |
+| 0.1970 | 17500 | 3.9127        |
+| 0.2026 | 18000 | 3.9082        |
+| 0.2082 | 18500 | 3.8932        |
+| 0.2139 | 19000 | 3.9085        |
+| 0.2195 | 19500 | 3.8767        |
+| 0.2251 | 20000 | 3.8721        |
+| 0.2307 | 20500 | 3.8628        |
+| 0.2364 | 21000 | 3.8671        |
+| 0.2420 | 21500 | 3.8577        |
+| 0.2476 | 22000 | 3.8536        |
+| 0.2532 | 22500 | 3.8385        |
+| 0.2589 | 23000 | 3.8394        |
+| 0.2645 | 23500 | 3.8452        |
+| 0.2701 | 24000 | 3.831         |
+| 0.2758 | 24500 | 3.8192        |
+| 0.2814 | 25000 | 3.8087        |
+| 0.2870 | 25500 | 3.8163        |
+| 0.2926 | 26000 | 3.8078        |
+| 0.2983 | 26500 | 3.8067        |
+| 0.3039 | 27000 | 3.7879        |
+| 0.3095 | 27500 | 3.7973        |
+| 0.3151 | 28000 | 3.7763        |
+| 0.3208 | 28500 | 3.777         |
+| 0.3264 | 29000 | 3.7649        |
+| 0.3320 | 29500 | 3.7616        |
+| 0.3377 | 30000 | 3.7713        |
+| 0.3433 | 30500 | 3.7623        |
+| 0.3489 | 31000 | 3.757         |
+| 0.3545 | 31500 | 3.7585        |
+| 0.3602 | 32000 | 3.7501        |
+| 0.3658 | 32500 | 3.7373        |
+| 0.3714 | 33000 | 3.7425        |
+| 0.3771 | 33500 | 3.7402        |
+| 0.3827 | 34000 | 3.7235        |
+| 0.3883 | 34500 | 3.7277        |
+| 0.3939 | 35000 | 3.7434        |
+| 0.3996 | 35500 | 3.7269        |
+| 0.4052 | 36000 | 3.7229        |
+| 0.4108 | 36500 | 3.7098        |
+| 0.4164 | 37000 | 3.7204        |
+| 0.4221 | 37500 | 3.7012        |
+| 0.4277 | 38000 | 3.6933        |
+| 0.4333 | 38500 | 3.6954        |
+| 0.4390 | 39000 | 3.7132        |
+| 0.4446 | 39500 | 3.704         |
+| 0.4502 | 40000 | 3.6975        |
+| 0.4558 | 40500 | 3.6978        |
+| 0.4615 | 41000 | 3.6937        |
+| 0.4671 | 41500 | 3.6813        |
+| 0.4727 | 42000 | 3.6754        |
+| 0.4784 | 42500 | 3.6883        |
+| 0.4840 | 43000 | 3.6704        |
+| 0.4896 | 43500 | 3.6816        |
+| 0.4952 | 44000 | 3.6738        |
+| 0.5009 | 44500 | 3.6783        |
+| 0.5065 | 45000 | 3.6761        |
+| 0.5121 | 45500 | 3.6672        |
+| 0.5177 | 46000 | 3.6688        |
+| 0.5234 | 46500 | 3.6523        |
+| 0.5290 | 47000 | 3.6683        |
+| 0.5346 | 47500 | 3.6563        |
+| 0.5403 | 48000 | 3.6557        |
+| 0.5459 | 48500 | 3.6447        |
+| 0.5515 | 49000 | 3.6393        |
+| 0.5571 | 49500 | 3.6423        |
+| 0.5628 | 50000 | 3.6384        |
+| 0.5684 | 50500 | 3.6424        |
+| 0.5740 | 51000 | 3.6263        |
+| 0.5796 | 51500 | 3.6067        |
+| 0.5853 | 52000 | 3.6177        |
+| 0.5909 | 52500 | 3.6306        |
+| 0.5965 | 53000 | 3.6242        |
+| 0.6022 | 53500 | 3.6087        |
+| 0.6078 | 54000 | 3.6164        |
+| 0.6134 | 54500 | 3.614         |
+| 0.6190 | 55000 | 3.62          |
+| 0.6247 | 55500 | 3.6256        |
+| 0.6303 | 56000 | 3.5988        |
+| 0.6359 | 56500 | 3.6065        |
+| 0.6416 | 57000 | 3.5924        |
+| 0.6472 | 57500 | 3.5968        |
+| 0.6528 | 58000 | 3.6105        |
+| 0.6584 | 58500 | 3.5961        |
+| 0.6641 | 59000 | 3.6007        |
+| 0.6697 | 59500 | 3.5943        |
+| 0.6753 | 60000 | 3.5876        |
+| 0.6809 | 60500 | 3.587         |
+| 0.6866 | 61000 | 3.5938        |
+| 0.6922 | 61500 | 3.5668        |
+| 0.6978 | 62000 | 3.5824        |
+| 0.7035 | 62500 | 3.5778        |
+| 0.7091 | 63000 | 3.5811        |
+| 0.7147 | 63500 | 3.5731        |
+| 0.7203 | 64000 | 3.5757        |
+| 0.7260 | 64500 | 3.5822        |
+| 0.7316 | 65000 | 3.5778        |
+| 0.7372 | 65500 | 3.5745        |
+| 0.7429 | 66000 | 3.5822        |
+| 0.7485 | 66500 | 3.5645        |
+| 0.7541 | 67000 | 3.5589        |
+| 0.7597 | 67500 | 3.5632        |
+| 0.7654 | 68000 | 3.5631        |
+| 0.7710 | 68500 | 3.5657        |
+| 0.7766 | 69000 | 3.5438        |
+| 0.7822 | 69500 | 3.5634        |
+| 0.7879 | 70000 | 3.5421        |
+| 0.7935 | 70500 | 3.5393        |
+| 0.7991 | 71000 | 3.5547        |
+| 0.8048 | 71500 | 3.5449        |
+| 0.8104 | 72000 | 3.5383        |
+| 0.8160 | 72500 | 3.5301        |
+| 0.8216 | 73000 | 3.5402        |
+| 0.8273 | 73500 | 3.5333        |
+| 0.8329 | 74000 | 3.5483        |
+| 0.8385 | 74500 | 3.5274        |
+| 0.8441 | 75000 | 3.5353        |
+| 0.8498 | 75500 | 3.5266        |
+| 0.8554 | 76000 | 3.5152        |
+| 0.8610 | 76500 | 3.5273        |
+| 0.8667 | 77000 | 3.5428        |
+| 0.8723 | 77500 | 3.5295        |
+| 0.8779 | 78000 | 3.5208        |
+| 0.8835 | 78500 | 3.519         |
+| 0.8892 | 79000 | 3.5361        |
+| 0.8948 | 79500 | 3.5256        |
+| 0.9004 | 80000 | 3.5295        |
+| 0.9061 | 80500 | 3.5054        |
+| 0.9117 | 81000 | 3.5179        |
+| 0.9173 | 81500 | 3.5154        |
+| 0.9229 | 82000 | 3.5151        |
+| 0.9286 | 82500 | 3.511         |
+| 0.9342 | 83000 | 3.5063        |
+| 0.9398 | 83500 | 3.5079        |
+| 0.9454 | 84000 | 3.5035        |
+| 0.9511 | 84500 | 3.5088        |
+| 0.9567 | 85000 | 3.4858        |
+| 0.9623 | 85500 | 3.4907        |
+| 0.9680 | 86000 | 3.4935        |
+| 0.9736 | 86500 | 3.4881        |
+| 0.9792 | 87000 | 3.4901        |
+| 0.9848 | 87500 | 3.5017        |
+| 0.9905 | 88000 | 3.4993        |
+| 0.9961 | 88500 | 3.4733        |
+
+</details>
+
+### Framework Versions
+- Python: 3.12.12
+- Sentence Transformers: 5.1.2
+- Transformers: 4.57.1
+- PyTorch: 2.8.0+cu126
+- Accelerate: 1.11.0
+- Datasets: 4.0.0
+- Tokenizers: 0.22.1
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### DenoisingAutoEncoderLoss
+```bibtex
+@inproceedings{wang-2021-TSDAE,
+    title = "TSDAE: Using Transformer-based Sequential Denoising Auto-Encoderfor Unsupervised Sentence Embedding Learning",
+    author = "Wang, Kexin and Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2021",
+    month = nov,
+    year = "2021",
+    address = "Punta Cana, Dominican Republic",
+    publisher = "Association for Computational Linguistics",
+    pages = "671--688",
+    url = "https://arxiv.org/abs/2104.06979",
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,25 @@
+{
+  "architectures": [
+    "BertModel"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "classifier_dropout": null,
+  "dtype": "float32",
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 384,
+  "initializer_range": 0.02,
+  "intermediate_size": 1536,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 6,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "transformers_version": "4.57.1",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 30522
+}

config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "__version__": {
+    "sentence_transformers": "5.1.2",
+    "transformers": "4.57.1",
+    "pytorch": "2.8.0+cu126"
+  },
+  "model_type": "SentenceTransformer",
+  "prompts": {
+    "query": "",
+    "document": ""
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e15ffc1ac620c4e19e4594a42710bc72ebbfda6ce7a36b94d5831fe53061506
+size 90864192

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+    "max_seq_length": 256,
+    "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,65 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": false,
+  "cls_token": "[CLS]",
+  "do_basic_tokenize": true,
+  "do_lower_case": true,
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "max_length": 128,
+  "model_max_length": 256,
+  "never_split": null,
+  "pad_to_multiple_of": null,
+  "pad_token": "[PAD]",
+  "pad_token_type_id": 0,
+  "padding_side": "right",
+  "sep_token": "[SEP]",
+  "stride": 0,
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "truncation_side": "right",
+  "truncation_strategy": "longest_first",
+  "unk_token": "[UNK]"
+}