Add new SentenceTransformer model

README.md

@@ -12,50 +12,53 @@ tags:
 - retrieval
 - reranking
 - generated_from_trainer
-- dataset_size:1451941
-- loss:MultipleNegativesRankingLoss
+- dataset_size:3119809
+- loss:ArcFaceInBatchLoss
 base_model: Alibaba-NLP/gte-modernbert-base
 widget:
-- source_sentence: Gocharya ji authored Krishna Cahrit Manas in the poetic form describing
-    about the full life of Lord Krishna ( from birth to Nirvana ) .
+- source_sentence: Hayley Vaughan portrayed Ripa on the ABC daytime soap opera , ``
+    All My Children `` , between 1990 and 2002 .
   sentences:
-  - 'Q: Can I buy coverage for prescription drugs right away?'
-  - Krishna Cahrit Manas in poetic form , describing the full life of Lord Krishna
-    ( from birth to nirvana ) , wrote Gocharya ji .
-  - Baron played actress Violet Carson who portrayed Ena Sharples in the soap .
-- source_sentence: The Kilkenny line only reached Maryborough in 1867 .
+  - Traxxpad is a music application for Sony 's PlayStation Portable published by
+    Definitive Studios and developed by Eidos Interactive .
+  - Between 1990 and 2002 , Hayley Vaughan Ripa portrayed in the ABC soap opera ``
+    All My Children `` .
+  - Between 1990 and 2002 , Ripa Hayley portrayed Vaughan in the ABC soap opera ``
+    All My Children `` .
+- source_sentence: Olivella monilifera is a species of dwarf sea snail , small gastropod
+    mollusk in the family Olivellidae , the marine olives .
   sentences:
-  - It was also known formerly as ' Crotto ' .
-  - The line from Maryborough only reached Kilkenny in 1867 .
-  - The line from Kilkenny only reached Maryborough in 1867 .
-- source_sentence: Tokelau International Netball Team represents Tokelau in the national
-    netball .
+  - Olivella monilifera is a species of the dwarf - sea snail , small gastropod mollusk
+    in the Olivellidae family , the marine olives .
+  - He was cut by the Browns after being signed by the Bills in 2013 . He was later
+    released .
+  - Olivella monilifera is a kind of sea snail , marine gastropod mollusk in the Olivellidae
+    family , the dwarf olives .
+- source_sentence: Hayashi said that Mackey `` is a sort of `` of the original model
+    for Tenchi .
   sentences:
-  - Ernest Dewey Albinson ( 1898 in Minneapolis , Minnesota - 1971 in Mexico ) was
-    an American artist .
-  - The Tokelau national netball team represents Tokelau in international netball
-    .
-  - The Tokelau international netball team represents Tokelau in national netball
-    .
-- source_sentence: The real number is called the `` imaginary part `` of the real
-    number ; the real number is called the `` complex part `` of .
+  - In the summer of 2009 , Ellick shot a documentary about Malala Yousafzai .
+  - Hayashi said that Mackey is `` sort of `` the original model for Tenchi .
+  - Mackey said that Hayashi is `` sort of `` the original model for Tenchi .
+- source_sentence: Much of the film was shot on location in Los Angeles and in nearby
+    Burbank and Glendale .
   sentences:
-  - The school board consists of Robbie Sanders , Bryan Richards , Linda Fullingim
-    , Lori Lambert , & Kelly Teague .
-  - Which web design company has the best templates?
-  - The real number is called the `` imaginary part `` of the real number , the real
-    number of `` complex part `` of .
-- source_sentence: All For You was the third and last single of Kate Ryan 's third
-    album `` Alive `` .
+  - Much of the film was shot on location in Los Angeles and in nearby Burbank and
+    Glendale .
+  - Much of the film was shot on site in Burbank and Glendale and in the nearby Los
+    Angeles .
+  - Traxxpad is a music application for the Sony PlayStation Portable developed by
+    the Definitive Studios and published by Eidos Interactive .
+- source_sentence: According to him , the earth is the carrier of his artistic work
+    , which is only integrated into the creative process by minimal changes .
   sentences:
-  - According to John Keay , he was `` country bred `` ( born and educated in India
-    ) .
-  - All For You was the third single of the third and last album `` Alive `` by Kate
-    Ryan .
-  - All For You was the third and last single of the third album of Kate Ryan `` Alive
-    `` .
+  - National players are Bold players .
+  - According to him , earth is the carrier of his artistic work being integrated
+    into the creative process only by minimal changes .
+  - According to him , earth is the carrier of his creative work being integrated
+    into the artistic process only by minimal changes .
 datasets:
-- redis/langcache-sentencepairs-v1
+- redis/langcache-sentencepairs-v2
 pipeline_tag: sentence-similarity
 library_name: sentence-transformers
 metrics:
@@ -72,32 +75,32 @@ model-index:
       type: information-retrieval
       name: Information Retrieval
     dataset:
-      name: train
-      type: train
+      name: test
+      type: test
     metrics:
     - type: cosine_accuracy@1
-      value: 0.5578696687594717
+      value: 0.5861241448475948
       name: Cosine Accuracy@1
     - type: cosine_precision@1
-      value: 0.5578696687594717
+      value: 0.5861241448475948
       name: Cosine Precision@1
     - type: cosine_recall@1
-      value: 0.53589188426978
+      value: 0.5679885764966713
       name: Cosine Recall@1
     - type: cosine_ndcg@10
-      value: 0.7523955452910316
+      value: 0.7729838064849864
       name: Cosine Ndcg@10
     - type: cosine_mrr@1
-      value: 0.5578696687594717
+      value: 0.5861241448475948
       name: Cosine Mrr@1
     - type: cosine_map@100
-      value: 0.6976030263836698
+      value: 0.7216697804426214
       name: Cosine Map@100
 ---
 
 # Redis fine-tuned BiEncoder model for semantic caching on LangCache
 
-This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Alibaba-NLP/gte-modernbert-base](https://huggingface.co/Alibaba-NLP/gte-modernbert-base) on the [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v1) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for sentence pair similarity.
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Alibaba-NLP/gte-modernbert-base](https://huggingface.co/Alibaba-NLP/gte-modernbert-base) on the [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for sentence pair similarity.
 
 ## Model Details
 
@@ -108,7 +111,7 @@ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [A
 - **Output Dimensionality:** 768 dimensions
 - **Similarity Function:** Cosine Similarity
 - **Training Dataset:**
-    - [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v1)
+    - [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
 - **Language:** en
 - **License:** apache-2.0
 
@@ -145,9 +148,9 @@ from sentence_transformers import SentenceTransformer
 model = SentenceTransformer("redis/langcache-embed-v3")
 # Run inference
 sentences = [
-    "All For You was the third and last single of Kate Ryan 's third album `` Alive `` .",
-    'All For You was the third and last single of the third album of Kate Ryan `` Alive `` .',
-    'All For You was the third single of the third and last album `` Alive `` by Kate Ryan .',
+    'According to him , the earth is the carrier of his artistic work , which is only integrated into the creative process by minimal changes .',
+    'According to him , earth is the carrier of his artistic work being integrated into the creative process only by minimal changes .',
+    'According to him , earth is the carrier of his creative work being integrated into the artistic process only by minimal changes .',
 ]
 embeddings = model.encode(sentences)
 print(embeddings.shape)
@@ -156,9 +159,9 @@ print(embeddings.shape)
 # Get the similarity scores for the embeddings
 similarities = model.similarity(embeddings, embeddings)
 print(similarities)
-# tensor([[0.9961, 0.9922, 0.9961],
-#         [0.9922, 1.0000, 0.9922],
-#         [0.9961, 0.9922, 1.0078]], dtype=torch.bfloat16)
+# tensor([[1.0000, 0.9961, 0.9922],
+#         [0.9961, 1.0000, 0.9961],
+#         [0.9922, 0.9961, 0.9961]], dtype=torch.bfloat16)
 ```
 
 <!--
@@ -191,17 +194,17 @@ You can finetune this model on your own dataset.
 
 #### Information Retrieval
 
-* Dataset: `train`
+* Dataset: `test`
 * Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
 
-| Metric             | Value      |
-|:-------------------|:-----------|
-| cosine_accuracy@1  | 0.5579     |
-| cosine_precision@1 | 0.5579     |
-| cosine_recall@1    | 0.5359     |
-| **cosine_ndcg@10** | **0.7524** |
-| cosine_mrr@1       | 0.5579     |
-| cosine_map@100     | 0.6976     |
+| Metric             | Value     |
+|:-------------------|:----------|
+| cosine_accuracy@1  | 0.5861    |
+| cosine_precision@1 | 0.5861    |
+| cosine_recall@1    | 0.568     |
+| **cosine_ndcg@10** | **0.773** |
+| cosine_mrr@1       | 0.5861    |
+| cosine_map@100     | 0.7217    |
 
 <!--
 ## Bias, Risks and Limitations
@@ -221,21 +224,21 @@ You can finetune this model on your own dataset.
 
 #### LangCache Sentence Pairs (all)
 
-* Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v1)
-* Size: 109,885 training samples
+* Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
+* Size: 126,938 training samples
 * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
 * Approximate statistics based on the first 1000 samples:
   |         | anchor                                                                            | positive                                                                          | negative                                                                          |
   |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                            | string                                                                            | string                                                                            |
-  | details | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 48 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 26.47 tokens</li><li>max: 61 tokens</li></ul> |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 48 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 26.54 tokens</li><li>max: 61 tokens</li></ul> |
 * Samples:
   | anchor                                                                                                                                      | positive                                                                                                                                      | negative                                                                                                                                      |
   |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|
   | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
   | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
   | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
-* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+* Loss: <code>losses.ArcFaceInBatchLoss</code> with these parameters:
   ```json
   {
       "scale": 20.0,
@@ -248,21 +251,21 @@ You can finetune this model on your own dataset.
 
 #### LangCache Sentence Pairs (all)
 
-* Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v1)
-* Size: 109,885 evaluation samples
+* Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
+* Size: 126,938 evaluation samples
 * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
 * Approximate statistics based on the first 1000 samples:
   |         | anchor                                                                            | positive                                                                          | negative                                                                          |
   |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                            | string                                                                            | string                                                                            |
-  | details | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 48 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 26.47 tokens</li><li>max: 61 tokens</li></ul> |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 48 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 26.54 tokens</li><li>max: 61 tokens</li></ul> |
 * Samples:
   | anchor                                                                                                                                      | positive                                                                                                                                      | negative                                                                                                                                      |
   |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|
   | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
   | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
   | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
-* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+* Loss: <code>losses.ArcFaceInBatchLoss</code> with these parameters:
   ```json
   {
       "scale": 20.0,
@@ -272,9 +275,9 @@ You can finetune this model on your own dataset.
   ```
 
 ### Training Logs
-| Epoch | Step | train_cosine_ndcg@10 |
-|:-----:|:----:|:--------------------:|
-| -1    | -1   | 0.7524               |
+| Epoch | Step | test_cosine_ndcg@10 |
+|:-----:|:----:|:-------------------:|
+| -1    | -1   | 0.7730              |
 
 
 ### Framework Versions
@@ -303,18 +306,6 @@ You can finetune this model on your own dataset.
 }
 ```
 
-#### MultipleNegativesRankingLoss
-```bibtex
-@misc{henderson2017efficient,
-    title={Efficient Natural Language Response Suggestion for Smart Reply},
-    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
-    year={2017},
-    eprint={1705.00652},
-    archivePrefix={arXiv},
-    primaryClass={cs.CL}
-}
-```
-
 <!--
 ## Glossary
 

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e5751153159fbe8c5f0461b1438392077d8a78eb76cea3ef88b53116443d1e6a
+oid sha256:95d02211c4cca89113f9f3e93ed91f5176bf50170faa2cb835f7bfea15bb9dd2
 size 298041696