intfloat commited on
Commit
c505dce
1 Parent(s): 9228c45

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -6095,6 +6095,14 @@ Here are some rules of thumb:
6095
 
6096
  Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
6097
 
 
 
 
 
 
 
 
 
6098
  ## Citation
6099
 
6100
  If you find our paper or models helpful, please consider cite as follows:
 
6095
 
6096
  Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
6097
 
6098
+ **3. Why does the cosine similarity scores distribute around 0.7 to 1.0?**
6099
+
6100
+ This is a known and expected behavior as we use a low temperature 0.01 for InfoNCE contrastive loss.
6101
+
6102
+ For text embedding tasks like text retrieval or semantic similarity,
6103
+ what matters is the relative order of the scores instead of the absolute values,
6104
+ so this should not be an issue.
6105
+
6106
  ## Citation
6107
 
6108
  If you find our paper or models helpful, please consider cite as follows: