intfloat commited on
Commit
cf5b12e
1 Parent(s): 6ad1cd1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -2697,6 +2697,14 @@ Here are some rules of thumb:
2697
 
2698
  Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
2699
 
 
 
 
 
 
 
 
 
2700
  ## Citation
2701
 
2702
  If you find our paper or models helpful, please consider cite as follows:
 
2697
 
2698
  Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
2699
 
2700
+ **3. Why does the cosine similarity scores distribute around 0.7 to 1.0?**
2701
+
2702
+ This is a known and expected behavior as we use a low temperature 0.01 for InfoNCE contrastive loss.
2703
+
2704
+ For text embedding tasks like text retrieval or semantic similarity,
2705
+ what matters is the relative order of the scores instead of the absolute values,
2706
+ so this should not be an issue.
2707
+
2708
  ## Citation
2709
 
2710
  If you find our paper or models helpful, please consider cite as follows: