fl399 commited on
Commit
b43ce13
1 Parent(s): d1ae5d2

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+
4
+ tags:
5
+ - sentence-embeddings
6
+ - sentence-similarity
7
+
8
+ ### cambridgeltl/trans-encoder-bi-simcse-roberta-large
9
+ An unsupervised sentence encoder (bi-encoder) proposed by [Liu et al. (2021)](https://arxiv.org/pdf/2109.13059.pdf). The model is trained with unlabelled sentence pairs sampled from STS2012-2016, STS-b, and SICK-R, using [princeton-nlp/unsup-simcse-bert-large-uncased](https://huggingface.co/princeton-nlp/unsup-simcse-bert-large-uncased) as the base model. Please use `[CLS]` (before pooler) as the representation of the input.
10
+
11
+ ### Citation
12
+ ```bibtex
13
+ @article{liu2021trans,
14
+ title={Trans-Encoder: Unsupervised sentence-pair modelling through self-and mutual-distillations},
15
+ author={Liu, Fangyu and Jiao, Yunlong and Massiah, Jordan and Yilmaz, Emine and Havrylov, Serhii},
16
+ journal={arXiv preprint arXiv:2109.13059},
17
+ year={2021}
18
+ }
19
+ ```