Update README.md
Browse files
README.md
CHANGED
|
@@ -8,6 +8,8 @@ tags:
|
|
| 8 |
### cambridgeltl/mirror-roberta-base-sentence-drophead
|
| 9 |
An unsupervised sentence encoder proposed by [Liu et al. (2021)](https://arxiv.org/pdf/2104.08027.pdf), using [drophead](https://aclanthology.org/2020.findings-emnlp.178.pdf) instead of dropout as feature space augmentation. The model is trained with unlabelled raw sentences, using [roberta-base](https://huggingface.co/roberta-base) as the base model. Please use `[CLS]` (before pooler) as the representation of the input.
|
| 10 |
|
|
|
|
|
|
|
| 11 |
### Citation
|
| 12 |
```bibtex
|
| 13 |
@inproceedings{
|
|
|
|
| 8 |
### cambridgeltl/mirror-roberta-base-sentence-drophead
|
| 9 |
An unsupervised sentence encoder proposed by [Liu et al. (2021)](https://arxiv.org/pdf/2104.08027.pdf), using [drophead](https://aclanthology.org/2020.findings-emnlp.178.pdf) instead of dropout as feature space augmentation. The model is trained with unlabelled raw sentences, using [roberta-base](https://huggingface.co/roberta-base) as the base model. Please use `[CLS]` (before pooler) as the representation of the input.
|
| 10 |
|
| 11 |
+
Note the model does not replicate the exact numbers in the paper since the reported numbers in the paper are average of three runs.
|
| 12 |
+
|
| 13 |
### Citation
|
| 14 |
```bibtex
|
| 15 |
@inproceedings{
|