SlowGuess/ACL_2020_OCR huggingface dataset:
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In *NAACL*, New Orleans, USA.
Kawin Ethayarajh. 2018. Unsupervised random walk sentence embeddings: A strong but simple baseline. In Workshop on Representation Learning for NLP, pages 91-100, Melbourne, Australia.
Basma Hassan, Samir E Abdelrahman, Reem Bahgat, and Ibrahim Farag. 2019. UESTS: An unsupervised ensemble semantic textual similarity method. IEEE Access, 7:85462-85482.
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, 9(8):1735-1780.
Douwe Kiela, Changhan Wang, and Kyunghyun Cho. 2018. Dynamic meta-embeddings for improved sentence representations. In EMNLP, pages 1466–1477, Brussels, Belgium.
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In NeurlPS, pages 3111-3119, Lake Tahoe, USA.
James O’Neill and Danushka Bollegala. 2018. Angular-based word meta-embedding learning. arXiv preprint arXiv:1808.04334.
Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. GloVe: Global vectors for word representation. In EMNLP, pages 1532-1543, Doha, Qatar.
Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. In NAACL-HLT, pages 2227-2237, New Orleans, USA.
Nina Poerner and Hinrich Schütze. 2019. Multiview domain adapted sentence embeddings for low-resource unsupervised duplicate question detection. In EMNLP-IJCNLP, Hong Kong, China.
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2019. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683.
Pushpendre Rastogi, Benjamin Van Durme, and Raman Arora. 2015. Multiview LSA: Representation learning via generalized CCA. In NAACL-HLT, pages 556-566, Denver, USA.
7032
Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. In EMNLP-IJCNLP, Hong Kong, China.
Shuai Tang and Virginia R de Sa. 2019. Improving sentence representations with multi-view frameworks. In Interpretability and Robustness for Audio, Speech and Language Workshop, Montreal, Canada.
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In NeurIPS, pages 5998-6008, Long Beach, USA.
John Wieting and Kevin Gimpel. 2018. ParaNMT-50M: Pushing the limits of paraphrastic sentence embeddings with millions of machine translations. In ACL, pages 451–462, Melbourne, Australia.
John Wieting and Douwe Kiela. 2019. No training required: Exploring random encoders for sentence classification. In *ICLR*, New Orleans, USA.
Wenpeng Yin and Hinrich Schütze. 2016. Learning word meta-embeddings. In ACL, pages 1351–1360, Berlin, Germany.
7033
single-source embeddings
meta-embeddings
method: dimensionality:	ParaNMT d=600	SBERT d=1024	USE d=512	conc d=2136	avg d=1024	svd d=1024	gcc a d=1024	ae d=1024
STS12
MSRpar	55.25/55.15	58.11/60.42	34.05/39.24	60.13/60.53	58.90/59.71	59.56/60.24	62.79/63.90	61.64/63.57
MSRvid	88.53/88.48	87.93/89.73	89.46/90.75	91.51/92.16	91.29/91.92	91.28/91.98	91.20/92.29	90.69/91.69
SMTeuropean	53.15/59.31	59.63/62.40	49.00/62.08	58.99/64.02	60.16/64.73	57.03/62.17	56.40/61.23	55.13/60.14
OnWN	73.42/69.82	68.08/68.51	71.66/65.81	77.89/73.05	77.53/73.00	77.80/73.12	77.90/73.50	75.35/73.03
SMTnews	67.03/58.53	60.75/53.11	68.66/61.29	74.85/66.53	74.54/66.88	73.73/66.48	75.75/67.31	74.91/64.76
STS13
FNWN	53.01/54.44	57.06/57.22	48.07/49.34	64.11/64.91	63.46/64.26	63.28/63.49	62.74/63.54	63.99/64.61
OnWN	75.62/75.80	77.54/80.00	66.64/68.10	80.84/81.13	80.46/80.81	79.89/80.53	84.04/83.65	80.17/81.50
SMT	42.54/41.13	44.54/44.80	43.85/41.80	47.46/44.89	47.87/45.04	48.59/45.58	49.20/46.01	48.92/45.40
headlines	79.52/79.83	73.67/77.17	70.70/71.82	81.13/83.48	80.64/82.96	81.49/83.54	82.58/84.37	80.78/82.13
STS14
OnWN	82.22/83.20	81.51/82.99	74.61/76.01	85.08/85.83	85.12/85.84	84.23/85.17	87.34/87.27	84.24/85.09
deft-forum	60.01/59.49	57.66/60.45	50.12/49.43	67.57/66.84	67.09/66.19	66.84/66.20	68.40/67.26	67.22/66.82
deft-news	77.46/72.75	72.62/76.80	68.35/63.35	81.72/79.04	81.60/78.98	80.36/78.31	81.09/79.20	79.59/78.83
headlines	78.85/76.98	73.72/75.41	65.88/62.34	79.64/79.93	79.39/79.86	79.85/79.59	81.68/81.50	80.13/79.77
images	86.14/83.36	84.57/79.42	85.54/80.55	89.52/85.68	89.35/85.51	89.29/85.37	88.83/84.83	87.64/83.42
tweet-news	79.39/73.43	75.12/70.80	72.48/64.24	82.50/76.50	82.12/76.13	83.14/77.17	83.09/77.04	81.61/77.23
STS15
answers-forums	73.54/74.50	64.04/62.78	72.70/75.02	79.33/79.91	78.47/79.12	79.15/79.69	78.39/78.59	72.65/72.21
answers-stud.	77.06/77.87	79.12/80.14	60.99/63.32	81.01/82.10	80.15/81.45	81.02/82.14	80.86/82.18	83.03/83.56
belief	80.28/80.25	77.46/77.46	78.68/82.14	86.14/87.58	85.55/87.01	85.05/86.02	86.38/87.58	82.49/83.07
headlines	81.92/82.28	78.91/81.88	73.26/74.77	83.20/86.03	83.33/86.25	83.48/86.02	84.87/86.72	84.16/85.53
images	88.60/88.87	86.76/89.02	88.39/90.34	90.92/91.95	90.86/91.92	90.46/91.59	90.34/91.85	90.26/91.35
STS16
answer-answer	69.71/68.96	63.41/66.63	72.52/72.72	79.65/78.89	78.93/77.82	79.37/79.21	78.70/78.50	76.83/77.17
headlines	80.47/81.90	75.23/79.33	69.70/75.11	80.97/84.95	80.60/84.53	81.36/85.14	81.41/84.85	80.40/83.17
plagiarism	84.49/85.62	80.78/82.04	74.93/77.42	85.86/87.17	85.88/87.25	85.54/87.36	85.92/87.76	85.01/86.14
postediting	84.53/86.34	81.32/85.87	82.81/86.49	88.18/90.76	87.98/90.51	87.55/90.21	87.01/90.24	86.71/89.28
question-quest.	72.37/72.73	63.38/64.72	68.54/70.25	75.49/77.42	76.05/77.76	74.08/75.93	73.44/74.98	73.25/73.60
Table 4: Pearson's  $r$  / Spearman's  $\rho  \times  {100}$  on individual sub-testsets of STS12-STS16. Boldface: best method in row.