SlowGuess/NAACL_2022_OCR huggingface dataset:
Diaz de Ilarraza, Peter Dirix, Kaja Dobrovoljc, Timothy Dozat, Kira Droganova, Puneet Dwivedi, Marhaba Eli, Ali Elkahky, Tomaz Erjavec, Richard Farkas, Hector Fernandez Alcalde, Jennifer Foster, Cláudia Freitas, Katarína Gajdová, Daniel Galbraith, Marcos Garcia, Moe Gärldens, Kim Gerdes, Filip Ginter, Iakes Goenaga, Koldo Gojenola, Memduh Gokirmak, Yoav Goldberg, Xavier Gómez Guinovart, Berta González Saavedra, Matias Grioni, Normunds Grūzītis, Bruno Guillaume, Nizar Habash, Jan Hajic, Jan Hajic jr., Linh Hà My, Kim Harris, Dag Haug, Barbora Hladka, Jaroslava Hlaváčová, Florinel Hociung, Petter Hohle, Radu Ion, Elena Irimia, Tomás Jelinek, Anders Johannsen, Fredrik Jørgensen, Hüner Kaşikara, Hi-roshi Kanayama, Jenna Kanerva, Tolga Kayadel-len, Václava Kettnerová, Jesse Kirchner, Natalia Kotsyba, Simon Krek, Veronika Laippala, Lorenzo Lambertino, Tatiana Lando, John Lee, Phuong Lê; Alessandro Lenci, Saran Lertpradit, Herman Leung, Cheuk Ying Li, Josie Li, Keying Li, Nikola Ljubesić, Olga Loginova, Olga Lyashevskaya, Teresa Lynn, Vivien Mactetanz, Aibek Makazhanov, Michael Mandl, Christopher Manning, Catalina Maranduc, David Mareček, Katrin Marheinecke, Héctor Martínez Alonso, Andre Martins, Jan Mašek, Yuji Matsumoto, Ryan McDonald, Gustavo Mendonça, Niko Miekka, Anna Missilä, Catalin Mitelulu, Yusuke Miyao, Simonetta Montemagni, Amir More, Laura Moreno Romero, Shinsuke Mori, Bohdan Moskalevskyi, Kadri Muischnek, Kaili Müürisep, Pinkey Nainwani, Anna Nedoluzhko, Gunta Nespore-Berzkalne, Luong Nguyen Thi, Huyen Nguyen Thi Minh, Vitaly Nikolaev, Hanna Nurmi, Stina Ojala, Petya Ostenova, Robert Ostling. Lilja Øvrelid, Elena Pascual, Marco Passarotti. Cenel-Augusto Perez, Guy Perrier, Slav Petrov. Jussi Piitulainen, Emily Pittler, Barbara Plank. Martin Popel. Lauma Pretkalnina Prokopis Prokopidis. Tiina Puolakainen. Sampa Pyysalo. Alexandre Rademaker. Loganathan Ramasamy. Taraka Rama. Vinit Ravishankar. Livy Real. Siva Reddy. Georg Rehm. Larissa Rinaldi. Laura Rituma. Mykhailo Romanenko. Rudolf Rosa. Davide Rovati. Benoit Sagot. Shadi Saleh. Tanja Samardžić. Manuela Sanguinetti. Baiba Saulite. Sebastian Schuster. Djame Seddah. Wolfgang Seeker. Mojgan Seraji. Mo Shen. Atsuko Shimada. Dmitry Sichinava. Natalia Silveira. Maria Simi. Radu Simionescu. Katalin Simko. María Šimková. Kiril Simov. Aaron Smith. Antonio Stella. Milan Straka. Jana Strnadóva. Alane Suhr. Umut Sulubacak. Zsolt Szántó. Dima Taji. Takaaki Tanaka. Trond Trosterud. Anna Trukhina. Reut Tsarfaty. Francis Tyers. Sumire Uematsu. Zdenka Urešová. Larraitz Uria. Hans Uszkoreit. Sowmya Vajjala. Daniel van Niekerk. Gertjan van Noord. Viktor Varga. Eric Villemonte de la Clergerie. Veronika Vincze. Lars Wallin. Jonathan North Washington. Mats Wiren. Tak-sum Wong. Zhuoran Yu. Zdeněk Žabokrtský. Amir Zeldes. Daniel Zeman and Hanzhi Zhu 2017 Universal dependencies 2.1. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics
Farhad Nooralahzadeh, Giannis Bekoulis, Johannes Bjerva, and Isabelle Augenstein. 2020. Zero-Shot Cross-Lingual Transfer with Meta Learning. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 4547-4562, Online. Association for Computational Linguistics.
Telmo Pires, Eva Schlinger, and Dan Garrette. 2019. How multilingual is multilingual BERT? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4996-5001, Florence, Italy. Association for Computational Linguistics.
Karolina Stanczak, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell, and Isabelle Augenstein. 2022. A Latent-Variable Model for Intrinsic Probing. arXiv preprint arXiv:2201.08214.
Lucas Torroba Hennigen, Adina Williams, and Ryan Cotterell. 2020. Intrinsic probing through dimension selection. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 197-216, Online. Association for Computational Linguistics.
Ivan Vulic, Edoardo Maria Ponti, Robert Litschko, Goran Glavaš, and Anna Korhonen. 2020. Probing pretrained language models for lexical semantics. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 7222-7240, Online. Association for Computational Linguistics.
Shijie Wu and Mark Dredze. 2019. Beto, bentz, becas: The surprising cross-lingual effectiveness of BERT. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 833–844, Hong Kong, China. Association for Computational Linguistics.
Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, and Colin Raffel. 2021. mT5: A massively multilingual pre-trained text-to-text transformer. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 483-498, Online. Association for Computational Linguistics.
Wei Zhao, Steffen Eger, Johannes Bjerva, and Isabelle Augenstein. 2021. Inducing language-agnostic multilingual representations. In Proceedings of *SEM 2021: The Tenth Joint Conference on Lexical and Computational Semantics*, pages 229–240, Online. Association for Computational Linguistics.
A Probed Property-Language Pairs
- ara (Arabic): Gender, Voice, Mood, Part of Speech, Aspect, Person, Number, Case, Definiteness
- heb (Hebrew): Part of Speech, Number, Tense, Person, Voice
- vie (Vietnamese): Part of Speech
- tam (Tamil): Part of Speech, Number, Gender, Case, Person, Finiteness, Tense
- afr (Afrikaans): Part of Speech, Number, Tense
- bel (Berlarusian): Part of Speech, Tense, Number, Aspect, Finiteness, Voice, Gender, Animacy, Case, Person
- bul (Bulgarian): Part of Speech, Definiteness, Gender, Number, Mood, Tense, Person, Voice, Comparison
- cat (Catalan): Gender, Number, Part of Speech, Tense, Mood, Person, Aspect
- ces (Czech): Part of Speech, Number, Case, Comparison, Gender, Mood, Person, Tense, Aspect, Polarity, Animacy, Possession, Voice
dan (Danish): Part of Speech, Number, Gender, Definiteness, Voice, Tense, Mood, Comparison
- deu (German): Part of Speech, Case, Number, Tense, Person, Comparison
- ell (Greek): Part of Speech, Case, Gender, Number, Finiteness, Person, Tense, Aspect, Mood, Voice, Comparison
- eng (English): Part of Speech, Number, Tense, Case, Comparison
- fas (Persian): Number, Part of Speech, Tense, Person, Mood, Comparison
- fra (French): Part of Speech, Number, Gender, Tense, Mood, Person, Polarity, Aspect
- gle (Irish): Tense, Mood, Part of Speech, Number, Person, Gender, Case
- glg (Galician): Part of Speech
- hin (Hindi): Person, Case, Part of Speech, Number, Gender, Voice, Aspect, Mood, Finiteness, Politeness
- hrv (Croatian): Case, Gender, Number, Part of Speech, Person, Finiteness, Mood, Tense, Animacy, Definiteness, Comparison, Voice
- ita (Italian): Part of Speech, Number, Gender, Person, Mood, Tense, Aspect
- lat (Latin): Part of Speech, Number, Gender, Case, Tense, Person, Mood, Aspect, Comparison
- lav (Latvian): Part of Speech, Case, Number, Tense, Mood, Person, Gender, Definiteness, Aspect, Comparison, Voice
- lit (Lithuanian): Tense, Voice, Number, Part of Speech, Finiteness, Mood, Polarity, Person, Gender, Case, Definiteness
- mar (Marathi): Case, Gender, Number, Part of Speech, Person, Aspect, Tense, Finiteness
- nld (Dutch): Person, Part of Speech, Number, Gender, Finiteness, Tense, Case, Comparison
- pol (Polish): Part of Speech, Case, Number, Animacy, Gender, Aspect, Tense, Person, Polarity, Voice
- por (Portuguese): Part of Speech, Person, Mood, Number, Tense, Gender, Aspect
- ron (Romanian): Definiteness, Number, Part of Speech, Person, Aspect, Mood, Case, Gender, Tense
- rus (Russian): Part of Speech, Case, Gender, Number, Animacy, Tense, Finiteness, Aspect, Person, Voice, Comparison
- slk (Slovak): Part of Speech, Gender, Case, Number, Aspect, Polarity, Tense, Voice, Animacy, Finiteness, Person, Mood, Comparison
- slv (Slovenian): Number, Gender, Part of Speech, Case, Mood, Person, Finiteness, Aspect, Animacy, Definiteness, Comparison
- spa (Spanish): Part of Speech, Tense, Aspect, Mood, Number, Person, Gender
- srp (Serbian): Number, Part of Speech, Gender, Case, Person, Tense, Definiteness, Animacy, Comparison
- swe (Swedish): Part of Speech, Gender, Number, Definiteness, Case, Tense, Mood, Voice, Comparison
- ukr (Ukrainian): Case, Number, Part of Speech, Gender, Tense, Animacy, Person, Aspect, Voice, Comparison
- urd (Urdu): Case, Number, Part of Speech, Person, Finiteness, Voice, Mood, Politeness, Aspect
- jpn (Japanese): Part of Speech
- eus (Basque): Part of Speech, Case, Animacy, Definiteness, Number, Argument Marking, Aspect, Comparison
- zho (Chinese): Part of Speech
- tur (Turkish): Case, Number, Part of Speech, Aspect, Person, Mood, Tense, Polarity, Possession, Politeness
- est (Estonian): Part of Speech, Mood, Finiteness, Tense, Voice, Number, Person, Case
- fin (Finnish): Part of Speech, Case, Number, Mood, Person, Voice, Tense, Possession, Comparison
B Pairwise Overlap by Morphosyntactic Category
Figure 6: The percentage overlap between the top-50 most informative dimensions in a randomly selected language model for each of the morphosyntactic categories. Statistically significant overlap is marked with an orange square.
(a) Animacy-m-BERT
(b) Aspect-XLM-R-base
(c) Comparison-XLM-R-large
(d) Definiteness-m-BERT
(e) Finiteness-XLM-R-base
(f) Gender-XLM-R-base
(g) Mood-XLM-R-large
(j) Part of Speech-XLM-R-large
(h) Person-m-BERT
(i) Polarity-XLM-R-large
(k) Possession-XLM-R-base
(1) Tense-XLM-R-base