# Towards standardized inflected lexicons for the Finnic languages

Jules Bouton

► To cite this version:

Jules Bouton. Towards standardized inflected lexicons for the Finnic languages. 9th International Workshop on Computational Linguistics for Uralic Languages, Association for Computational Linguistics, Nov 2024, Helsinki, Finland. pp.59-66. hal-04822038

HAL Id: hal-04822038

https://u-paris.hal.science/hal-04822038v1

Submitted on 5 Dec 2024

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Towards standardized inflected lexicons for the Finnic languages

Jules Bouton

Université Paris-Cité, LLF, CNRS

jules.bouton@u-paris.fr

## Abstract

We introduce three richly annotated lexicons of nouns for Livonian, standard Finnish and Livvi Karelian. Our datasets are distributed in the machine-readable Paralex standard, which consists of linked CSV tables described in a JSON metadata file. We built on the morphological dictionary of Livonian, the VepKar database and the Omorfi software to provide inflected forms. All noun forms were transcribed with grapheme-to-phoneme conversion rules and the paradigms annotated for both overabundance and defectivity. The resulting datasets are usable for quantitative studies of morphological systems and for qualitative investigations. They are linked to the original resources and can be easily updated.

# 1 Introduction

## 1.1 Rationale

Over recent years, the amount of morphological resources available for the Uralic languages has strongly increased. Reasons for this are (a) the efforts of Finno-Ugrists to provide dictionaries and translation tools for minority languages; (b) the interest of typologists for computational approaches to linguistic diversity. However, these resources are scattered across different standards and do not necessarily fit the needs of morphologists. Although recent researches in computational morphology rely on various approaches (e.g. Malouf, 2017; Baayen et al., 2019; Beniamine et al., 2021), they all share the need for high quality morphological data in phonemic transcription.

Several projects strive to provide good coverage of the numerous Finnic languages. Recently, lexicons following the UniMorph format have flourished: Finnish (Kirov et al., 2016); Estonian and Northern Sami (Kirov et al., 2018); Livvi, Livonian and several other (McCarthy et al., 2020); Võro (Batsuren et al., 2022). Despite its increasing size, Malouf et al. (2020) have shown the pit-

falls of UniMorph when it comes to linguistically informed studies of morphological variation. Semantic information, inflectional classes or frequencies are hard to extract and wordforms are provided in orthographical representations. The GiellaLT infrastructure (Pirinen et al., 2023) also provides access to dozens of morphological rule-based parsers. However, they are intended to enhance language-learning tools and they are not meant for morphological investigation either.

On the other hand, scholars and language institutes have developed their own resources, providing both inflected forms and rich annotation. Such resources are invaluable, but there is few of them. As a result of their dispersal, they are provided in different formats and through idiosyncratic infrastructures which make them less accessible for large scale comparative studies. Still, efforts for interoperability exist: in UniMorph 3.0, resources for Karelian languages are directly extracted from the VepKar database (McCarthy et al., 2020), although a lot of information is lost in the conversion, due to the limits of the UniMorph format.

Our lexicons in phonemic transcription are designed to fill this gap. We selected valuable, well-curated and rich resources for three Uralic languages from the Finnic group with very different backgrounds. Standard Finnish is the national language of Finland, spoken by around five million people in Finland.<fnref n="1" /> Livvi Karelian is a southern Karelian language spoken by 25,000 individuals in Russia, near lake Ladoga. Courland Livonian is a minority language spoken until the end of the 20th century on the coast of Courland. Although our pipeline can in theory be extended to verbs, this release only covers nouns. As our main contribution, we enriched the datasets with phonemic transcriptions and linguistic annotations.

<footnote n="1">¹Statistics are from the corresponding chapters of Bakró-Nagy et al. (2022).</footnote>
<table><caption>Table 1: Main properties of the three datasets</caption><thead><tr><th>Dataset</th><th>ISO</th><th>Licence</th><th>DOI</th><th>Cells</th><th>Lexemes</th><th>Forms</th></tr></thead><tbody><tr><td>ParaLiv</td><td>1.0</td><td>liv</td><td>CC BY-SA 4.0</td><td>10.5281/zenodo.11391421</td><td>16</td><td>6,769</td><td>110,449</td></tr><tr><td>ParaKar</td><td>1.0</td><td>olo</td><td>CC BY-SA 4.0</td><td>10.5281/zenodo.13736171</td><td>33</td><td>4,975</td><td>196,555</td></tr><tr><td>ParaFin</td><td>1.0</td><td>fin</td><td>GNU GPL v3</td><td>10.5281/zenodo.13736132</td><td>151</td><td>5,000</td><td>879,117</td></tr></tbody></table>

## 1.2 The Paralex format

Beniamine et al. (2023) introduced the Paralex standard<fnref n="2" />, which provides a structured way of representing morphological data. A Paralex dataset is a relational database constituted of CSV files linked together by relations. Beniamine et al. (2024) provide a detailed presentation of the structure of such a dataset. Thanks to the underlying Frictionless framework (Fowler et al., 2017), a Paralex dataset is adaptable to one’s needs but also machine-readable. Thus, the Paralex standard puts good data management practices (FAIR: Wilkinson et al. 2016; DEAR: Beniamine et al. 2023) at the core of the dataset development.

Paralex datasets are intended for morphologists. As such, they offer two crucial improvements over other formats: phonemic representations and rich annotations. Since orthographic representations of words often obfuscate crucial features, the inflected forms are provided both in orthographic and phonemic writing. The phonemic transcriptions are checked on development sets to avoid regressions and cover most of the morphologically meaningful contrasts. Allophony is left out when it doesn’t affect morphology. Paralex takes into account morphological diversity and has built-in methods to tag variants or defectivity (see below).

Our datasets follow these principles. They are made available on Zenodo under the names *ParaKar*, *ParaFin* and *ParaLiv* (see Table 1). The pipelines used to build the lexicons are available on Gitlab and ensure replicability of the results. Changes in the upstream sources can easily lead to updated versions of the datasets thanks to Zenodo’s versioning system. They are distributed under open-source licences.

# 2 Building the lexicons

## 2.1 Lexemes and forms

For Livonian, we relied on the morphological dictionary of the Livonian Institute (Ernštreits et al.,

2024), which itself builds on the Livonian dictionary by Viitso and Ernštreits (2012). In the absence of reliable frequency information, we provide support for all the nouns in the dictionary. We extracted the inflected wordforms and their properties as a JSON file and controlled the quality of the forms. A dozen of lexemes required upstream corrections and were ruled out. All the cells available in the dictionary were retained, which does not include lexicalized external local case forms. In compounds, the boundary between the components is marked. For phonological reasons, the derivatives ending in -nikā were treated as compounds, following Posti (1942, 301).

Similarly to Paralex datasets, the VepKar corpus used for Karelian (VepKar, 2009/2024; Boyko et al., 2022) is a relational database with annotated tables. Thus, converting the extracted tables was rather straightforward, despite the difference in the data structure (resp. CSV and MySQL). As for Livonian, the VepKar database provided preinflected forms for Livvi (Novak et al., 2020; Krizhanovskaya et al., 2024). Since VepKar has a better support for New Written Livvic, we focused on this variety of Livvi and excluded forms from other dialects. We retained all the lexemes that were attested at least once in the corpus. We replaced the accusative cell used in VepKar by genitive and nominative labels, depending on the form in question.<fnref n="3" /> We additionally filtered the database and corrected a few forms. VepKar features an affix column, which made it possible to insert a boundary in wordforms after the immutable part of the stem. Compounds are segmented.

The situation of Finnish is different as we did not use a database of wordforms. We selected the 5000 most frequent nouns from the frequency dataset provided with the LASTU software (Itkonen

<footnote n="3">³With respect to the accusative, the situation in Karelian is similar to that in Finnish. Bielecki (2009) shows that older descriptive grammars introduced an accusative while recent accounts only feature nominative and genitive. While syntacticians tend to agree in favour of an accusative (Holmberg and Nikanne, 1993), we adopt here a morphological perspective.</footnote>

<footnote n="2">²https://paralex-standard.org/</footnote>
et al., 2024), which in turn relies on the Finnish Parsebank (Luotolahti et al., 2015). We then matched those nouns with the internal resources of the Omorfi HFST (Pirinen, 2015; Pirinen et al., 2017) and used the generator to produce inflected forms. Although the interaction of clitics, case and number markers and personal suffixes leads to a large amount of paradigm cells, we decided to only retain the combination of case, number and possessive suffixes. In our dataset, this already amounts to 151 cells.<fnref n="4" /> Compounds and immutable stem boundaries are marked as well.

Table 1 summarizes the quantitative properties of the extracted datasets. All have around 5000 lexemes, which is a standard size for such resources (Beniamine et al., 2024).

## 2.2 Phonemic transcriptions

Grapheme-to-phoneme (G2P) transcription was performed with the Epitran software (Mortensen et al., 2018). Epitran requires a mapping of graphemes to phonemes and a set of pre- and post-processing regular expressions. For our datasets, we used a bundle of custom and modified rules.

For Livonian, we used a heavily modified version of the Estonian rules built for the Eesthetic package (Beniamine et al., 2024). Traditional accounts of Livonian phonology (Posti, 1942; Viitso, 2007) introduced numerous distinctions which are not always crucial for a phonemic description. For our transcription we relied on Tuisk's (2016) analysis and complemented it with previous accounts. We review the most crucial design choices.

Traditional accounts distinguish between short phonemes, long phonemes, short geminates and long geminates. We decided to keep a three-fold distinction for consonants and a two-fold opposition for vowels (ex 1). Due to the existence of feet isochrony (Viitso, 2007, 49), we mark the length of the first syllable coda when the second syllable is short (ex 2). Livonian is known for its tonal opposition (broken or plain) which affects accented syllables (Tuisk, 2015). We transcribe the broken tone as a property of vowels and polyphthongs and mark it with a superscript glottal stop ʔ (ex 3). We insert glides where required before orthographic <ž>, <j> and <v> (ex 3). Finally, Livonian displays a wide range of polyphthongs which were all documented. Table 2 showcases the triphthongs.

<table><caption>Table 2: Inventory of Livonian triphthongs found in our dataset</caption><thead><tr><th rowspan="2"></th><th colspan="2">Front-back</th><th colspan="2">Back-front</th></tr><tr><th>Plain</th><th>Broken</th><th>Plain</th><th>Broken</th></tr></thead><tbody><tr><th>All short</th><td>ieu</td><td>ieʔu</td><td>uoi</td><td>uoʔi</td></tr><tr><th>Last long</th><td>ieu:</td><td></td><td>uoi:</td><td></td></tr><tr><th>First long</th><td></td><td></td><td>u:oi</td><td>u:ʔoi</td></tr></tbody></table>

(1) a. kik → kik: 'rooster' NOM.SG
b. kikīd → kik'i:d NOM.PL
c. kikkō → kik:u: PART.SG

(2) a. mustā → mus'ta: 'black' NOM.SG
b. mustō → mus:tw PART.SG

(3) ke'ž → ke'jʒ 'flea'

For Finnish, we used a modified version of the Finnish G2P converter introduced in Epitran 1.25. We don't mark the allophones of /h/, /s/, /l/, /m/, /n/ (ex 4), but we added additional rules to distinguish diphthongs from vowel sequences (ex 5) in conformity with Suomi et al. (2008, 49-51). We marked as a glottal stop the stop that alternates with intervocalic /k/ during gradation (ex 6). Following Karlsson's (1983, 349) view, morphs triggering boundary lengthening were not considered in the phonemic transcription, but we documented them in the analysed orthographic and phonemic transcriptions with the superscript symbol x (ex 6).

(4) a. vihko → vihko 'notebook'
b. kohta → kohta 'place'

(5) a. hyötyä → hyøtyæ 'benefit'
b. aie → gje (gjex) 'intention'

(6) vaa'an → uα:ʔan 'scale'

The Karelian G2P is a slightly modified version of the Finnish one. It is based on Pyöli (2011), but was extended with more detailed sources (Novak et al., 2022; Arhimaa, 2022). The Livvi transcription covers the digraphs and affricates specific to Karelian (ex 7) and introduces support for the contextual palatalization of /l/, /n/, /r/, /d/ and /t/ (ex 8) following the principles described by Novak et al. (2022, 58). We included palatalized and voiced geminates and we took into account the existence of six triphthongs, although they do not occur in our dataset as they are limited to verbs.

(7) čondžoi → ſʃondʒoj 'flea'

(8) ellendys → elʔendys 'wisdom'

<footnote n="4">⁴For possessives, the values 3SG and 3PL are treated as syncretic. For instance, the cell NOM.SG.3 covers singular and plural possessors.</footnote>
<table><caption>Table 3: Mapping of the ILL.SG cell to other dialects</caption><tr><td>–</td><td>Our datasets</td><td>ill.sg</td></tr><tr><td>–</td><td>UD</td><td>N;IN+ALL;SG</td></tr><tr><td>–</td><td>UniMorph</td><td>Case=Ill|Number=Sing</td></tr><tr><td>fin</td><td>Omorfi</td><td>[NUM=SG][CASE=ILL]</td></tr><tr><td>olo</td><td>VepKar ID</td><td>10</td></tr><tr><td>liv</td><td>Liv. Institute</td><td>IllSg</td></tr><tr><td>liv</td><td>Tartu</td><td>sg.ill.</td></tr></table>

## 3 Rich annotations

**Phonemes and graphemes** For each dataset, we provided a grapheme inventory to ensure consistency in our orthographical sources. All three datasets also contain a machine-readable phoneme inventory with contrasting articulatory features.

**Features-values** To ensure compatibility with external resources, we linked our features and values to other standards. All datasets contain mappings to UniMorph (Sylak-Glassman et al., 2015) and Universal Dependencies (Nivre et al., 2016) dialects. Additionally, *ParaLiv* maps to the referential used by the Livonian Institute and the University of Tartu dialect corpus (Lindström et al., 2022), *ParaFin* maps to the Omorfi encoding and *ParaKar* to the VepKar unique identifiers. These mappings have proven valuable in extracting token frequencies (see below). An overview of the mappings offered in the three datasets is provided for the illative singular cell in Table 3.

**Overabundance and defectivity** In the Paralex format, each wordform is assigned a record. If two forms are available for a given cell, a case of overabundance (Thornton, 2019), two records are created. If a cell has no known form, a record is still created with the label #DEF#. For such non-canonical phenomena, we provide semantic annotations to distinguish overabundant forms and to make explicit the reason for defectivity. For instance, in Finnish, the third person possessive suffix takes two forms: -nsA or -Vn. Such forms are tagged *poss nsA* and *poss Vn*. A record can have several tags.<fnref n="5" /> Concerning defectivity, Omorfi and VepKar tend to provide extensive paradigms.<fnref n="6" />

This can partly be explained by the difficulty of assessing the defectivity of a given form, due to low frequency effects (Nikolaev and Bermel, 2023).

**Frequencies** Paralex lexicons can optionally store frequencies at three different levels: cells, forms and lexemes. As for our lexicons, we provide all frequencies for Finnish and Livvi, but only cell frequencies for Livonian.

The frequencies were extracted from the Finnish dataset provided with the LASTU software (Itkonen et al., 2024), which in turn relies on the Finnish Parsebank (Luotolahti et al., 2015). We used the frequency table for forms occurring at least 10 times in the parsebank. We matched the universal dependency features used in the original dataset with our own cells and ruled out all inconsistent annotations. In further versions of the dataset, we plan to introduce frequencies directly extracted from the parsebank. For lexemes, we use the cumulated lexeme frequencies already provided by the LASTU dataset. For Karelian, we used the annotated VepKar corpus to extract form, lexeme and cell frequencies. For Livonian, we extracted word frequencies from the Estonian Dialects Corpus (Lindström et al., 2019, 2022) and grouped them by cell. This corpus was to small to assign a frequency to the lexemes or to the forms.

## 4 Conclusion

We introduced inflected lexicons for three Finnic languages: Livonian, Finnish and Livvi. We reviewed current practices in Uralic language resources and emphasized the importance of rich, machine-readable formats to facilitate cross-linguistic studies of morphological systems. We presented the design choices for our datasets and introduced our linguistically motivated grapheme-to-phoneme rules. We outlined the annotations that we performed. Appendix A showcases the main tables of one of the resulting datasets.

Although we did our best to manually check the transcriptions by evaluating random samples of forms and by carrying out targeted verifications, it is very likely that some mistakes remain, especially for loanwords. In addition to improved transcriptions, further versions should include more morphological annotations (e.g. information on stem gradation according to traditional descriptions) and reference other sources of frequencies (especially for Finnish). The datasets could also be extended to verbal inflection.

<footnote n="5">⁵Some forms follow idiosyncratic patterns and are not tagged. The percentage of untagged forms is: 1.27% in *ParaFin*, 4.24% in *ParaLiv* and 5.08% in *ParaKar*.</footnote>

<footnote n="6">⁶In Omorfi, only *pluralia tantum* appear as defective.</footnote>
## Acknowledgments

We are thankful to the Livonian Institute, the Karelian Research Center and the developers of Omorfi for providing access to their morphological resources. The help of Tuuli Tuisk and Valts Erntreits was precious in answering our questions about Livonian phonology and the resources of the Livonian Institute. Olivier Bonami provided comments on this paper and Sacha Beniamine answered questions related to the datasets.

## References

Anneli Arhimaa. 2022. *Karelian*. In Marianne Bakró-Nagy, Johanna Laakso, and Elena Skribnik, editors, *The Oxford Guide to the Uralic Languages*, pages 269–290. Oxford University Press, Oxford.

R. Harald Baayen, Yu-Ying Chuang, Elnaz Shafaei-Bajestan, and James P. Blevins. 2019. *The Discriminative Lexicon: A Unified Computational Model for the Lexicon and Lexical Processing in Comprehension and Production Grounded Not in (De)Composition but in Linear Discriminative Learning*. *Complexity*, 2019:39.

Marianne Bakró-Nagy, Johanna Laakso, and Elena Skribnik. 2022. *The Oxford Guide to the Uralic Languages*. Oxford Guides to the World's Languages. Oxford University Press, Oxford.

Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Abbott Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya Samame, Delio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier López Francis, Arturo Oncevay, Juan López Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean-Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóga, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovskaya, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Wolinski, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko,

Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud'hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, and Ekaterina Vylomova. 2022. UniMorph 4.0: Universal Morphology. In *Proceedings of the Thirteenth Language Resources and Evaluation Conference (LREC 2022)*, pages 840–855, Marseille, France. European Language Resources Association (ELRA).

Sacha Beniamine, Mari Aigro, Matthew Baerman, Jules Bouton, and Maria Copot. 2024. *Eesthetic: A Paralex Lexicon of Estonian Paradigms*. In *Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)*, pages 5526–5537, Torino, Italia. European Language Resources Association (ELRA) and International Committee on Computational Linguistics (ICCL).

Sacha Beniamine, Cormac Anderson, Mae Carroll, Matías Guzmán Naranjo, Borja Herce, Matteo Pellegrini, Erich Round, Helen Sims-Williams, and Tiago Tresoldi. 2023. *Paralex: a DeAR standard for rich lexicons of inflected forms*. In *International Symposium of Morphology (ISMo 2023)*, Nancy, France. https://www.paralex-standard.org.

Sacha Beniamine, Olivier Bonami, and Ana R. Luís. 2021. *The fine implicative structure of European Portuguese conjugation*. *Isogloss*. *Open Journal of Romance Linguistics*, 7:1–35.

Robert Bielecki. 2009. *On the Nature of the Accusative in Finnish*. *Lingua Posnaniensis*, 51(1):19–38.

Tatyana Boyko, Nina Zaitseva, Natalia Krizhanovskaya, Andrew Krizhanovsky, Irina Novak, Nataliya Pellinen, and Aleksandra Rodionova. 2022. *The Open Corpus of the Veps and Karelian Languages: Overview and Applications*. *KnE Social Sciences*, 7(3):29–40.

Valts Ernštreits, Tiit-Rein Viitso, and Milda Kurp piece. 2024. Livonian morphology database. http://www.livonian.tech.

Dan Fowler, Jo Barratt, and Paul Walsh. 2017. *Fric tionless Data: Making Research Data Quality Vis ible*. *International Journal of Digital Curation*, 12(2):274–285.

Anders Holmberg and Urpo Nikanne, editors. 1993. *Case and Other Functional Categories in Finnish Syntax*. Number 39 in Studies in Generative Gram mar. De Gruyter Mouton.

Sami Itkonen, Tuomo Häikiö, Seppo Vainio, and Minna Lehtonen. 2024. *LASTU: A psycholinguistic search tool for Finnish lexical stimuli*. *Behavior Re search Methods*, 56(6):6165–6178.
Fred Karlsson. 1983. *Suomen kielen äänne- ja muotorakenne*. Werner Söderström, Porvoo, Finland.

Christo Kirov, Ryan Cotterell, John Sylak-Glassman, Géraldine Walther, Ekaterina Vylomova, Patrick Xia, Manaal Faruqui, Sabrina J. Mielke, Arya McCarthy, Sandra Kübler, David Yarowsky, Jason Eisner, and Mans Hulden. 2018. UniMorph 2.0: Universal Morphology. In *Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)*, Miyazaki, Japan. European Language Resources Association (ELRA).

Christo Kirov, John Sylak-Glassman, Roger Que, and David Yarowsky. 2016. Very-large Scale Parsing and Normalization of Wiktionary Morphological Paradigms. In *Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016)*, pages 3121–3126, Portorož, Slovenia. European Language Resources Association (ELRA).

Natalia Krizhanovskaya, Irina Novak, and Nataliya Pellinen. 2024. Pravila generacii imennyh slovoform po minimizirovannomu šablonu dlâ novopis'mennyh variantov sobstvenno karel'skogo i livvikovskogo narečij.

Liina Lindström, Pärtel Lippus, and Tuuli Tuisk. 2019. The online database of the University of Tartu Archives of Estonian Dialects and Kindred Languages and the Corpus of Estonian Dialects. *Uralica Helsingiensia*, (14):327–350.

Liina Lindström, Triin Todesk, and Maarja-Liisa Pilvik. 2022. Corpus of Estonian Dialects.

Juhani Luotolahti, Jenna Kanerva, Veronika Laippala, Sampo Pyysalo, and Filip Ginter. 2015. Towards Universal Web Parsebanks. In *Proceedings of the Third International Conference on Dependency Linguistics (Depling 2015)*, pages 211–220, Uppsala, Sweden. Uppsala University.

Robert Malouf. 2017. *Abstractive morphological learning with a recurrent neural network*. *Morphology*, 27(4):431–458.

Robert Malouf, Farrell Ackerman, and Arturs Semenuks. 2020. Lexical databases for computational analyses: A linguistic perspective. In *Proceedings of the Society for Computation in Linguistics 2020*, pages 446–456, New York, New York. Association for Computational Linguistics (ACL).

Arya D. McCarthy, Christo Kirov, Matteo Grella, Amrit Nidhi, Patrick Xia, Kyle Gorman, Ekaterina Vylomova, Sabrina J. Mielke, Garrett Nicolai, Miikka Silfverberg, Timofey Arkhangelskiy, Nataly Krizhanovsky, Andrew Krizhanovsky, Elena Klyachko, Alexey Sorokin, John Mansfield, Valts Ernštreits, Yuval Pinter, Cassandra L. Jacobs, Ryan Cotterell, Mans Hulden, and David Yarowsky. 2020. UniMorph 3.0: Universal Morphology. In *Proceedings of the Twelfth Language Resources and Evaluation Conference (LREC 2020)*, pages 3922–3931, Marseille, France. European Language Resources Association (ELRA).

David R. Mortensen, Siddharth Dalmia, and Patrick Littell. 2018. Epitran: Precision G2P for Many Languages. In *Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)*, pages 2711–2714, Miyazaki, Japan. European Language Resources Association (ELRA).

Alexandre Nikolaev and Neil Bermel. 2023. *Study-ing negative evidence in Finnish language corpora*. *Word Structure*, 16(2-3):206–232.

Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter, Yoav Goldberg, Jan Hajič, Christopher D. Manning, Ryan McDonald, Slav Petrov, Sampo Pyysalo, Natalia Silveira, Reut Tsarfaty, and Daniel Zeman. 2016. Universal Dependencies v1: A Multilingual Treebank Collection. In *Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016)*, pages 1659–1666, Portorož, Slovenia. European Language Resources Association (ELRA).

Irina Novak, Natalia Krizhanovskaya, Tat'jana Bojko, and Nataliya Pellinen. 2020. *Development of rules of generation of nominal word forms for new-written variants of the Karelian language*. *Bulletin of Ugric studies*, 10(4):679–691.

Irina Novak, Martti Penttonen, Aleksi Ruuskanen, and Lea Siilin. 2022. *Karelian in Grammars: A study of phonetic and morphological variation*. Karelian Research Centre of the Russian Academy of Sciences, Petroskoi.

Flammie Pirinen, Sjur Moshagen, and Katri Hiovain-Asikainen. 2023. *GiellaLT* — a stable infrastructure for Nordic minority languages and beyond. In *Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa)*, pages 643–649, Tórshavn, Faroe Islands. University of Tartu Library.

Tommi A. Pirinen. 2015. Development and Use of Computational Morphology of Finnish in the Open Source and Open Science Era: Notes on Experiences with Omorfi Development. *SKY Journal of Linguistics*, 28:381–393.

Tommi A. Pirinen, Inari Listenmaa, Ryan Johnson, Francis M. Tyers, and Juha Kuokkala. 2017. Open morphology of Finnish. University of Helsinki.

Lauri Posti. 1942. *Grundzüge der livischen Lautgeschichte*. Number 75 in Mémoires de la Société Finno-Ougrienne. University of Helsinki, Helsinki.

Raija Pyöli. 2011. *Livvinkarjalan kielioppi*. Karjalan kielen seura, Helsinki.

Kari Suomi, Juhani Toivanen, and Riikka Ylitalo. 2008. *Finnish sound structure: phonetics, phonology, phonotactics and prosody*. Number 9 in Studia Humaniora Ouluensia. University of Oulu, Oulu.
John Sylak-Glassman, Christo Kirov, David Yarowsky, and Roger Que. 2015. A Language-Independent Feature Schema for Inflectional Morphology. In *Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)*, pages 674–680, Beijing, China. Association for Computational Linguistics (ACL).

Anna Maria Thornton. 2019. Overabundance: A Canonical Typology. In Franz Rainer, Francesco Gardani, Wolfgang U. Dressler, and Hans Christian Luschützky, editors, *Competition in Inflection and Word-Formation*, number 5 in Studies in Morphology, pages 223–258. Springer, Cham.

Tuuli Tuisk. 2015. Acoustics of Stød in Livonian. In *Proceedings of the 18th International Congress of Phonetic Sciences*, Glasgow, UK. University of Glasgow.

Tuuli Tuisk. 2016. Main features of the Livonian sound system and pronunciation. *Eesti ja soome-ugri keeleteaduse ajakiri. Journal of Estonian and Finno-Ugric Linguistics*, 7(1):121–143.

VepKar. 2009/2024. Open Corpus of Veps and Karelian languages. http://dictorpus.krc.karelia.ru/.

Tiit-Rein Viitso. 2007. Livonian Gradation: Types and Genesis. *Linguistica Uralica*, 43(1):45.

Tiit-Rein Viitso and Valts Ernštreits. 2012. *Līvōkīel-ēstikīel-lełkīel sōnārōntōz = Liivi-eesti-läti sōn-araamat = Lībiešu-igaņu-latviešu vārdnīca*. University of Tartu, Tartu.

Mark D. Wilkinson, Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, Niklas Blomberg, Jan-Willem Boiten, Luiz Bonino da Silva Santos, Philip E. Bourne, Jildau Bouwman, Anthony J. Brookes, Tim Clark, Mercè Crosas, Ingrid Dillo, Olivier Dumon, Scott Edmunds, Chris T. Evelo, Richard Finkers, Alejandra Gonzalez-Beltran, Alasdair J. G. Gray, Paul Groth, Carole Goble, Jeffrey S. Grethe, Jaap Heringa, Peter A. C. 't Hoen, Rob Hooft, Tobias Kuhn, Ruben Kok, Joost Kok, Scott J. Lusher, Maryann E. Martone, Albert Mons, Abel L. Packer, Bengt Persson, Philippe Rocca-Serra, Marco Roos, Rene van Schaik, Susanna-Assunta Sansone, Erik Schultes, Thierry Sengstag, Ted Slater, George Strawn, Morris A. Swertz, Mark Thompson, Johan van der Lei, Erik van Mulligen, Jan Velterop, Andra Waagmeester, Peter Wittenburg, Katherine Wolstencroft, Jun Zhao, and Barend Mons. 2016. The FAIR Guiding Principles for scientific data management and stewardship. *Scientific Data*, 3(1):160018.
A Appendix: Sample tables from the ParaLiv dataset

<table><caption>(a) The forms table</caption><thead><tr><th>form_id</th><th>lexeme</th><th>cell</th><th>orth_form</th><th>phon_form</th><th>analysed_orth_form</th><th>analysed_phon_form</th><th>defectiveness_tag</th><th>overabundance_tag</th></tr></thead><tbody><tr><td>võrbõz_22999</td><td>22999</td><td>dat.pl</td><td>võrbõdön</td><td>v u: r b w d w n</td><td>võrbõdön</td><td>v u: r b w d w n</td><td></td><td></td></tr><tr><td>irī_13393</td><td>irī_13393</td><td>ill.sg</td><td>irī</td><td>ir i:</td><td>irī</td><td>ir i:</td><td></td><td>illsg_without_z</td></tr><tr><td>ērškõmõrapõz_12800</td><td>12800</td><td>ine.sg</td><td>ērškõmõrapõzõs</td><td>ērškõmõrapõzõs</td><td>ērškõmõrapõzõs</td><td>ērškõmõrapõzõs</td><td></td><td></td></tr><tr><td>passõr_18233</td><td>18233</td><td>dat.pl</td><td>passõrdön</td><td>p a s: w r d w n</td><td>passõrdön</td><td>p a s: w r d w n</td><td></td><td></td></tr><tr><td>vikāt_22643</td><td>22643</td><td>ine.pl</td><td>vikātis</td><td>v i k: a: t i s</td><td>vikātis</td><td>v i k: a: t i s</td><td></td><td></td></tr><tr><td>nõrkõz_17668</td><td>17668</td><td>ine.pl</td><td>nõrkõžis</td><td>n u: r i k w 3 i s</td><td>nõrkõžis</td><td>n u: r i k w 3 i s</td><td></td><td></td></tr><tr><td>silmadkõp_20193</td><td>20193</td><td>inn.pl</td><td>silmadkõpõdöks</td><td>s i: l m a d k: a: p w d w k s</td><td>silmadkõpõdöks</td><td>s i: l m a d k: a: p w d w k s</td><td></td><td></td></tr><tr><td>kõrtami_15156</td><td>15156</td><td>gen.pl</td><td>kõrtamiät</td><td>k w: r t a m i s t</td><td>kõrtamiät</td><td>k w: r t a m i s t</td><td></td><td></td></tr><tr><td>suolm_20758</td><td>20758</td><td>nom.pl</td><td>suolmõd</td><td>s u o: l m w d</td><td>suolmõd</td><td>s u o: l m w d</td><td></td><td></td></tr><tr><td>saländõm_19842</td><td>19842</td><td>ela.pl</td><td>saländõmist</td><td>s a l: n d u m i s t</td><td>saländõmist</td><td>s a l: n d u m i s t</td><td></td><td></td></tr></tbody></table>

<table><caption>(b) The lexemes table</caption><thead><tr><th>lexeme_id</th><th>label</th><th>inflection_class</th><th>POS</th></tr></thead><tbody><tr><td>armāiga_11913</td><td>armāiga</td><td>101</td><td>noun</td></tr><tr><td>skūolsoppiji_20388</td><td>skūolsoppiji</td><td>286</td><td>noun</td></tr><tr><td>ministrij_16883</td><td>ministrij</td><td>199</td><td>noun</td></tr><tr><td>kūjabulā_15356</td><td>kūjabulā</td><td>83</td><td>noun</td></tr><tr><td>pülēd_19079</td><td>pülēd</td><td>234</td><td>noun</td></tr><tr><td>azūmsõnā_11992</td><td>azūmsõnā</td><td>83</td><td>noun</td></tr></tbody></table>

<table><caption>(c) The cells table</caption><thead><tr><th>cell_id</th><th>POS</th><th>unimorph</th><th>ud</th><th>livonian_tech</th><th>tartu</th><th>frequency</th></tr></thead><tbody><tr><td>nom.sg</td><td>noun</td><td>N:NOM;SG</td><td>Case=Nom|Number=Sing</td><td>NomSg</td><td>sg.nom.</td><td>5410</td></tr><tr><td>gen.sg</td><td>noun</td><td>N:GEN;SG</td><td>Case=Gen|Number=Sing</td><td>GenSg</td><td>sg.gen.</td><td>3941</td></tr><tr><td>dat.sg</td><td>noun</td><td>N:DAT;SG</td><td>Case=Dat|Number=Sing</td><td>DatSg</td><td>sg.dat.</td><td>762</td></tr><tr><td>prt.sg</td><td>noun</td><td>N:PRT;SG</td><td>Case=Prt|Number=Sing</td><td>PrtSg</td><td>sg.tr.</td><td>1890</td></tr><tr><td>inn.sg</td><td>noun</td><td>N:INS;SG</td><td>Case=Ins|Number=Sing</td><td>InnSg</td><td>sg.ctr.</td><td>177</td></tr><tr><td>ill.sg</td><td>noun</td><td>N:IN+ALL;SG</td><td>Case=III|Number=Sing</td><td>IIIsg</td><td>sg.ill.</td><td>877</td></tr></tbody></table>

<table><caption>(d) The tags table</caption><thead><tr><th>sound_id</th><th>CLTS_id</th><th>syllabic</th><th>stress</th><th>long</th><th>half-long</th><th>consonantal</th><th>...</th></tr></thead><tbody><tr><td>j:</td><td>j:</td><td>0</td><td></td><td>1</td><td></td><td>0</td><td>...</td></tr><tr><td>k':</td><td>k':</td><td>0</td><td></td><td>0</td><td>1</td><td>1</td><td>...</td></tr><tr><td>i?u</td><td></td><td>1</td><td>1</td><td>0</td><td></td><td>0</td><td>...</td></tr><tr><td>r':</td><td></td><td>0</td><td></td><td>0</td><td>1</td><td>1</td><td>...</td></tr><tr><td>ieu:</td><td></td><td>1</td><td>1</td><td>0</td><td></td><td>0</td><td>...</td></tr><tr><td>o?'</td><td></td><td>1</td><td>1</td><td>1</td><td></td><td>0</td><td>...</td></tr></tbody></table>

<table><caption>(e) The tags table</caption><thead><tr><th>tag_id</th><th>tag_column_name</th><th>comment</th></tr></thead><tbody><tr><td>defective</td><td>defectiveness_tag</td><td>defective for unknown reasons</td></tr><tr><td>pluralia_tantum</td><td>defectiveness_tag</td><td>defective in singular because pluralia tantum</td></tr><tr><td>illsg_without_z</td><td>overabundance_tag</td><td>a parallel form for illatives; without z final consonant</td></tr><tr><td>illsg_with_z</td><td>overabundance_tag</td><td>a parallel form for illatives; with z final consonant</td></tr><tr><td>elasm_with_õ</td><td>overabundance_tag</td><td>a parallel form for consonantal words; with õ final vowel</td></tr><tr><td>elasm_without_õ</td><td>overabundance_tag</td><td>a parallel form for consonantal words; without õ final vowel</td></tr></tbody></table>

<table><caption>(f) The graphemes table</caption><thead><tr><th>grapheme_id</th><th>comment</th><th>canonical_order</th></tr></thead><tbody><tr><td>a</td><td></td><td>3</td></tr><tr><td>ā</td><td></td><td>4</td></tr><tr><td>k</td><td></td><td>18</td></tr><tr><td>o</td><td></td><td>24</td></tr><tr><td>r</td><td></td><td>29</td></tr><tr><td>z</td><td></td><td>39</td></tr></tbody></table>

<table><caption>Table 4: Excerpts from the forms, lexemes, cells, sounds, tags, graphemes, features tables from the ParaLiv package. Primary keys have a grey shading.</caption><thead><tr><th>value_id</th><th>label</th><th>POS</th><th>feature</th><th>unimorph</th><th>ud</th><th>livonian_tech</th><th>tartu</th><th>canonical_order</th></tr></thead><tbody><tr><td>nom</td><td>nominative</td><td>noun</td><td>case</td><td>NOM</td><td>Case=Nom</td><td>Nom</td><td>nom</td><td>1</td></tr><tr><td>gen</td><td>genitive</td><td>noun</td><td>case</td><td>GEN</td><td>Case=Gen</td><td>Gen</td><td>gen</td><td>2</td></tr><tr><td>prt</td><td>partitive</td><td>noun</td><td>case</td><td>PRT'</td><td>Case=Par</td><td>Prt</td><td>part</td><td>3</td></tr><tr><td>dat</td><td>dative</td><td>noun</td><td>case</td><td>DAT</td><td>Case=Dat</td><td>Dat</td><td>dat</td><td>4</td></tr><tr><td>inn</td><td>instrumental-comitative</td><td>noun</td><td>case</td><td>INS</td><td>Case=Ins</td><td>Inn</td><td>tr</td><td>5</td></tr><tr><td>ill</td><td>illative</td><td>noun</td><td>case</td><td>IN+ALL</td><td>Case=III</td><td>III</td><td>ill</td><td>6</td></tr></tbody></table>