GenAI4ELab/papercli-papers huggingface dataset:
Jambu: A historical linguistic database for South Asian languages
Authors: Aryaman Arora; Adam Farris; Samopriya Basu; Suresh Kolichala
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: We introduce JAMBU, a cognate database of South Asian languages which unifies dozens of previous sources in a structured and accessible format. The database includes nearly 287k lemmata from 602 lects, grouped together in 23k sets of cognates. We outline the data wrangling necessary to compile the dataset and train neural models for reflex prediction on the Indo- Aryan subset of the data. We hope that JAMBU is an invaluable resource for all historical linguists and Indologists, and look towards further improvement and expansion of the database.
Lightweight morpheme labeling in context: Using structured linguistic representations to support linguistic analysis for the language documentation context
Authors: Bhargav Shandilya; Alexis Palmer
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: Linguistic analysis is a core task in the process of documenting, analyzing, and describing endangered and less-studied languages. In addition to providing insight into the properties of the language being studied, having tools to automatically label words in a language for grammatical category and morphological features can support a range of applications useful for language pedagogy and revitalization. At the same time, most modern NLP methods for these tasks require both large amounts of data in the language and compute costs well beyond the capacity of most research groups and language communities. In this paper, we present a gloss-to-gloss (g2g) model for linguistic analysis (specifically, morphological analysis and part-of-speech tagging) that is lightweight in terms of both data requirements and computational expense. The model is designed for the interlinear glossed text (IGT) format, in which we expect the source text of a sentence in a low-resource language, a translation of that sentence into a language of wider communication, and a detailed glossing of the morphological properties of each word in the sentence. We first produce silver standard parallel glossed data by automatically labeling the high-resource translation. The model then learns to transform source language morphological labels into output labels for the target language, mediated by a structured linguistic representation layer. We test the model on both low-resource and high-resource languages, and find that our simple CNN-based model achieves comparable performance to a state-of-the-art transformer-based model, at a fraction of the computational cost.
Improving Automated Prediction of English Lexical Blends Through the Use of Observable Linguistic Features
Authors: Jarem Saunders
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: The process of lexical blending is difficult to reliably predict. This difficulty has been shown by machine learning approaches in blend modeling, including attempts using then state-of-the-art LSTM deep neural networks trained on character embeddings, which were able to predict lexical blends given the ordered constituent words in less than half of cases, at maximum. This project introduces a novel model architecture which dramatically increases the correct prediction rates for lexical blends, using only Polynomial regression and Random Forest models. This is achieved by generating multiple possible blend candidates for each input word pairing and evaluating them based on observable linguistic features. The success of this model architecture illustrates the potential usefulness of observable linguistic features for problems that elude more advanced models which utilize only features discovered in the latent space.
Colexifications for Bootstrapping Cross-lingual Datasets: The Case of Phonology, Concreteness, and Affectiveness
Authors: Yiyi Chen; Johannes Bjerva
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: Colexification refers to the linguistic phenomenon where a single lexical form is used to convey multiple meanings. By studying cross-lingual colexifications, researchers have gained valuable insights into fields such as psycholinguistics and cognitive sciences (Jack- son et al., 2019; Xu et al., 2020; Karjus et al., 2021; Schapper and Koptjevskaja-Tamm, 2022; FranÃ§ois, 2022). While several multilingual colexification datasets exist, there is untapped potential in using this information to bootstrap datasets across such semantic features. In this paper, we aim to demonstrate how colexifications can be leveraged to create such cross-lingual datasets. We showcase curation procedures which result in a dataset covering 142 languages across 21 language families across the world. The dataset includes ratings of concreteness and affectiveness, mapped with phonemes and phonological features. We further analyze the dataset along different dimensions to demonstrate potential of the proposed procedures in facilitating further interdisciplinary research in psychology, cognitive science, and multilingual natural language processing (NLP). Based on initial investigations, we observe that i) colexifications that are closer in concreteness/affectiveness are more likely to colexify ; ii) certain initial/last phonemes are significantly correlated with concreteness/affectiveness intra language families, such as /k/ as the initial phoneme in both Turkic and Tai-Kadai correlated with concreteness, and /p/ in Dravidian and Sino-Tibetan correlated with Valence; iii) the type-to-token ratio (TTR) of phonemes are positively correlated with concreteness across several language families, while the length of phoneme segments are negatively correlated with concreteness; iv) certain phonological features are negatively correlated with concreteness across languages. The dataset is made public online for further research.
Character alignment methods for dialect-to-standard normalization
Authors: Yves Scherrer
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper evaluates various character alignment methods on the task of sentence-level standardization of dialect transcriptions. We compare alignment methods from different scientific traditions (dialectometry, speech processing, machine translation) and apply them to Finnish, Norwegian and Swiss German dialect datasets. In the absence of gold alignments, we evaluate the methods on a set of characteristics that are deemed undesirable for the task. We find that trained alignment methods only show marginal benefits to simple Levenshtein distance. On this particular task, eflomal outperforms related methods such as GIZA++ or fast_align by a large margin.
SIGMORPHON–UniMorph 2023 Shared Task 0: Typologically Diverse Morphological Inflection
Authors: Omer Goldman; Khuyagbaatar Batsuren; Salam Khalifa; Aryaman Arora; Garrett Nicolai; Reut Tsarfaty; Ekaterina Vylomova
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: The 2023 SIGMORPHON–UniMorph shared task on typologically diverse morphological inflection included a wide range of languages: 26 languages from 9 primary language families. The data this year was all lemma-split, to allow testing models’ generalization ability, and structured along the new hierarchical schema presented in (Batsuren et al., 2022). The systems submitted this year, 9 in number, showed ingenuity and innovativeness, including hard attention for explainability and bidirectional decoding. Special treatment was also given by many participants to the newly-introduced data in Japanese, due to the high abundance of unseen Kanji characters in its test set.
SIGMORPHON–UniMorph 2023 Shared Task 0, Part 2: Cognitively Plausible Morphophonological Generalization in Korean
Authors: Canaan Breiss; Jinyoung Jo
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper summarises data collection and curation for Part 2 of the 2023 SIGMORPHON-UniMorph Shared Task 0, which focused on modeling speaker knowledge and generalization of a pair of interacting phonological processes in Korean. We briefly describe how modeling the generalization task could be of interest to researchers in both Natural Language Processing and linguistics, and then summarise the traditional description of the phonological processes that are at the center of the modeling challenge. We then describe the criteria we used to select and code cases of process application in two Korean speech corpora, which served as the primary learning data. We also report the technical details of the experiment we carried out that served as the primary test data.
Morphological reinflection with weighted finite-state transducers
Authors: Alice Kwak; Michael Hammond; Cheyenne Wing
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper describes the submission by the University of Arizona to the SIGMORPHON 2023 Shared Task on typologically diverse morphological (re-)infection. In our submission, we investigate the role of frequency, length, and weighted transducers in addressing the challenge of morphological reinflection. We start with the non-neural baseline provided for the task and show how some improvement can be gained by integrating length and frequency in prefix selection. We also investigate using weighted finite-state transducers, jump-started from edit distance and directly augmented with frequency. Our specific technique is promising and quite simple, but we see only modest improvements for some languages here.
Linear Discriminative Learning: a competitive non-neural baseline for morphological inflection
Authors: Cheonkam Jeong; Dominic Schmitz; Akhilesh Kakolu Ramarao; Anna Stein; Kevin Tang
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper presents our submission to the SIGMORPHON 2023 task 2 of Cognitively Plausible Morphophonological Generalization in Korean. We implemented both Linear Discriminative Learning and Transformer models and found that the Linear Discriminative Learning model trained on a combination of corpus and experimental data showed the best performance with the overall accuracy of around 83%. We found that the best model must be trained on both corpus data and the experimental data of one particular participant. Our examination of speaker-variability and speaker-specific information did not explain why a particular participant combined well with the corpus data. We recommend Linear Discriminative Learning models as a future non-neural baseline system, owning to its training speed, accuracy, model interpretability and cognitive plausibility. In order to improve the model performance, we suggest using bigger data and/or performing data augmentation and incorporating speaker- and item-specifics considerably.
Tü-CL at SIGMORPHON 2023: Straight-Through Gradient Estimation for Hard Attention
Authors: Leander Girrbach
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper describes our systems participating in the 2023 SIGMORPHON Shared Task on Morphological Inflection and in the 2023 SIGMORPHON Shared Task on Interlinear Glossing. We propose methods to enrich predictions from neural models with discrete, i.e. interpretable, information. For morphological inflection, our models learn deterministic mappings from subsets of source lemma characters and morphological tags to individual target characters, which introduces interpretability. For interlinear glossing, our models learn a shallow morpheme segmentation in an unsupervised way jointly with predicting glossing lines. Estimated segmentation may be useful when no ground-truth segmentation is available. As both methods introduce discreteness into neural models, our technical contribution is to show that straight-through gradient estimators are effective to train hard attention models.
The BGU-MeLeL System for the SIGMORPHON 2023 Shared Task on Morphological Inflection
Authors: Gal Astrach; Yuval Pinter
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper presents the submission by the MeLeL team to the SIGMORPHON–UniMorph Shared Task on Typologically Diverse and Acquisition-Inspired Morphological Inflection Generation Part 3: Models of Acquisition of Inflectional Noun Morphology in Polish, Estonian, and Finnish. This task requires us to produce the word form given a lemma and a grammatical case, while trying to produce the same error-rate as in children. We approach this task with a reduced-size character-based transformer model, multilingual training and an upsampling method to introduce bias.
Findings of the SIGMORPHON 2023 Shared Task on Interlinear Glossing
Authors: Michael Ginn; Sarah Moeller; Alexis Palmer; Anna Stacey; Garrett Nicolai; Mans Hulden; Miikka Silfverberg
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper presents the findings of the SIGMORPHON 2023 Shared Task on Interlinear Glossing. This first iteration of the shared task explores glossing of a set of six typologically diverse languages: Arapaho, Gitksan, Lezgi, Natügu, Tsez and Uspanteko. The shared task encompasses two tracks: a resource-scarce closed track and an open track, where participants are allowed to utilize external data resources. Five teams participated in the shared task. The winning team Tü-CL achieved a 23.99%-point improvement over a baseline RoBERTa system in the closed track and a 17.42%-point improvement in the open track.
LISN @ SIGMORPHON 2023 Shared Task on Interlinear Glossing
Authors: Shu Okabe; François Yvon
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper describes LISN”’“s submission to the second track (open track) of the shared task on Interlinear Glossing for SIGMORPHON 2023. Our systems are based on Lost, a variation of linear Conditional Random Fields initially developed as a probabilistic translation model and then adapted to the glossing task. This model allows us to handle one of the main challenges posed by glossing, i.e. the fact that the list of potential labels for lexical morphemes is not fixed in advance and needs to be extended dynamically when labelling units are not seen in training. In such situations, we show how to make use of candidate lexical glosses found in the translation and discuss how such extension affects the training and inference procedures. The resulting automatic glossing systems prove to yield very competitive results, especially in low-resource settings.
SigMoreFun Submission to the SIGMORPHON Shared Task on Interlinear Glossing
Authors: Taiqi He; Lindia Tjuatja; Nathaniel Robinson; Shinji Watanabe; David R. Mortensen; Graham Neubig; Lori Levin
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: In our submission to the SIGMORPHON 2023 Shared Task on interlinear glossing (IGT), we explore approaches to data augmentation and modeling across seven low-resource languages. For data augmentation, we explore two approaches: creating artificial data from the provided training data and utilizing existing IGT resources in other languages. On the modeling side, we test an enhanced version of the provided token classification baseline as well as a pretrained multilingual seq2seq model. Additionally, we apply post-correction using a dictionary for Gitksan, the language with the smallest amount of data. We find that our token classification models are the best performing, with the highest word-level accuracy for Arapaho and highest morpheme-level accuracy for Gitksan out of all submissions. We also show that data augmentation is an effective strategy, though applying artificial data pretraining has very different effects across both models tested.
An Ensembled Encoder-Decoder System for Interlinear Glossed Text
Authors: Edith Coates
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper presents my submission to Track 1 of the 2023 SIGMORPHON shared task on interlinear glossed text (IGT). There are a wide amount of techniques for building and training IGT models (see Moeller and Hulden, 2018; McMillan-Major, 2020; Zhao et al., 2020). I describe my ensembled sequence-to-sequence approach, perform experiments, and share my submission’s test-set accuracy. I also discuss future areas of research in low-resource token classification methods for IGT.
Glossy Bytes: Neural Glossing using Subword Encoding
Authors: Ziggy Cross; Michelle Yun; Ananya Apparaju; Jata MacCabe; Garrett Nicolai; Miikka Silfverberg
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper presents several different neural subword modelling based approaches to interlinear glossing for seven under-resourced languages as a part of the 2023 SIGMORPHON shared task on interlinear glossing. We experiment with various augmentation and tokenization strategies for both the open and closed tracks of data. We found that while byte-level models may perform well for greater amounts of data, character based approaches remain competitive in their performance in lower resource settings.
The SIGMORPHON 2022 Shared Task on Cross-lingual and Low-Resource Grapheme-to-Phoneme Conversion
Authors: Arya D. McCarthy; Jackson L. Lee; Alexandra DeLucia; Travis Bartley; Milind Agarwal; Lucas F.E. Ashby; Luca Del Signore; Cameron Gibson; Reuben Raff; Winston Wu
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: Grapheme-to-phoneme conversion is an important component in many speech technologies, but until recently there were no multilingual benchmarks for this task. The third iteration of the SIGMORPHON shared task on multilingual grapheme-to-phoneme conversion features many improvements from the previous year’s task (Ashby et al., 2021), including additional languages, three subtasks varying the amount of available resources, extensive quality assurance procedures, and automated error analyses. Three teams submitted a total of fifteen systems, at best achieving relative reductions of word error rate of 14% in the crosslingual subtask and 14% in the very-low resource subtask. The generally consistent result is that cross-lingual transfer substantially helps grapheme-to-phoneme modeling, but not to the same degree as in-language examples.
SIGMORPHON 2022 Shared Task on Grapheme-to-Phoneme Conversion Submission Description: Sequence Labelling for G2P
Authors: Leander Girrbach
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: This paper describes our participation in the Third SIGMORPHON Shared Task on Grapheme-to-Phoneme Conversion (Low-Resource and Cross-Lingual) (McCarthy et al.,2022). Our models rely on different sequence labelling methods. The main model predicts multiple phonemes from each grapheme and is trained using CTC loss (Graves et al., 2006). We find that sequence labelling methods yield worse performance than the baseline when enough data is available, but can still be used when very little data is available. Furthermore, we demonstrate that alignments learned by the sequence labelling models can be easily inspected.
Low-resource grapheme-to-phoneme mapping with phonetically-conditioned transfer
Authors: Michael Hammond
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: In this paper we explore a very simple nonneural approach to mapping orthography to phonetic transcription in a low-resource context with transfer data from a related language. We start from a baseline system and focus our efforts on data augmentation. We make three principal moves. First, we start with an HMMbased system (Novak et al., 2012). Second, we augment our basic system by recombining legal substrings in restricted fashion (Ryan and Hulden, 2020). Finally, we limit our transfer data by only using training pairs where the phonetic form shares all bigrams with the target language.
A future for universal grapheme-phoneme transduction modeling with neuralized finite-state transducers
Authors: Chu-Cheng Lin
Venue: ACL 2023 (Proceedings of the 20th SIGMORPHON workshop on Computational Research in Phonetics, Phonology, and Morphology)

Abstract: We propose a universal grapheme-phoneme transduction model using neuralized finite-state transducers. Many computational models of grapheme-phoneme transduction nowadays are based on the (autoregressive) sequence-to-sequence string transduction paradigm. While such models have achieved state-of-the-art performance, they suffer from theoretical limitations of autoregressive models. On the other hand, neuralized finite-state transducers (NFSTs) have shown promising results on various string transduction tasks. NFSTs can be seen as a generalization of weighted finite-state transducers (WFSTs), and can be seen as pairs of a featurized finite-state machine (‘marked finite-state transducer’ or MFST in NFST terminology), and a string scoring function. Instead of taking a product of local contextual feature weights on FST arcs, NFSTs can employ arbitrary scoring functions to weight global contextual features of a string transduction, and therefore break the Markov property. Furthermore, NFSTs can be formally shown to be more expressive than (autoregressive) seq2seq models. Empirically, joint grapheme-phoneme transduction NFSTs have consistently outperformed vanilla seq2seq models on grapheme-tophoneme and phoneme-to-grapheme transduction tasks for English. Furthermore, they provide interpretable aligned string transductions, thanks to their finite-state machine component. In this talk, we propose a multilingual extension of the joint grapheme-phoneme NFST. We achieve this goal by modeling typological and phylogenetic features of languages and scripts as optional latent variables using a finite-state machine. The result is a versatile graphemephoneme transduction model: in addition to standard monolingual and multilingual transduction, the proposed multilingual NFST can also be used in various controlled generation scenarios, such as phoneme-to-grapheme transduction of an unseen language-script pair. We also plan to release an NFST software package.