Colexifications for Bootstrapping Cross-lingual Datasets: The Case of Phonology, Concreteness, and Affectiveness (2023)

Abstract: Colexification refers to the linguistic phenomenon where a single lexical form is used to convey multiple meanings. By studying cross-lingual colexifications, researchers have gained valuable insights into fields such as psycholinguistics and cognitive sciences (Jack- son et al., 2019; Xu et al., 2020; Karjus et al., 2021; Schapper and Koptjevskaja-Tamm, 2022; FranÃ§ois, 2022). While several multilingual colexification datasets exist, there is untapped potential in using this information to bootstrap datasets across such semantic features. In this paper, we aim to demonstrate how colexifications can be leveraged to create such cross-lingual datasets. We showcase curation procedures which result in a dataset covering 142 languages across 21 language families across the world. The dataset includes ratings of concreteness and affectiveness, mapped with phonemes and phonological features. We further analyze the dataset along different dimensions to demonstrate potential of the proposed procedures in facilitating further interdisciplinary research in psychology, cognitive science, and multilingual natural language processing (NLP). Based on initial investigations, we observe that i) colexifications that are closer in concreteness/affectiveness are more likely to colexify ; ii) certain initial/last phonemes are significantly correlated with concreteness/affectiveness intra language families, such as /k/ as the initial phoneme in both Turkic and Tai-Kadai correlated with concreteness, and /p/ in Dravidian and Sino-Tibetan correlated with Valence; iii) the type-to-token ratio (TTR) of phonemes are positively correlated with concreteness across several language families, while the length of phoneme segments are negatively correlated with concreteness; iv) certain phonological features are negatively correlated with concreteness across languages. The dataset is made public online for further research.

## introduction semantic typology studies cross-lingual semantic categorization @xcite . within this area, the term "colexification" was first introduced and used by @xcite and @xcite to create semantic maps. the study of colexifications focuses on cross-lingual colexification patterns, where the same lexical form is used in distinct languages to express multiple concepts. for instance, mapu in mapudungun and apakee in ignaciano both express the concepts earth and world @xcite . colexifications have been found to be pervasive across languages and cultures. the investigation of colexifications have led to interesting findings across different fields, such as linguistic typology (schapper and koptjevskaja-tamm, 2022), psycholinguistics @xcite , cognitive science @xcite , but remain relatively unexplored in nlp @xcite . in recent years, with the increasing popularity of automatic methods and big data in linguistics, datasets such as concepticon @xcite and babelnet @xcite have been developed, affording large-scale cross-lingual semantic comparisons. the database of crosslingual colexifications (clics 3 ) @xcite was created based on the concepticon con-cepts, including 4,228 colexification patterns across 3,156 languages, to facilitate research in colexifications. studies have also been shown to curate large-scale colexification networks from babelnet, consisting of over 6 million synsets across 520 languages @xcite . while syntactic typology is relatively wellestablished in nlp @xcite @xcite @xcite @xcite @xcite , semantic typology has so far only been subject to limited research @xcite @xcite . as a relatively new topic in both semantic typology and nlp, colexifications covers a wide-range of languages and language families. in contrast, although the concepts of concreteness/abstractness and affectiveness (e.g., valence, dominance and arousal) have long been in the center stage of interdisciplinary research fields such as cognitive science, psychology, linguistics and neurophysiology @xcite @xcite , language coverage of such resources is severely limited, and curation prohibitively expensive. the study of phonemes and phonological features have furthermore been essential to, e.g., address the problems of non-arbitrariness in languages and investigating universals of spoken languages (de varda @xcite . studies such as @xcite demonstrate the genealogical stability (persistence) and susceptibility to change (diffusibility) via studying the patterns the phonemes/phonological forms and the colexifications across european languages. however, this study is limited to a small range of languages, and the investigated concepts are also restricted to 100-item swadesh list @xcite . with the proposed procedures, a wider range of concepts and the phonological forms across language families are curated. in this paper, we create a synset graph based on multilingual wordnet @xcite data from ba-belnet 5.0. we then develop a cross-lingual dataset that includes ratings of concreteness and affectiveness, as this approach yields more comprehensive data than using clics 3 . in addition, we meticulously select and organize phonemes and phonological features for the lexicons that represent the concepts. our methodology for data creation is not limited to the constructed dataset, as it has potential for broader applications. we showcase the versatility of our approach through analysis across various dimensions, and make our dataset freely available. ## related work colexifications the creation of semantic maps using cross-linguistic colexifications was initially formalized by @xcite . semantic maps are graphical representations of the relationship between recurring expressions of meaning in a language @xcite . this method is based on the idea that language-specific colexification patterns indicate the semantic proximity or relatedness between the meanings that are colexified @xcite . when analyzed crosslinguistically, colexification patterns can provide insights into various fields, such as cognitive principles recognition @xcite @xcite @xcite , diachronic semantic shifts in individual languages @xcite @xcite , and language contact evolution @xcite @xcite . @xcite conducted a study on cross-lingual colexifications related to emotions and found that different languages associate emotional concepts differently. for example, persian speakers associate grief closely with regret, while dargwa speakers associate it with anxiety. the variations in cultural background and universal structure in emotion semantics provide interesting insights into the field of nlp. @xcite analyzed colexifications from various sources, including babelnet, open multilingual wordnet, and clics 3 , and demonstrated that there is no universal colexification pattern. in the field of nlp, @xcite constructed a synset graph from babelnet to boost performance on lexical semantic similarity task. more recently, @xcite use colexifications to construct language embeddings and further model language similarities. our goal is to utilize colexifications to construct cross-lingual datasets, including diverse ratings and phonological forms and features, to support further research, particularly in low-resource languages where norms and ratings are notably scarce. norms and ratings a large number of words in high-resource languages have been assigned norms and ratings by researchers in psychology @xcite . norms and ratings of words are essential components in psychology, linguistics, and recently being widely used in nlp. norms refer to the typical frequency and context in which words are used in a particular language, while ratings represent subjective judgements of individuals on various dimensions such as concreteness, valence, arousal, and imageability. these norms and ratings can improve the performance on downstream tasks, such as sentiment analysis, emotion recognition, word sense disambiguation, and affective computing @xcite @xcite . the study of concreteness and abstractness of concepts is interdisciplinary and spans across various fields, including linguistics, psychology, psycholinguistics, and neurophysiology @xcite . concrete concepts are those that can be perceived by the senses, such as cat and moun-tain, while abstract concepts, like relationship and understanding, cannot be perceived by the senses. @xcite conducted a study on concreteness ratings for 37,058 english words and 2,896 two-word expressions, involving over 4,000 participants, which has provided insights across various linguistic disciplines. the concreteness ratings are based on a scale of 1 (abstract) to 5 (concrete). these ratings have been used in conjunction with various tasks such as classification of metaphoricity @xcite and animacy @xcite , as well as cultural studies @xcite . apart from concreteness, affective ratings are also essential for interdisciplinary research in psychology, linguistics and nlp. the affective norms for english words (anew) dataset, providing ratings of valence, arousal and dominance for english words, has been widely used in both psychology and nlp research @xcite . subsequently, the affective norms for french words (fan) and the affective norms for german words (angst) datasets, proving similar affective ratings for french and german words, respectively, have also been developed @xcite . the spanish version of anew is developed by @xcite . extending the english anew, @xcite covers nearly 14,000 english lemmas, providing ratings for valence (the pleasantness of a stimulus), arousal (the intensity of emotion provoked by a stimulus), and dominance (the degree of control exerted by a stimulus). for creating our dataset, we use the ratings from @xcite , see details in section 3. the data for linguistic norms and ratings is usually collected only for one language. for lowresource languages, such data is obviously lacking. using our procedures, the norms and ratings can be bootstrapped for low-resource languages by sharing cross-lingual concepts through colexifications. phonemes and phonological features while direct phonetic comparison across languages is difficult, a common practice in comparing phonological characteristics across languages is to combine similar sounds into one multilingual phone set @xcite . while more advanced methods for phonological typology do exist, e.g. @xcite , a basic approach to phonology is found via the international phonetic alphabet (ipa), which classifies sounds based on general phonological properties. in this vein, wikipron is created to serve as an open-source tool for mining phonemic pronunciation data from wikitionary and still under continuous maintenance @xcite . to this date, it contains more than 1,8 million word/pronunciations across 543 languages. 2 the pronunciations are given in ipa, and segmented in a way that ipa diacritics can be properly recognized @xcite . demonstrating that phonological features outperform character-based models, panphon is created and used for various ner-related tasks @xcite . to date, panphon is a database relating over 5,000 ipa segments to 24 subsegmental articulatory features. 3 it has been used for various purposes, such as cross-modal and cross-lingual study of iconicity in languages @xcite , and cross-linguistic phonosemantic correspondence using a deep-learning framework @xcite . in this paper, we build upon this work by diving into the relationship between phonological features, and the concreteness and affectiveness of sense lemmas across a wide set of languages. the paper is inspired by findings such that the sounds of words can influence their meaning and emotional impact. for example, words with round vowel sounds are often associated with positive emotions, while harsher, more angular sounds can convey negative emotions @xcite . this study aims to initiate the study on the intricate interplay between sound and affective/abstract meanings. ## dataset curation a colexification pattern refers to a case where two concepts are colexified, such as dad-pope shown in figure 1 . specifically, a colexification is an instance of a colexification pattern, such as far in danish, as shown in in order to leverage colexifications to create a cross-lingual dataset incorporating norms and ratings in psychology and other fields, we propose the following procedures for data curation and creation, as illustrated in fig. 2 . building the synset/concept graph in word-net, a sense is a discrete representation of one aspect of the meaning of a word. for example, the lemma bank can either mean the sense financial institution or the sense sloping mound. the set of near-synonyms for a sense is called a synset, which is a primitive in wordnet @xcite . synsets are groups of words sharing the same concept. in order to construct of colexification networks, i) the worddnet synsets are extracted from babelnet; ii) for each synset, all the included word senses with their lemmas in the regarding language are elicitated; iii) finally, the sets of synsets sharing the same lemmas are extracted to represent a sysnet graph, with nodes being the synsets and the edges being the lemmas and their languages. the construction of a synset graph from babelnet is first formalized in @xcite , and adapted by @xcite incorporating information of the languages and lemmas, see the algorithm 1. we adopt the algorithm presented in chen et al. ( 2023) return g s 20: end function a wordnet synset comprises a sense word, a part-of-speech (pos) tag, and a sense number, e.g., dad#n#1. the sense numbers indicate the prevalence of the use of senses, with the most frequently used sense labeled 1. the frequency of use is determined by how often a sense is tagged in semantic concordance texts. 4 our assumption is that the mean score of lexicon ratings, annotated by multiple humans across domains and languages, represents the ratings for the most prevalent sense. however, when it comes to cross-lingual synset-toconcept mapping, there may be variations in the sense annotations between languages. suppose that in french the main sense knot is knot#n#4, which refers to a unit of speed, while in english, the annotation for knot likely refers to an actual knot that you tie, which is the 1st sense for the synset. as a result, we cannot expect the same ratings of concreteness or affectiveness for these two different senses. therefore, to map synsets to concepts, we always select the initial sense of the synsets.. once filtered by the 1st sense of the synsets, as illustrated in phonemes extraction to facilitate analysis of phonetic characteristics cross-lingually in the context of colexifications and against ratings of concreteness and affectiveness, we extract phonemes from wikipron, which to this date includes 1,882,240 word/pronunciation pairs in 543 languages. 5 to map the pronunciations to our data, we mapped their word/language code pairs to the pairs of sense lemma/language code extracted from ba-belnet. as a result, there are 139,698 sense lemma/ phonemes pairs across 142 languages, presented as in phonological features extraction phonological features have been proposed as the foundation of spoken language universals. despite variations in phones across languages, the set of phonological features remains constant. phones can be constructed from a set of phonological features. in our study, we extract phonemes for sense lemmas and then further extract phonological (articulatory) features based on the subsegments using panphon. panphon generates 24 phonological features for each segment, such as syllabic, sonorant, consonantal, continuant, delayed release, lateral, nasal, strident, voice, spread glottis, constricted glottis, anterior, coronal, distributed, labial, high (vowel/consonant, not tone), low (vowel/consonant, not tone), back, round, elaric airstream mechanism (click), tense, long, hitone, hireg foot_4 . each feature is assigned a value of '1', '-1', or '0', where '1' indicates a positive value of the feature, '-1' indicates a negative value of the feature, and '0' indicates that the feature is absent for that sound. for instance, a vowel cannot possess consonant features, so it is marked as '0'. we use panphon to convert each phone into a vector with length 24 in our dataset. incorporating norms and ratings having built the concept graph from the synset graph by selecting the 1st senses of the synsets across languages, we map the concepts from databases containing norms and ratings to the concept graph. as shown in to conduct analysis of the correlations between phonemes/phonological features against the concreteness/affectiveness, the ratings for each phonemes are calculated as the average of the ratings of the included concepts, grouped by the phonemes and its language, respectively. undergoing these procedures, we create a dataset in 142 languages across 21 language families, including ratings in concreteness/affectivness, and phonemes for lemmas. the overall statistics of the data is shown in previous studies show that abstract concepts are often understood by reference to more concrete concepts @xcite , and words that first arise with concrete meanings often later gain an abstract one @xcite . @xcite leans on these findings to show that concepts more dissimilar in concreteness and affective valence are more likely to colexify. to test this, we calculate the correlation coefficients foot_5 between the number of colexifications and concreteness/affectiveness distances of the colexified concepts across languages. however, the results show the exact contrary to the previous theories and findings. as shown in since both distances of conreteness and affectiveness are correlated with colexifications, it is intuitive to assume they might be correlated to each other. to test this, we calcuate the correlation coefficients between each dimension of concreteness and affectiveness. as shown in fig. 4 , the distances of valence and dominance are correlated with each other stronger than other pairs. and, concreteness distance is not significantly correlated with any dimension of affectiveness. ## conclusion and future work in this study, we proposed a set of procedures to leverage colexifications to bootstrap cross-lingual datasets, incorporating human ratings of concreteness and affective meanings. the created dataset presents data in 142 languages across 21 language families and 5 language macro areas. however, the procedures can be applied beyond the datasets used in this paper. inspired by previous works, we test the correlations between i) the distance of concreteness/affectiveness and the number of colexifications; ii) the phonemes and concreteness/ affectiveness; and iii) the phonological features and the ratings. it is shown that i) colexifications closer in concreteness/effectiveness are more likely to colexify; ii) certian initial/last phonemes do present statistically significant correlations with the ratings across languages; and iii) there is a positive correlation between the phoneme diversity and concreteness; finally iv) certain phonological features are negatively correlated with the ratings. while it is difficult to draw any meaningful conclusions from this finding without a prior hypothesis, we hope that future work can use this dataset to make well-founded findings on the interactions between phonology, concreteness, and affectiveness. we have showcased the soundness and validity of our approach to curate data from different domains and create a cross-lingual dataset mapping the information. the initial analyses and findings could inspire further applications in nlp and also other fields, such as psychology and psycholingusitics, which we will explore extensively for future work. nevertheless, the analyses conducted in this study are confined to individual correlation tests, which are inadequate for reaching definitive conlusions. for future work, we will employ multivariate modeling techniques utilizing affective/concrete ratings and the phonetic features to delve deeper into understanding the connections between human conceptualization and sounds across diverse languages and cultures.