Linking the TUFS Basic Vocabulary to the Open Multilingual W ordnet (2020)

Abstract: We describe the linking of the TUFS Basic Vocabulary Modules, created for online language learning, with the Open Multilingual Wordnet. The TUFS modules have roughly 500 lexical entries in 30 languages, each with the lemma, a link across the languages, an example sentence, usage notes and sound files. The Open Multilingual Wordnet has 34 languages (11 shared with TUFS) organized into synsets linked by semantic relations, with examples and definitions for some languages. The links can be used to (i) evaluate existing wordnets, (ii) add data to these wordnets and (iii) create new open wordnets for Khmer, Korean, Lao, Mongolian, Russian, Tagalog, Urdua nd Vietnamese

## introduction in this paper we describe linking two complementary linguistic resources -the tufs basic vocabulary modules, created for online language learning @xcite , with the open multilingual wordnet (omw: @xcite . multilingual lexicons are still quite rare, with most created by linking various bilingual lexicons. the tufs basic vocabulary modules are hand created, using commonly occurring vocabulary (designed for beginning language learners). it includes some languages with few online language resources, like lao and khmer. because the lexicons are used by learners of single languages, the current interfaces do not allow easy access to them as a single multilingual resource. the first product of this paper is an easily accessible multilingual lexicon, based on the tufs vocabulary, fully documented and available from github. 1 the second is a high quality mapping between the tufs vocabulary and the open multilingual wordnet. the structure of the paper is as follows. we start off by introducing the tufs database, an open language resource, to provide context for the entries in § 1.1. next, in § 1.2, we briefly describe the omw. then, in § 2, we created machine tractable versions of the data. in § 3, we mapped the omw and tufs using the wordnet synsets and the translation sets. in § 3.1 we show the mapping process. § 3.2 shows special cases such as when hyponym relations were assigned or when a new entry was recommended for words with two distinct meanings that needed to be separated. § 4 discusses tufs can be used to evaluate the languages in the omw. ## creating the tufs translation sets the first task we did was to analyze the vocabulary for each language and link them into the translation sets. as part language translation meaning arabic (ar) ٌ ‫ﺎذ‬ ‫ﺘَ‬ ْ ‫ﺳ‬ ُٔ ‫ا‬ [noun] professor, teacher arabic in syria (as) ‫إﺳﺘﺎذ‬ ‫)أﺳﺎﺗﺬة:‪(brk‬‬ teacher german (de) lehrer (classrom) @xmath0. for primary school; feminine is institutrice french (fr) professeur teacher. professor; same for masculine and feminine. french (fr) enseignant teacher. teaching staff. teacher as a job. indonesian (id) guru teacher indonesian (id) dosen teacher japanese (ja) 先⽣ teacher; instructor; not used when referring to one's own job; doctor; ※ used when addressing a medical doctor in stead of "dr.-" central khmer (km) ្រគូ teacher korean (ko) 선생님 teacher lao (lo) ອາຈານ teacher mongolian (mn) багш teacher malay (ms) guru;cikgu teacher; instructor; not used when referring to one's own job; doctor; ※ used when addressing a medical doctor in stead of "dr.-" burmese (my) ဆရာ;ဆရာမ; teacher; instructor; not used when referring to one's ေကျာင် းဆရာ;ဆရာဝန် own job; doctor; ※ used when addressing a medical doctor in stead of "dr.-" por. in brazil (pb) professor teacher portuguese (pt) professor teacher russian (ru) учитель primary•middle•high school teacher; (преподаватель is used for university teachers) thai (th) อาจารย์ teacher tagalog (tl) titser teacher turkish (tr) öğretmen teacher urdu (ur) ‫استاد‬ teacher vietnamese (vi) cô giáo teacher (indicates a female teacher) vietnamese (vi) thầy giáo teacher (indicates a male teacher) mandarin chinese (zh) ⽼师 (py:lǎoshī) teacher ## linking omw and tufs in this section we describe the mapping between the tufs translation sets and wordnet synsets. this mapping will allow several tasks: (i) for languages with existing wordnets, we can do a general evaluation of their coverage ( § 4). it is hard to evaluate large multilingual lexicons as there is no one who can speak all languages. further, pure size is not a perfect metric -coverage of basic vocabulary is very important. like all selections, the tufs vocabulary has its quirks, but is a welcome addition to the current widely used testset of 5,000 core concepts @xcite based on the british national corpus. this is not multilingual -we can test for coverage in terms of synsets, but we have no idea if the language specific realizations are reasonable. in addition, tufs has pronunciation for all of the vocabulary, we intend to add links to this from omw. looking purely in terms of words, coverage of the tufs vocabulary varies very widely for wordnets in the omw, ## omw evaluation in this section, we give the results of measuring the coverage of the wordnets in omw (1.2), for the 503 translation sets. the results are shown in ## conclusions the tufs basic vocabulary modules were linked with the open multilingual wordnet. the tufs modules were created by hand, which provided basic vocabulary for languages with scarce online language resources like lao and khmer. the tufs interface provides modules which are bilingual resources for international students who wish to study japanese. fortunately, each module was connected by an id (tid) that corresponds to a basic japanese lemma. to make all languages accessible, a multilingual lexicon was produced, combining all translations and links to the respective modules under its tid. additionally, three bilingual speakers mapped the tufs data to the omw synsetstwo students from tufs evaluated the algorithm by assigning "confidence scores" and the final speaker (also the last author) further refined the mapping by making sure the links were correct. for example, warm should only be linked to the basic definition of it and not, say, an emotional connotation of kindness. this ensured a high quality mapping of the tufs basic vocabulary to the omw synsets.