COL A'XN thest auto ens. I An Y LYCU A9 CZAIC YNA
Laura Slaughter¹, So Miyagawa³, Luis Morgado da Costa², Heike Behlmer³, Amir Zeldes 4, Hugo Lundhaug¹ ¹University of Oslo, Norway ²Nanyang Technological University, Singapore ³Georg-August-Universität Göttingen, Germany 4Georgetown University, USA Contents 20 minutes, 5 topics •  Brief overview of wordnets: What is a wordnet? •  Wordnets & CILI: How does a wordnet differ from a dictionary or lexicon? •  Coptic Wordnet: Where are the files and how do I get started? •  Applications of wordnets: What can I do with it? •  Improvements and future plans: Who is maintaining it and what are the future plans? TO X9 C7X1CC0YNA Brief Overview of Wordnets What is a wordnet? •  Started in mid-1980s by a psychologist, George A. Miller •  Establish psycholinguistics as an independent field of research
The first WordNet - Princeton WordNet (PWN) •  large lexical database of English •  nouns, verbs, adjectives and adverbs are grouped into sets of cognitive synonyms (synsets) •  each synset expresses a distinct concept •  synsets are interlinked by means of conceptual-semantic and lexical relations •  covers over 117,000 concepts and over 150,000 English words 4
Lexical Categories
•  Words are assigned to lexical categories: nouns, verbs, adjectives, adverbs •  Also other classes of concepts came later: determiners and other function words (pronouns, auxiliary words, conjunctions (coming soon)) •  Prepositions (still out)- but point of discussion •  Lexical relations between word forms ○  direct hypernym | inherited hypernym | sister term o antonym ○  derivationally related form •  W: (adj) happy [Related to: happiness] (enjoying or showing or marked by joy or pleasure) "a happy smile"; "spent many happy days on the beach"; "a happy marriage"
•  Semantic relations hold between word meanings. •  Inferred relations- all the male children of my mother are my brothers; shark is a fish and fish is an animal, then shark is an animal • Nouns •  hypernyms (canine is a hypernym of dog) •  hyponyms (dog is a hyponym of canine) •  meronym (window is a meronym of building) •  holonym (building is a holonym of window) • Verbs •  hypernyms (to perceive is a hypernym of to listen) •  troponym (to stroll is a troponym of to walk) •  entailment (to sleep is entailed by to snore)
1 WordNet Search - 3.1 - WordNet home page - Glossary - Help
• S: (v) plant (place something or someone in a certain position in order to secretly observe or deceive) "Plant a spy in Moscow"; "plant bugs in the dissident's apartment" • S: (v) plant, implant (put firmly in the mind) "Plant a thought in the students' minds"
Antonym, Pertainym, Participle
•  Fellbaum, Christiane. "WordNet." Theory and applications of ontology: computer applications. Springer, Dordrecht, 2010. 231-243. •  Global Wordnet Association (GWA) proceedings: http://globalwordnet.org/global-wordnet- conferences-2/ •  Useful links: •  Online Princeton Wordnet • https://wordnet.princeton.edu/ •  Joining Open Multilingual Wordnet • https://lr.soh.ntu.edu.sg/omw/join • Schemas • http://globalwordnet.github.io/schemas/
Wordnets and CILI
Wordnet vs Lexicon #1 Wordnet introduces the concept of a concept (synset), synset IDs for a set of synonyms, meaning is not based on the definition written but through the synonym list #2 Wordnet links these concepts and provides a hierarchy to traverse #3 Wordnet provides the potential to link to many other languages beyond the translations in a dictionary
• Wordnets are connected by linking concepts (synset IDs) •  Global Wordnet Association maintains a list (not complete) http://globalwordnet.org/wordnets-in-the-world/ •  Ancient Greek • Latin •  Arabic + Quranic Arabic WordNet • Hebrew •  Middle Ancient Chinese • Sanskrit
GWA: Global Wordnet Association
•  To promote the standardization of the specification of wordnets for all languages in the world, including: •  the standardization of the Common Inter-Lingual-Index (CILI) for inter-linking the wordnets of different languages, as a universal index of meaning •  the development of a common representation for wordnet data •  studies in lexical semantics- wordnet is output of this worldwide research •  To promote the development of guidelines and methodologies for building wordnets in new languages •  To promote the development of explicit criteria and definitions for verifying the relations in any language (C) X4(C) X1(C) YNOL
Common Inter-lingual Index (CILI)
•  A flat list of concepts, no lemmas and no structure, officially has no parts of speech; exists in relation with other wordnets •  Doesn’t presuppose a hierarchical structure, or that a concept exists in all languages •  CILI IDs are persistent, only deprecate or supercede, never change the meaning of a concept Bond, F., Vossen, P. T. J. M., McCrae, J., & Fellbaum, C. (2016). CILI: the Collaborative Interlingual Index. In V. Barbu Mititelu, C. Forăscu, P. T. J. M. Vossen, & C. Fellbaum (Eds.), Proceeding of the 8th Global WordNet Conference 2016.
13
- Artificial Classes versus Lexicalized Classes: instrumentality; natural object - Lexicalization differences of classes: container and artifact (object) are not lexicalized in Dutchィス
•  Slaughter, Laura, Wenjie Wang, Luis Morgado da Costa, and Francis Bond. "Enhancing the Collaborative Interlingual Index for Digital Humanities: Cross-linguistic analysis in the domain of theology." (2018) • http://compling.hss.ntu.edu.sg/events/2018-gwc/pdfs/gwc-2018-proceedings.pdf •  Concepts related to theology in the PWN are Anglo- Christian skewed. I worked with Wenjie - his main interests were in Buddhism, to examine concepts in PWN •  Examine available synsets in PWN that are relevant to support scholarly work on sacred texts •  Sunyata in sanskrit wordnet, emptiness in PWN: offering •  Could be useful to catalog specific named entities that are found within sacred texts and compare them with those available in existing wordnets- places, individuals, supernatural beings, mythical beasts, or objects with magical properties; WordNet is linked to DBpedia •  Should annotate with sacred texts, PWN never had theological texts so it is incomplete
You can add variations of lemmas, including orthographic variations and transliterations, as shown below. You can have various classes of transliteration, and if they are automatically generated, you can give them a confidence score. <LexicalEntry id="w613347"> <Lemma writtenForm="动物沟通" partOfSpeech="n" script="Hans"/> <Form writtenForm="dòngwùgõutõng" script="Latn-pinyin"> <Tag category="transliteration">pinyin</Tag> <Tag category="confidence">0.77</Tag> </Form> <Form writtenForm="dong4wu4gou1tong1" script="Latn-pinyin"> <Tag category="transliteration">pin1yin1</Tag> <Tag category="confidence">0.77</Tag> </Form> <Form writtenForm="dongwugoutong" script="Latn-pinyin"> <Tag category="transliteration">pinyin</Tag> <Tag category="confidence">0.77</Tag> </Form> </LexicalEntry> • Tags for orthographic variation and transliteration, regional dialects •  Diachronic meaning change tagging •  Wordnet structures are not pre- defined, so we can contribute to add additional tags as needed, for example “region” or “period”
•  Slides and link to GitHub are on the Coptic Wordnet page at UiO • https://www.tf.uio.no/english/ research/groups/coptic-texts-and- manuscripts/coptic-wordnet/ Laura Slaughter, Luis Morgado da Costa, So Miyagawa, Marco Buchler, Amir Zeldes, Hugo Lundhaug, and Heike Behlmer. 2019. The Making of Coptic Wordnet. In P. Vossen (Eds.) F. Bond, C. Fellbaum, editor, The 10th Global WordNet Conference (GWC 2018), held in Wroclaw, Poland, July 2019
Coptic Wordnet
Coptic Wordnet is a machine-readable lexical database of the Coptic language. It contains nouns, verbs, adjectives, and adverbs which are grouped into sets of synonyms called synsets. Each synset represents one underlying lexical concept. The current Coptic release is based on the Sahidic dialect. How do I get the data he data repository for Coptic Wordnet and license information can be found here. Laura Slaughter, Luis Morgado da Costa, So Miyagawa, Marco Buchler, Amir Zeldes, Hugo Lundhaug, and Heike Behlmer. 2019. The Making of Coptic Wordnet. In P. Vossen (Eds.) F. Bond, C. Fellbaum, editor, The 10th Global WordNet Conference (GWC 2018), held in Wroclaw, Poland, July 2019, forthcoming. Slides Release •  Creative Commons Attribution 4.0 International License (CC BY 4.0) • GitHub (coptic-wordnet): •  OMW tsv files to be used with Python NLTK •  WN-LMF format (for CILI) 18
Automated Construction Approach
•  Dictionaries (Crum, 1939. Oxford) •  Coptic Dictionary Online (English, French, German) •  MARCION (English, French, German, Czech, Greek) •  Dictionary of Greek Loan Words in Coptic (DDGLC) (Ancient Greek, English) •  Use word-aligned dictionaries between Coptic and the five other languages: English, Greek (modern + ancient), French, German, and Czech •  Naive algorithm, Multilingual Sense Intersection (Luis's project)
•  Ranking procedure: What is the likelihood that a coptic lemma x belongs to each of the meanings (concept/ synset) provided by the aligned lemmas in each language. •  Concepts suggested by more languages have a higher chance of being correct; the more matching lemmas in the set, the more likely it is correct •  Within concepts having same # of language matches, metrics to rank (ranking score): •  # of individual lemmas matched in each language • Part-of-speech congruency, •  Lemma-concept saturation level (i.e. for each concept being suggested, what percentage of lemmas was seen to inform the same concept, per language) •  Full description of this will be reported in a future paper (author: Luis Morgado da Costa) 1 coptic lemma had 9 possible concepts concept 1 has highest ranking
• 0,1,? 1: attesting the existence of the candidate sense, (i.e. the lemma was known to include the meaning proposed by the candidate synset) 0: rejecting the possibility that the candidate lemma could be used in the candidate sense, and the question mark ? “uncertain”
Coptic Wordnet Coverage

Notes About Coverage
•  Senses distributed among 25,871 synsets, fairly well across different parts of speech •  Cover about 77.4% of the list of 5000 core word senses in PWN, the usual measure for coverage for a WN •  7 senses per nominal synset •  12.2 senses per verbal synset •  May have so many senses because a single lemma can take many forms and spelling variation (future work to explore)
counted it it was “1”
•  What can you do with a wordnet that you cannot do with a lexicon? •  #1 Multilingual possibilities- can generate a new lexicon to another language •  #2 Robust language documentation, language study from linguistic perspective- 30+ years in the making of wordnet structure; big return on investment to use the structure provided; though making a wordnet is a long term commitment 25
•  A wordnet should be designed to facilitate automatic text analysis •  #1 use is Word Sense Disambiguation (WSD) •  e.g. bass is (1) a fish, (2) tones of low frequency •  Information retrieval, text mining, summarization, machine translation, sentiment analysis, question-answering, language generation
•  Text reuse, of interest to So because of his dissertation •  Traverse the hierarchy to find replacements •  Uses BabelNet (WordNets are used) •  Except for Ancient Greek, uses a flat file result of query to the AGWN database •  Results: found that it isn't enough to use hypernym to expand query, but needs to traverse the graph of relationships to find some optimal distance
Word-Sense Tagging
•  Multilingual Comparisons: Use CILI to create new contextualized concepts that would be interesting for other languages •  e.g. What is a “bank” for Coptic speakers? •  Diachronic change/conceptual shift: Concept alignments between other languages can be interesting for Coptic's context, along with diachronic change information, looking towards measuring “concept shift” or flow of ideas over time
•  Link Coptic WN to the Coptic Dictionary Online (CDO), following practices of Linked Open Data connected to CDO entries •  Larger evaluation where we have balanced the sample (w/number of languages) •  Determine a confidence score for each sense, filter the size of the wordnet depending on the task •  Text Reuse: TRACER application to find text reuse, replacing words, the WN provides synonyms, hypernyms, hyponyms, co-hyponyms (future paper, hierarchical traversal) •  Create and annotate a sense-tagged corpus, alongside the wordnet, gain word frequency information, test for coverage and review concepts in context •  Needs Funding!- #1 Priority, currently maintained at UiO, Oslo (me) and with the help of Luis (NTU, Singapore) and So (Kansai University, Japan)
Wish List
•  Additional work with TRACER and other text teuse applications •  Digital Humanities work within the domain of Theology, Digital Philology, CILI theology concepts, create better resource for working on scholarly texts •  Provide a tool for the study of Coptic-related language evolution, including the problems of concept drift (how concepts travel through space and time) •  Multilingual projects. Coptic WN, AGWN- these are places to start, though AGWN seems to be abandoned; or Egyptian •  Instructions for implementation, providing Python scripts for defined tasks, user-friendly visual way to work with the WN 30
Thanks!
• Thanks go to: •  So Miyagawa and Amir Zeldes for organizing the workshop •  Tonio Sebastian Richter and Katrin John from DDGLC •  Adam Rambousek for access to in-progress Czech Wordnet. •  Milan Konvicka for MARCION